-- Logs begin at Wed 2022-09-07 15:30:48 UTC, end at Wed 2022-09-07 16:27:05 UTC. -- Sep 07 15:55:16.426218 dv-cinder-856174-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 07 15:55:16.433521 dv-cinder-856174-1-smb devstack@keystone.service[81611]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 15:55:16 2022] *** Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: nodename: dv-cinder-856174-1-smb Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: machine: x86_64 Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: clock source: unix Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: pcre jit disabled Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: detected number of CPU cores: 4 Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: current working directory: / Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: detected binary path: /usr/bin/uwsgi-core Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: your processes number limit is 47680 Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: your memory page size is 4096 bytes Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: detected max file descriptor number: 2048 Sep 07 15:55:16.435636 dv-cinder-856174-1-smb devstack@keystone.service[81611]: lock engine: pthread robust mutexes Sep 07 15:55:16.444254 dv-cinder-856174-1-smb devstack@keystone.service[81611]: thunder lock: enabled Sep 07 15:55:16.444254 dv-cinder-856174-1-smb devstack@keystone.service[81611]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 07 15:55:16.444254 dv-cinder-856174-1-smb devstack@keystone.service[81611]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 15:55:16.476175 dv-cinder-856174-1-smb devstack@keystone.service[81611]: Python main interpreter initialized at 0x555773a729c0 Sep 07 15:55:16.476175 dv-cinder-856174-1-smb devstack@keystone.service[81611]: python threads support enabled Sep 07 15:55:16.476175 dv-cinder-856174-1-smb devstack@keystone.service[81611]: your server socket listen backlog is limited to 100 connections Sep 07 15:55:16.476175 dv-cinder-856174-1-smb devstack@keystone.service[81611]: your mercy for graceful operations on workers is 90 seconds Sep 07 15:55:16.476559 dv-cinder-856174-1-smb devstack@keystone.service[81611]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 15:55:16.476635 dv-cinder-856174-1-smb devstack@keystone.service[81611]: *** Operational MODE: preforking *** Sep 07 15:55:16.476939 dv-cinder-856174-1-smb devstack@keystone.service[81611]: *** uWSGI is running in multiple interpreter mode *** Sep 07 15:55:16.476939 dv-cinder-856174-1-smb devstack@keystone.service[81611]: spawned uWSGI master process (pid: 81611) Sep 07 15:55:16.477149 dv-cinder-856174-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 07 15:55:16.478226 dv-cinder-856174-1-smb devstack@keystone.service[81611]: spawned uWSGI worker 1 (pid: 81620, cores: 1) Sep 07 15:55:16.478226 dv-cinder-856174-1-smb devstack@keystone.service[81611]: spawned uWSGI worker 2 (pid: 81621, cores: 1) Sep 07 15:55:16.478226 dv-cinder-856174-1-smb devstack@keystone.service[81611]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 15:55:20.806803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:55:20.806803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: from cryptography.utils import int_from_bytes Sep 07 15:55:20.807620 dv-cinder-856174-1-smb devstack@keystone.service[81621]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:55:20.807620 dv-cinder-856174-1-smb devstack@keystone.service[81621]: from cryptography.utils import int_from_bytes Sep 07 15:55:20.814793 dv-cinder-856174-1-smb devstack@keystone.service[81620]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:55:20.814793 dv-cinder-856174-1-smb devstack@keystone.service[81620]: from cryptography.utils import int_from_bytes Sep 07 15:55:20.815308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:55:20.815308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: from cryptography.utils import int_from_bytes Sep 07 15:55:20.859208 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 15:55:20.859390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 15:55:20.859575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] command line args: [] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 15:55:20.859848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 15:55:20.860035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ================================================================================ {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 15:55:20.860294 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] admin_token = **** {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.860543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] config_dir = [] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.860754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.860944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] config_source = [] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.861127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] debug = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.861329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.861697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.861876 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.862129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.862378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.862610 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] list_limit = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.862791 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] log_config_append = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.862970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.863147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] log_dir = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.863322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] log_file = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.863567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.863815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.864060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.864310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.864483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.864660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.864927 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.865174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.865406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.865638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.865871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.866101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.866347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.866592 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.866867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.867370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.867555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] publish_errors = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.867789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.868022 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.868202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.868450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.868706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 15:55:20.868793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.868937 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 15:55:20.869024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] standard_threads = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.869091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] command line args: [] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 15:55:20.869153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.869372 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 15:55:20.869455 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.869583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ================================================================================ {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 15:55:20.869669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.869730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] use_journal = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.869794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] admin_token = **** {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.869889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] use_json = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.870036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] config_dir = [] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.870129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] use_stderr = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.870225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] use_syslog = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.870306 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.870406 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] config_source = [] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.870491 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.870576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] debug = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.870702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.870783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.870940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.871036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.871182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.871257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.871427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.871502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.871676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.871761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.871908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] list_limit = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.871983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.872089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] log_config_append = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.872170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.872267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.872377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.872454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] log_dir = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.872610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] log_file = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.872711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.872874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.872969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.873163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.873253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.873521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.873603 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.873932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.874022 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.874129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.874228 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.874304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.874487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.874573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.874742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.874819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.874983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.875060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.875226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.875303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.875461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.875553 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.875695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.875772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.875946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.876023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.876197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.876287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.876458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.876547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.876731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.876984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.877073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.877199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] publish_errors = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.877290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.877393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.877475 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.877628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.877704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.877808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.877891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.878056 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.878137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.878290 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.878366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.878526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] standard_threads = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.878613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.878760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.878841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.879004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.879080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.879182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.879265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.879359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] use_journal = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.879470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.879545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] use_json = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.879697 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] use_stderr = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.879778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.879924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] use_syslog = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.880002 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.880095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:20.880171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.880354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.880429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.880596 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.880673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.880852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.880938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.881088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.881201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.881309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.881396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.881537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.881614 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.881783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.881859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.882013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.882091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.882246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.882327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.882476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.882605 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.882712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.882789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.882946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.883021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.883192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.883279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.883420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.883520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.883654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.883730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.883887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.883971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.884120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.884197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.884354 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.884464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.884587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.884672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.884831 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.884935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.885074 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.885182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.885309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.885464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.885543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.885700 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.885778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.885956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.886037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.886210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.886288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.886445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.886521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.886678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.886754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.886909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.886992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.887147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.887273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.887399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.887475 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.887645 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.887721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.887875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.887950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.888111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.888186 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.888344 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.888420 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.888579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.888661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.888661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.889607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.889719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.890060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.890163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.890312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.890423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.890552 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.890663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.890803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.890882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.891041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.891121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.891278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.891403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.891514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.891593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.892011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.892094 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.892246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.892322 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.892499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.892580 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.892760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.892890 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.893002 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.893084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.893238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.893317 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.893474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.893552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.893713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.893793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.893946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.894026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.894182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.894259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.894419 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.894498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.894652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.894769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.894884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.894962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.895115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.895198 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.895352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.895432 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.895583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.895659 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.895821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.895897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.896056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.896134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.896303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.896378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.896537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.896613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.896815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.896911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.897059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.897136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.897297 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.897374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.897529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] auth.external = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.897608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.897760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.897843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.898032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.898109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.898258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.898332 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.898494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] auth.password = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.898571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.898723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] auth.token = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.898800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.898963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.899049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.899198 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.899277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.899433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.899509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.899796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.899899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.899899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.900031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.900132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.900210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.900366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.900451 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.900602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] credential.caching = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.900701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.900875 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.900956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.901113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.901202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.901354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.901431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.901590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.901667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.901828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.901913 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.902061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.902137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.902308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.902395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.902552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.902631 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.902788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.902873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.903038 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.903115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.903280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.903359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.903524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.903609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.903764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.903843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.904004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.904082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.904241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.904343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.905402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] federation.caching = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.905628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.905709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.905881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.905959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.906132 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.906212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.906364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.906450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.906610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.906687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.906847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.906926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.907090 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.907167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.907324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.907403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.907577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.907655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.907811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.907888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.908059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.908137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.908295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.caching = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.908374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.908542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.908620 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] auth.external = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.908812 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.908893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.909049 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.909133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.909283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.909362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.909531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.909610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] auth.password = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.909761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.909846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] auth.token = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.909996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.910074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.910242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.910319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.910487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.910566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.910721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.910797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.910947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.911024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.911177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.911257 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.911420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.911499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.911657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] credential.caching = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.911733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.911899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.911978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.912151 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.912235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.912394 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.912480 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.912648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.912777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.912912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.912991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.913148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.913304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.913381 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.913452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.913602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.913680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.913830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.913933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.914095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.914226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.914302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.914383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.914526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.914612 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.914774 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.914853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.915003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.915087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.915252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.915338 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.915499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.915577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] federation.caching = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.915732 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.915810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.915978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.916064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.916224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.916302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.916454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.916531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.916706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.916825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.916939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.917069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.917174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.917329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.917407 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.917570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.917649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.917830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.917907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.918070 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.918147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.918315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.918393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.918553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.caching = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.918689 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.918805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.918924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.919056 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.919155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.919296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.919405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.919535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.919653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.919786 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.919890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.920079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.920272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.920523 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.920788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.920941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.921021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.921203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.921282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.921461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.921544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.921701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.921781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.921937 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.922021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.922173 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.922250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.922424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.922503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.922658 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.922737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.922897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.922987 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.923132 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.923211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.923367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.923445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.923598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.923684 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.923846 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.923961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.924092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.924170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.924338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.924424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.924577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.924654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.924838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.924918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.925066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.925156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.925312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.925391 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.925548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.925626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.925785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.925887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.926021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.926101 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.926255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.926334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.926500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.926586 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.926737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.926814 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.926970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.927049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.927225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.927310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.927454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.927574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.927692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.927769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.927926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.928012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.928162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.928239 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.928398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.928474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.928642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.928750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.928907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.928991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.929137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.929214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.929373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.929463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.929612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] resource.caching = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.929691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.929851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.929927 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.930089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.930174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.930321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.930398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.930576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.930654 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.930813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.930897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.931046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.931123 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.931283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.931359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.931518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.931603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.931754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.931831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.931990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] role.caching = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.932068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.932235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.932319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] role.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.932462 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.932539 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.932733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.932815 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.932984 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.933075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.933221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.933299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.933455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.933533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.933694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.933780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.933932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.934010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.934168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.934246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.934401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.934487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.934633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.934710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.934881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.934966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.935127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.935212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.935373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.935450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.935702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.935833 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.936197 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.936433 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.936550 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.936700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.936819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.936956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.937121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.937199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.937271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.937442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.937523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.937675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.937762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.937928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.938006 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.938177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.938297 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.938415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.938543 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.938644 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.938806 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.938884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.939042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.939120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.939294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.939374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.939536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.939620 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.939778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.939856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.940020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.940099 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.940253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.940331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.940489 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.940568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.940753 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.940837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] token.caching = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.940992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.941069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.941236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] resource.caching = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.941313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.941472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.941552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.941728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.941805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.941969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.942047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.942202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.942280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.942442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.942520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.942686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.942765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.942934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.943020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.943169 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.943247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.943405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.943482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.943640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.943720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] role.caching = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.943885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.943952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] role.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.944117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.944194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.944371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.944451 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.944611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.944713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.944902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.944981 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.945154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.945243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.connection = **** {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.945394 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.945471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.945640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.945720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.945878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.945965 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.946118 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.946196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.946353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.946431 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.946588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.946674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.946823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.946902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.947056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.947136 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.947298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.947384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.947532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.947721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.947799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.947963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.948041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.948218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.948298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.948449 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.948526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.948743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.948826 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.948942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.949023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.949180 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.949259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.949412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.949490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.949570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 15:55:20.949689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.949933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.950171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.950408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.950644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.950899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.951162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.952417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.952671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.952942 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.953180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.953422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] token.caching = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.953666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.953921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.954165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.954427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.954682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.954924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.955169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.955417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.955668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.955914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.956156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.956396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.956647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.956961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.957196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.957446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.957717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.957982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.connection = **** {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.958229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.958481 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.958721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.958966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.959205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.959445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.959685 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.959922 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.960168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.960405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.960650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.960915 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.961168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.961409 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.961655 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.961889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.962132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.962370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:20.962540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 15:55:20.979485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:20.979715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:20.979940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:20.988866 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:20.989699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:20.989937 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:20.990167 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:20.999876 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.017648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.017889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.018833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.019064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.074303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.074870 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.124232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.124450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.125111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.125354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.282148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.282391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.282622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.282834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.282921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.283051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.283142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.283269 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.283352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.283491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.283712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.283931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.306237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.306486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.306581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.306700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.306822 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.306920 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.307054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.307135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.307276 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.307357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.307494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.307578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.307707 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.307921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.319175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.319699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.332056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.332236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.332360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.332450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.332596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.332727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.332850 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.332984 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.333066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.333206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.333302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.333426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81621) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.333508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.333688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81620) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:55:21.350818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.350955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.351038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 15:55:21.351166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 15:55:21.351363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.351507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.351584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 15:55:21.351795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 15:55:21.351879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.352077 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.352159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.352338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.352428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.352600 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.352709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.352886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.362479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.362761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.363035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.363146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.363323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.363430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.363706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.363993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.370309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.371104 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.373737 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.374029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.374315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.374595 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.374879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.375077 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.375160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.375373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.375464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.375657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.375740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.375912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.375993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.376190 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.376273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.376462 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.376542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.376759 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.377037 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.377311 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.377587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.377860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.399956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.401461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.401750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.401835 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.403258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.403544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.406429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.406717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.407003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.408555 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.408866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.409155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.413330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.413623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.415662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.415949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.419312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.419611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.419891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.420484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.420753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.421038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.421177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.421316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.421471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.421588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.421761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.421863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.423810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.424111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.424402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.424710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.437208 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.437491 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.440851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.441132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.441294 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.444480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.444811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.445086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.448183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.448481 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.448958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.452538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.453810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.455733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.456033 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.456319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.456625 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.456920 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.457006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.457202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.460049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.460352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.460643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.461067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.461355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.461641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.473307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.473597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.473870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.474146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.478233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.478528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.478803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.479075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.480996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.482608 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.484157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.484434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.486272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.487113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.487401 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.487686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.487919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.488027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.488446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.489449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.489731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.492375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.492663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.492972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.493270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.493554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.499717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.500000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.500285 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.500573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.500995 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.501297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.501594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.505263 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.505560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.505848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.506160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.506494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.506779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.507081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.517710 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.520609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.523516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.523669 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.525047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.526568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.526805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.526911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.527245 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.530841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.532314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.533817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.534105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.534188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.534391 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.535608 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.538519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.538921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.539213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.539499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.540943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.542417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.546396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.546691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.546982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.547265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.547834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.548152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.548440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.555256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.555360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81621) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.555554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.555640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.555837 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.555919 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.556127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.556406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.556717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.556980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.557265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.557538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.557830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.558114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.558386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.558651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.558922 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81621) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.563848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81620) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:55:21.564133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.564418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.564719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.565000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.565275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.565550 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.565840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.566115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.566405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.566679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.566943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.567211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.567505 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81620) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:55:21.593656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555773a729c0 pid: 81621 (default app) Sep 07 15:55:21.597013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc0ac-7dfe-43e8-bd47-2092f08d72a7 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:21.597306 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc0ac-7dfe-43e8-bd47-2092f08d72a7 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:21.597583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc0ac-7dfe-43e8-bd47-2092f08d72a7 None None] PATH_INFO: `/v3` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:21.601747 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Wed Sep 7 15:55:21 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:21.602650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555773a729c0 pid: 81620 (default app) Sep 07 15:55:28.450466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edaa67-416c-4948-a396-4fcc0caf4c6e None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:28.450975 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edaa67-416c-4948-a396-4fcc0caf4c6e None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:28.451058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edaa67-416c-4948-a396-4fcc0caf4c6e None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:28.453175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:55:28.460994 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa633677-3c04-4784-ae7c-d0057c25f8b7 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:28.461526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa633677-3c04-4784-ae7c-d0057c25f8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:28.461526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa633677-3c04-4784-ae7c-d0057c25f8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:28.533875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: INFO dbcounter [None req-aa633677-3c04-4784-ae7c-d0057c25f8b7 None None] Registered counter for database keystone Sep 07 15:55:28.553074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG oslo_db.sqlalchemy.engines [None req-aa633677-3c04-4784-ae7c-d0057c25f8b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:55:28.559647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writer thread running {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:55:28.741261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG passlib.handlers.bcrypt [None req-aa633677-3c04-4784-ae7c-d0057c25f8b7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81620) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 15:55:28.741576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG passlib.handlers.bcrypt [None req-aa633677-3c04-4784-ae7c-d0057c25f8b7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81620) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 15:55:28.802997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-aa633677-3c04-4784-ae7c-d0057c25f8b7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:28.804628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-aa633677-3c04-4784-ae7c-d0057c25f8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:28.955959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1/3] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 07 15:55:29.401858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edaa67-416c-4948-a396-4fcc0caf4c6e None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:29.472872 dv-cinder-856174-1-smb devstack@keystone.service[81621]: INFO dbcounter [None req-f5edaa67-416c-4948-a396-4fcc0caf4c6e None None] Registered counter for database keystone Sep 07 15:55:29.494407 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG oslo_db.sqlalchemy.engines [None req-f5edaa67-416c-4948-a396-4fcc0caf4c6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:55:29.503219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writer thread running {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:55:29.623704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edaa67-416c-4948-a396-4fcc0caf4c6e None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:29.628606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866f124-bee4-4d79-a38b-d08ca3557c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:29.629267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866f124-bee4-4d79-a38b-d08ca3557c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:29.629547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866f124-bee4-4d79-a38b-d08ca3557c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:29.629818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866f124-bee4-4d79-a38b-d08ca3557c44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:29.638293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866f124-bee4-4d79-a38b-d08ca3557c44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:29.692016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8866f124-bee4-4d79-a38b-d08ca3557c44 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 15:55:29.692358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866f124-bee4-4d79-a38b-d08ca3557c44 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:29.702585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 3/4] 10.222.0.43 () {58 vars in 1324 bytes} [Wed Sep 7 15:55:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 15:55:29.708810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa633677-3c04-4784-ae7c-d0057c25f8b7 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:29.723420 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa633677-3c04-4784-ae7c-d0057c25f8b7 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:29.727842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc46be-5acf-4ed8-ba84-6ce79f91bfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:29.728976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc46be-5acf-4ed8-ba84-6ce79f91bfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:29.729261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc46be-5acf-4ed8-ba84-6ce79f91bfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:29.729563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc46be-5acf-4ed8-ba84-6ce79f91bfc3 admin admin] PATH_INFO: `/v3/projects/fca4039aaacb4eb6975387ddf331698c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:29.731058 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc46be-5acf-4ed8-ba84-6ce79f91bfc3 admin admin] RBAC: Authorizing `identity:get_project(project_id=fca4039aaacb4eb6975387ddf331698c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:29.785635 dv-cinder-856174-1-smb devstack@keystone.service[81620]: WARNING keystone.common.rbac_enforcer.enforcer [None req-13bc46be-5acf-4ed8-ba84-6ce79f91bfc3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 15:55:29.785968 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc46be-5acf-4ed8-ba84-6ce79f91bfc3 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:29.790643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 2/5] 10.222.0.43 () {56 vars in 1207 bytes} [Wed Sep 7 15:55:29 2022] GET /identity/v3/projects/fca4039aaacb4eb6975387ddf331698c => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:32.034544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb318f2-8f08-4dfc-83f1-926dd8e615fd None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:32.034998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb318f2-8f08-4dfc-83f1-926dd8e615fd None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:32.035093 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb318f2-8f08-4dfc-83f1-926dd8e615fd None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:32.039153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 4/6] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:32.044995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3001c9-cd9f-472f-8cb3-1712dba52f48 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:32.045427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3001c9-cd9f-472f-8cb3-1712dba52f48 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:32.045531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3001c9-cd9f-472f-8cb3-1712dba52f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:32.066636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-4a3001c9-cd9f-472f-8cb3-1712dba52f48 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:32.068155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4a3001c9-cd9f-472f-8cb3-1712dba52f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:32.077389 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 3/7] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 07 15:55:32.347352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb318f2-8f08-4dfc-83f1-926dd8e615fd None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:32.360320 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb318f2-8f08-4dfc-83f1-926dd8e615fd None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:32.364759 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e33953-34e7-417d-9477-5449781aae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:32.365363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e33953-34e7-417d-9477-5449781aae6e admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:32.365643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e33953-34e7-417d-9477-5449781aae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:32.365920 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e33953-34e7-417d-9477-5449781aae6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:32.373763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e33953-34e7-417d-9477-5449781aae6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:32.375720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e33953-34e7-417d-9477-5449781aae6e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:32.384716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 5/8] 10.222.0.43 () {58 vars in 1324 bytes} [Wed Sep 7 15:55:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 15:55:32.390743 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3001c9-cd9f-472f-8cb3-1712dba52f48 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:32.400067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3001c9-cd9f-472f-8cb3-1712dba52f48 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:32.404367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b428e2-29db-4a73-8232-d83e08f8e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:32.405561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b428e2-29db-4a73-8232-d83e08f8e104 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:32.406074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b428e2-29db-4a73-8232-d83e08f8e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:32.406408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b428e2-29db-4a73-8232-d83e08f8e104 admin admin] PATH_INFO: `/v3/users/ce735e61d3c64f3e9c5c513c8681f881` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:32.407784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b428e2-29db-4a73-8232-d83e08f8e104 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce735e61d3c64f3e9c5c513c8681f881)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:32.409656 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b428e2-29db-4a73-8232-d83e08f8e104 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:32.411171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 4/9] 10.222.0.43 () {56 vars in 1198 bytes} [Wed Sep 7 15:55:32 2022] GET /identity/v3/users/ce735e61d3c64f3e9c5c513c8681f881 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:34.664983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36f6bb-8372-45d5-a639-6757e1202fdd None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:34.665532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36f6bb-8372-45d5-a639-6757e1202fdd None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:34.665532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36f6bb-8372-45d5-a639-6757e1202fdd None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:34.666863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:34.672790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8863d-16f4-4da7-85b7-2dfc5fc8f6d3 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:34.673210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8863d-16f4-4da7-85b7-2dfc5fc8f6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:34.673349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8863d-16f4-4da7-85b7-2dfc5fc8f6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:34.691271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b5b8863d-16f4-4da7-85b7-2dfc5fc8f6d3 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:34.692460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b5b8863d-16f4-4da7-85b7-2dfc5fc8f6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:34.743593 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb85146-21bb-4989-8703-7bbda2cf51c3 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:34.744050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb85146-21bb-4989-8703-7bbda2cf51c3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:34.744510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb85146-21bb-4989-8703-7bbda2cf51c3 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:34.746655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 7/11] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:34.752370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b7e6-4e95-445e-9483-ded9780a8b93 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:34.752653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b7e6-4e95-445e-9483-ded9780a8b93 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:34.752958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b7e6-4e95-445e-9483-ded9780a8b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:34.776164 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 5/12] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:55:34.796841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG passlib.handlers.bcrypt [None req-9423b7e6-4e95-445e-9483-ded9780a8b93 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81621) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 15:55:34.797236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG passlib.handlers.bcrypt [None req-9423b7e6-4e95-445e-9483-ded9780a8b93 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81621) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 15:55:34.847783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-9423b7e6-4e95-445e-9483-ded9780a8b93 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:34.849442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9423b7e6-4e95-445e-9483-ded9780a8b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:34.954272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 8/13] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:55:35.056116 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8863d-16f4-4da7-85b7-2dfc5fc8f6d3 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:35.081704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:35.165779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8863d-16f4-4da7-85b7-2dfc5fc8f6d3 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:35.199531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c98fca-2d92-40f6-bfce-6187c29eeebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:35.200165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c98fca-2d92-40f6-bfce-6187c29eeebf None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:35.200445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c98fca-2d92-40f6-bfce-6187c29eeebf None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:35.200741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c98fca-2d92-40f6-bfce-6187c29eeebf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:35.212490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c98fca-2d92-40f6-bfce-6187c29eeebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-b1c98fca-2d92-40f6-bfce-6187c29eeebf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:55:35.221278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:55:35.222244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:55:35.223078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 6/14] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:55:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:55:35.224477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423b7e6-4e95-445e-9483-ded9780a8b93 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:35.228612 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c98fca-2d92-40f6-bfce-6187c29eeebf None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:35.310847 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:35.326706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423b7e6-4e95-445e-9483-ded9780a8b93 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:35.329649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:35.332168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c98fca-2d92-40f6-bfce-6187c29eeebf None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:35.367484 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51dad5-630f-4f3b-be5d-d13577d3e752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:35.367756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc24b7-2d68-4ded-a481-47411abdcfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:35.368091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51dad5-630f-4f3b-be5d-d13577d3e752 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:35.368370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51dad5-630f-4f3b-be5d-d13577d3e752 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:35.368615 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc24b7-2d68-4ded-a481-47411abdcfb6 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:35.368724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51dad5-630f-4f3b-be5d-d13577d3e752 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:35.368930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc24b7-2d68-4ded-a481-47411abdcfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:35.369204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc24b7-2d68-4ded-a481-47411abdcfb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:35.369321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51dad5-630f-4f3b-be5d-d13577d3e752 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:35.369620 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51dad5-630f-4f3b-be5d-d13577d3e752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:35.371019 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51dad5-630f-4f3b-be5d-d13577d3e752 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:35.382939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 7/15] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:55:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:55:35.388566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51dad5-630f-4f3b-be5d-d13577d3e752 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:35.439496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc24b7-2d68-4ded-a481-47411abdcfb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:35.441066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc24b7-2d68-4ded-a481-47411abdcfb6 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:35.493279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51dad5-630f-4f3b-be5d-d13577d3e752 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:35.534585 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ba297-29f5-4ed8-9734-daf84f5e39d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:35.535260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ba297-29f5-4ed8-9734-daf84f5e39d3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:35.535543 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ba297-29f5-4ed8-9734-daf84f5e39d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:35.535813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ba297-29f5-4ed8-9734-daf84f5e39d3 None admin] PATH_INFO: `/v3/users/ce735e61d3c64f3e9c5c513c8681f881` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:35.536985 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ba297-29f5-4ed8-9734-daf84f5e39d3 None admin] RBAC: Authorizing `identity:get_user(user_id=ce735e61d3c64f3e9c5c513c8681f881)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:35.539285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ba297-29f5-4ed8-9734-daf84f5e39d3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:35.541687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 8/16] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:55:35 2022] GET /identity/v3/users/ce735e61d3c64f3e9c5c513c8681f881 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:55:35.542304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 9/17] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:55:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:55:35.548369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ba297-29f5-4ed8-9734-daf84f5e39d3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:35.548584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc24b7-2d68-4ded-a481-47411abdcfb6 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:35.551547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:35.563872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:35.648844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc24b7-2d68-4ded-a481-47411abdcfb6 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:35.651230 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ba297-29f5-4ed8-9734-daf84f5e39d3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:35.683563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6388d-4286-479c-b4aa-3197831a965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:35.684413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6388d-4286-479c-b4aa-3197831a965d None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:35.684706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6388d-4286-479c-b4aa-3197831a965d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:35.685000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6388d-4286-479c-b4aa-3197831a965d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:35.687257 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6b6ea-ac45-4bce-afaa-36efa32895aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:35.687903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6b6ea-ac45-4bce-afaa-36efa32895aa None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:35.688190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6b6ea-ac45-4bce-afaa-36efa32895aa None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:35.688469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6b6ea-ac45-4bce-afaa-36efa32895aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:35.689642 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6b6ea-ac45-4bce-afaa-36efa32895aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:35.691103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6b6ea-ac45-4bce-afaa-36efa32895aa None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:35.692653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 9/18] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:55:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:35.698528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6b6ea-ac45-4bce-afaa-36efa32895aa None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:35.705086 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6388d-4286-479c-b4aa-3197831a965d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:35.706586 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6388d-4286-479c-b4aa-3197831a965d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-b6d6388d-4286-479c-b4aa-3197831a965d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:55:35.725505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:55:35.726428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:55:35.727262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:55:35.727262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:55:35.727262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:55:35.727262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 10/19] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:55:35.732375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6388d-4286-479c-b4aa-3197831a965d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:35.782064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:35.790522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:35.801602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6b6ea-ac45-4bce-afaa-36efa32895aa None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:35.838587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ccc60-fd3b-465f-99da-5abbbf9ac9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:35.839209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ccc60-fd3b-465f-99da-5abbbf9ac9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:35.839392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6388d-4286-479c-b4aa-3197831a965d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:35.839486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ccc60-fd3b-465f-99da-5abbbf9ac9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:35.839748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ccc60-fd3b-465f-99da-5abbbf9ac9c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:35.840480 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ccc60-fd3b-465f-99da-5abbbf9ac9c3 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.domain.id=default, user.id=ce735e61d3c64f3e9c5c513c8681f881) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:35.840832 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ccc60-fd3b-465f-99da-5abbbf9ac9c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:35.842270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ccc60-fd3b-465f-99da-5abbbf9ac9c3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:35.849719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 10/20] 10.222.0.43 () {56 vars in 1322 bytes} [Wed Sep 7 15:55:35 2022] GET /identity/v3/role_assignments?user.id=ce735e61d3c64f3e9c5c513c8681f881&scope.domain.id=default&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:55:35.877611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e8107-c003-4bfa-a6c8-2c7b1af2816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:35.878252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e8107-c003-4bfa-a6c8-2c7b1af2816a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:35.878555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e8107-c003-4bfa-a6c8-2c7b1af2816a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:35.878846 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e8107-c003-4bfa-a6c8-2c7b1af2816a None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:35.879521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e8107-c003-4bfa-a6c8-2c7b1af2816a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:35.879832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e8107-c003-4bfa-a6c8-2c7b1af2816a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:35.881324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e8107-c003-4bfa-a6c8-2c7b1af2816a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:35.902039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 11/21] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:55:38.282497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70919004-4b19-4ca1-b1e8-d77b97984f29 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:38.283440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70919004-4b19-4ca1-b1e8-d77b97984f29 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:38.283908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70919004-4b19-4ca1-b1e8-d77b97984f29 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:38.285517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 11/22] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:55:38.301393 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b368-c2a5-4ac0-a1cb-70cf8cd2419c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:38.301873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b368-c2a5-4ac0-a1cb-70cf8cd2419c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:38.301942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b368-c2a5-4ac0-a1cb-70cf8cd2419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:38.332721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b154b368-c2a5-4ac0-a1cb-70cf8cd2419c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:38.334754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b154b368-c2a5-4ac0-a1cb-70cf8cd2419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:38.476544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 12/23] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:55:38.615460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46d4de-58c4-4f51-bdac-eb5bdc7bc35b None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:38.616458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46d4de-58c4-4f51-bdac-eb5bdc7bc35b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:38.617256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46d4de-58c4-4f51-bdac-eb5bdc7bc35b None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:38.619911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:38.628226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3af0e5-4985-48d7-97c6-dc4fe64587d2 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:38.628622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3af0e5-4985-48d7-97c6-dc4fe64587d2 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:38.628797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3af0e5-4985-48d7-97c6-dc4fe64587d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:38.665949 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7c3af0e5-4985-48d7-97c6-dc4fe64587d2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:38.667163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7c3af0e5-4985-48d7-97c6-dc4fe64587d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:38.723976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:38.754702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 13/25] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:55:38.836857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be8333-79ad-45ac-8029-177c90d24ca8 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:38.837765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be8333-79ad-45ac-8029-177c90d24ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:38.838497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be8333-79ad-45ac-8029-177c90d24ca8 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:38.841203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 13/26] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:38.859586 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5442-7463-4e4e-be4e-c52c8eb85973 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:38.859969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5442-7463-4e4e-be4e-c52c8eb85973 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:38.860199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5442-7463-4e4e-be4e-c52c8eb85973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:38.892735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-a17b5442-7463-4e4e-be4e-c52c8eb85973 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:38.892735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a17b5442-7463-4e4e-be4e-c52c8eb85973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:39.005141 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 14/27] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:55:39.208897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be8333-79ad-45ac-8029-177c90d24ca8 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:39.350881 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be8333-79ad-45ac-8029-177c90d24ca8 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:39.381036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15fbee-6778-40e2-b4a3-ba4fa540b36d None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:39.381574 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15fbee-6778-40e2-b4a3-ba4fa540b36d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:39.381574 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15fbee-6778-40e2-b4a3-ba4fa540b36d None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:39.382990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 15/28] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:55:39.399048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56f9a1-2f94-4de5-8dc5-e561c3adc214 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:39.399363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56f9a1-2f94-4de5-8dc5-e561c3adc214 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:39.399598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56f9a1-2f94-4de5-8dc5-e561c3adc214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:39.426832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-ec56f9a1-2f94-4de5-8dc5-e561c3adc214 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:39.429066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ec56f9a1-2f94-4de5-8dc5-e561c3adc214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:39.449596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41efde4-5cd1-49e1-986b-518d4c192f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:39.450821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41efde4-5cd1-49e1-986b-518d4c192f2b None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:39.451248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41efde4-5cd1-49e1-986b-518d4c192f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:39.452601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41efde4-5cd1-49e1-986b-518d4c192f2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:39.496226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41efde4-5cd1-49e1-986b-518d4c192f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-a41efde4-5cd1-49e1-986b-518d4c192f2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:55:39.505710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:55:39.507251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:55:39.508662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:55:39.508662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:55:39.508662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:55:39.508662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:55:39.508662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:55:39.508662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:55:39.508662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:55:39.508662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:55:39.508662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:55:39.508662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:55:39.508662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:55:39.508662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:55:39.513474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 14/29] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:55:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:55:39.529326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41efde4-5cd1-49e1-986b-518d4c192f2b None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:39.537261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:39.651088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 16/30] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 07 15:55:39.651860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56f9a1-2f94-4de5-8dc5-e561c3adc214 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:39.740908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:39.751936 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41efde4-5cd1-49e1-986b-518d4c192f2b None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:39.803855 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0280-6039-4468-9376-8842b4f17270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:39.804466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0280-6039-4468-9376-8842b4f17270 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:39.804767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0280-6039-4468-9376-8842b4f17270 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:39.805043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0280-6039-4468-9376-8842b4f17270 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:39.805716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff0280-6039-4468-9376-8842b4f17270 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:39.806018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff0280-6039-4468-9376-8842b4f17270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:39.807414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff0280-6039-4468-9376-8842b4f17270 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:39.828562 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 15/31] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:55:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:55:39.829460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0280-6039-4468-9376-8842b4f17270 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:39.862677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56f9a1-2f94-4de5-8dc5-e561c3adc214 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:39.906628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600cb0a-40ff-41cd-a503-0ad858894636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:39.907691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600cb0a-40ff-41cd-a503-0ad858894636 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:39.909510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600cb0a-40ff-41cd-a503-0ad858894636 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:39.910008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600cb0a-40ff-41cd-a503-0ad858894636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:39.926106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600cb0a-40ff-41cd-a503-0ad858894636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:39.928888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600cb0a-40ff-41cd-a503-0ad858894636 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-5600cb0a-40ff-41cd-a503-0ad858894636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:55:39.951639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:55:39.952670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:55:39.953740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:55:39.953740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:55:39.953740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:55:39.953740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 17/32] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:55:39.954717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600cb0a-40ff-41cd-a503-0ad858894636 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:40.053196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:40.078685 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0280-6039-4468-9376-8842b4f17270 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:40.102522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:40.120880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600cb0a-40ff-41cd-a503-0ad858894636 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:40.127220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d3ff2-6400-4bc0-a887-87dff6bb5722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:40.127991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d3ff2-6400-4bc0-a887-87dff6bb5722 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:40.128342 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d3ff2-6400-4bc0-a887-87dff6bb5722 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:40.128713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d3ff2-6400-4bc0-a887-87dff6bb5722 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:40.129469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d3ff2-6400-4bc0-a887-87dff6bb5722 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:40.130947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d3ff2-6400-4bc0-a887-87dff6bb5722 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:40.165576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae906e8-17b3-41c4-90af-0718ffb38a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:40.166560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae906e8-17b3-41c4-90af-0718ffb38a00 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:40.167082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae906e8-17b3-41c4-90af-0718ffb38a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:40.167537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae906e8-17b3-41c4-90af-0718ffb38a00 None admin] PATH_INFO: `/v3/users/ce735e61d3c64f3e9c5c513c8681f881` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:40.169258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae906e8-17b3-41c4-90af-0718ffb38a00 None admin] RBAC: Authorizing `identity:get_user(user_id=ce735e61d3c64f3e9c5c513c8681f881)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:40.171534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae906e8-17b3-41c4-90af-0718ffb38a00 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:40.173698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 18/33] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:55:39 2022] GET /identity/v3/users/ce735e61d3c64f3e9c5c513c8681f881 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:40.174680 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae906e8-17b3-41c4-90af-0718ffb38a00 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:40.291611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 16/34] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Sep 7 15:55:39 2022] POST /identity/v3/roles => generated 219 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:55:40.292986 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d3ff2-6400-4bc0-a887-87dff6bb5722 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:40.333581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae906e8-17b3-41c4-90af-0718ffb38a00 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:40.407112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03797dd-a7ee-4b10-af2b-fa21ce32a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:40.408259 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03797dd-a7ee-4b10-af2b-fa21ce32a547 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:40.409041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03797dd-a7ee-4b10-af2b-fa21ce32a547 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:40.409889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03797dd-a7ee-4b10-af2b-fa21ce32a547 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:40.411423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03797dd-a7ee-4b10-af2b-fa21ce32a547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:40.412321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03797dd-a7ee-4b10-af2b-fa21ce32a547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:40.415710 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03797dd-a7ee-4b10-af2b-fa21ce32a547 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:40.437949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d3ff2-6400-4bc0-a887-87dff6bb5722 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:40.442739 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 19/35] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:40.444563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03797dd-a7ee-4b10-af2b-fa21ce32a547 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:40.480339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:40.482287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:40.492051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f838-fa9a-41e7-bdf6-3e513835e73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:40.493084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f838-fa9a-41e7-bdf6-3e513835e73e None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:40.493382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f838-fa9a-41e7-bdf6-3e513835e73e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:40.493874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f838-fa9a-41e7-bdf6-3e513835e73e None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:40.494669 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f838-fa9a-41e7-bdf6-3e513835e73e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:40.496580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f838-fa9a-41e7-bdf6-3e513835e73e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:40.517013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 17/36] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Sep 7 15:55:40 2022] POST /identity/v3/roles => generated 225 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:55:40.518362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f838-fa9a-41e7-bdf6-3e513835e73e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:40.656094 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03797dd-a7ee-4b10-af2b-fa21ce32a547 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:40.674920 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f838-fa9a-41e7-bdf6-3e513835e73e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:40.723262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60ae1a-2fc7-4205-9b78-5f1404f27de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:40.724739 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60ae1a-2fc7-4205-9b78-5f1404f27de7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:40.725462 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60ae1a-2fc7-4205-9b78-5f1404f27de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:40.726166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60ae1a-2fc7-4205-9b78-5f1404f27de7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:40.732148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60ae1a-2fc7-4205-9b78-5f1404f27de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:40.739431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60ae1a-2fc7-4205-9b78-5f1404f27de7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:40.739664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee00dcb-53f3-4dab-b3d8-c463a64ddf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:40.740062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee00dcb-53f3-4dab-b3d8-c463a64ddf3c None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:40.740376 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee00dcb-53f3-4dab-b3d8-c463a64ddf3c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:40.740946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee00dcb-53f3-4dab-b3d8-c463a64ddf3c None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:40.742166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee00dcb-53f3-4dab-b3d8-c463a64ddf3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:40.744132 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 20/37] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:55:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:40.750438 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee00dcb-53f3-4dab-b3d8-c463a64ddf3c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:40.761985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60ae1a-2fc7-4205-9b78-5f1404f27de7 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:40.836902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 18/38] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:55:40 2022] POST /identity/v3/projects => generated 301 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:55:40.838303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb47f4-733a-44b7-ad3e-31c5e923e04d None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:40.838618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb47f4-733a-44b7-ad3e-31c5e923e04d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:40.838927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb47f4-733a-44b7-ad3e-31c5e923e04d None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:40.840370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 19/39] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:40.847974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00739f-7a82-43b0-853d-fb6290bc34bc None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:40.848309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00739f-7a82-43b0-853d-fb6290bc34bc None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:40.848529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00739f-7a82-43b0-853d-fb6290bc34bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:40.893040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-de00739f-7a82-43b0-853d-fb6290bc34bc None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:40.894789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-de00739f-7a82-43b0-853d-fb6290bc34bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:40.953735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:40.974205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:40.994375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60ae1a-2fc7-4205-9b78-5f1404f27de7 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:41.039107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dd97a-60ac-4969-bafd-32ee89c34c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:41.039809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dd97a-60ac-4969-bafd-32ee89c34c90 None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:41.040092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dd97a-60ac-4969-bafd-32ee89c34c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:41.040368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dd97a-60ac-4969-bafd-32ee89c34c90 None admin] PATH_INFO: `/v3/domains/default/users/ce735e61d3c64f3e9c5c513c8681f881/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:41.042690 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dd97a-60ac-4969-bafd-32ee89c34c90 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ce735e61d3c64f3e9c5c513c8681f881, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:41.044411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dd97a-60ac-4969-bafd-32ee89c34c90 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:41.180091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 21/40] 10.222.0.43 () {58 vars in 1361 bytes} [Wed Sep 7 15:55:40 2022] PUT /identity/v3/domains/default/users/ce735e61d3c64f3e9c5c513c8681f881/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:55:41.181911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48412aca-7d3b-4d1b-9d4e-7a779ee22c54 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:41.182205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48412aca-7d3b-4d1b-9d4e-7a779ee22c54 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:41.182482 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48412aca-7d3b-4d1b-9d4e-7a779ee22c54 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:41.188289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 22/41] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:41.197520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f8548-3f18-4b77-a758-220b3940b661 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:41.197949 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f8548-3f18-4b77-a758-220b3940b661 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:41.198337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f8548-3f18-4b77-a758-220b3940b661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:41.215111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 20/42] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:55:41.235480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-bb8f8548-3f18-4b77-a758-220b3940b661 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:41.237223 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-bb8f8548-3f18-4b77-a758-220b3940b661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:41.364720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 23/43] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:55:41.509164 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00739f-7a82-43b0-853d-fb6290bc34bc None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:41.620202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00739f-7a82-43b0-853d-fb6290bc34bc None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:41.628908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f8548-3f18-4b77-a758-220b3940b661 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:41.668980 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186fa0-d3a2-4a2d-825f-6ae69da1abd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:41.669607 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186fa0-d3a2-4a2d-825f-6ae69da1abd9 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:41.669890 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186fa0-d3a2-4a2d-825f-6ae69da1abd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:41.671305 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186fa0-d3a2-4a2d-825f-6ae69da1abd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:41.671305 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46186fa0-d3a2-4a2d-825f-6ae69da1abd9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:41.672267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46186fa0-d3a2-4a2d-825f-6ae69da1abd9 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:41.694422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 21/44] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Sep 7 15:55:41 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:55:41.734388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:41.769055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f8548-3f18-4b77-a758-220b3940b661 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:41.811836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb3814-9b58-43cd-aaaa-fd79754adce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:41.812637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb3814-9b58-43cd-aaaa-fd79754adce6 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:41.812984 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb3814-9b58-43cd-aaaa-fd79754adce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:41.813228 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb3814-9b58-43cd-aaaa-fd79754adce6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:41.814425 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb3814-9b58-43cd-aaaa-fd79754adce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:41.817627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb3814-9b58-43cd-aaaa-fd79754adce6 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:41.817906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 24/45] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:55:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:55:41.827740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186fa0-d3a2-4a2d-825f-6ae69da1abd9 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:41.865370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:41.959179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186fa0-d3a2-4a2d-825f-6ae69da1abd9 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:42.001233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea6845-7d25-4c41-bf9e-4af04d3c42fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:42.001871 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea6845-7d25-4c41-bf9e-4af04d3c42fb None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:42.002154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea6845-7d25-4c41-bf9e-4af04d3c42fb None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:42.002428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea6845-7d25-4c41-bf9e-4af04d3c42fb None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:42.003122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea6845-7d25-4c41-bf9e-4af04d3c42fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:42.004593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea6845-7d25-4c41-bf9e-4af04d3c42fb None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:42.044776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 22/46] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:55:41 2022] POST /identity/v3/projects => generated 312 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:55:43.476833 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e90f26-a4bb-4205-844d-2d2d1c92bc7b None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:43.477350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e90f26-a4bb-4205-844d-2d2d1c92bc7b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:43.477431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e90f26-a4bb-4205-844d-2d2d1c92bc7b None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:43.478717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 25/47] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:43.484382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d354f4-923b-496c-ad78-2b5fd539fc4e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:43.484865 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d354f4-923b-496c-ad78-2b5fd539fc4e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:43.485125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d354f4-923b-496c-ad78-2b5fd539fc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:43.503907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-a2d354f4-923b-496c-ad78-2b5fd539fc4e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:43.505146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-a2d354f4-923b-496c-ad78-2b5fd539fc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:43.580394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 23/48] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:55:43.858057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e90f26-a4bb-4205-844d-2d2d1c92bc7b None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:43.977742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e90f26-a4bb-4205-844d-2d2d1c92bc7b None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:44.017323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949653-817b-4e2e-8308-e72ea8beb2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:44.018229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949653-817b-4e2e-8308-e72ea8beb2ab None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:44.018515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949653-817b-4e2e-8308-e72ea8beb2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:44.018795 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949653-817b-4e2e-8308-e72ea8beb2ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:44.033070 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949653-817b-4e2e-8308-e72ea8beb2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-15949653-817b-4e2e-8308-e72ea8beb2ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:55:44.042947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:55:44.044045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:55:44.044885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 26/49] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:55:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:55:44.052600 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d354f4-923b-496c-ad78-2b5fd539fc4e None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:44.066871 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:44.163907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d354f4-923b-496c-ad78-2b5fd539fc4e None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:44.201280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7072d-5fbf-4909-9532-5207ae63fdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:44.202018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7072d-5fbf-4909-9532-5207ae63fdfd None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:44.202460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7072d-5fbf-4909-9532-5207ae63fdfd None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:44.202766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7072d-5fbf-4909-9532-5207ae63fdfd None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:44.203468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7072d-5fbf-4909-9532-5207ae63fdfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:44.203774 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7072d-5fbf-4909-9532-5207ae63fdfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:44.205255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7072d-5fbf-4909-9532-5207ae63fdfd None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:44.215203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 24/50] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:55:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:44.221287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949653-817b-4e2e-8308-e72ea8beb2ab None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:44.224413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:44.313105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b721-9d1d-4be4-b1e3-7ae9750f9182 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:44.313405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b721-9d1d-4be4-b1e3-7ae9750f9182 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:44.313693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b721-9d1d-4be4-b1e3-7ae9750f9182 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:44.315057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 25/51] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:55:44.320675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcf1c2-e682-45ef-b87f-5236a1d2d2b0 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:44.320883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcf1c2-e682-45ef-b87f-5236a1d2d2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:44.321167 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcf1c2-e682-45ef-b87f-5236a1d2d2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:44.331344 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949653-817b-4e2e-8308-e72ea8beb2ab None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:44.339353 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e6fcf1c2-e682-45ef-b87f-5236a1d2d2b0 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:44.340593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e6fcf1c2-e682-45ef-b87f-5236a1d2d2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:44.367249 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f83487-670f-45a8-9e59-0d3bd2da2391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:44.367880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f83487-670f-45a8-9e59-0d3bd2da2391 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:44.368160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f83487-670f-45a8-9e59-0d3bd2da2391 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:44.368434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f83487-670f-45a8-9e59-0d3bd2da2391 None admin] PATH_INFO: `/v3/users/ce735e61d3c64f3e9c5c513c8681f881` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:44.369596 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f83487-670f-45a8-9e59-0d3bd2da2391 None admin] RBAC: Authorizing `identity:get_user(user_id=ce735e61d3c64f3e9c5c513c8681f881)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:44.371063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f83487-670f-45a8-9e59-0d3bd2da2391 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:44.372670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 27/52] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:55:44 2022] GET /identity/v3/users/ce735e61d3c64f3e9c5c513c8681f881 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:55:44.378509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f83487-670f-45a8-9e59-0d3bd2da2391 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:44.414639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 26/53] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:55:44.451558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:44.486673 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f83487-670f-45a8-9e59-0d3bd2da2391 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:44.521349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3da905-bef6-400f-bc16-a208355606bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:44.521986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3da905-bef6-400f-bc16-a208355606bd None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:44.522270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3da905-bef6-400f-bc16-a208355606bd None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:44.522547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3da905-bef6-400f-bc16-a208355606bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:44.523676 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3da905-bef6-400f-bc16-a208355606bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:44.525170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3da905-bef6-400f-bc16-a208355606bd None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:44.526749 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 28/54] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:55:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:55:44.533190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcf1c2-e682-45ef-b87f-5236a1d2d2b0 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:44.535948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:44.637161 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcf1c2-e682-45ef-b87f-5236a1d2d2b0 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:44.674640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a7d1c-0829-4c9c-acd4-103dbc546b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:44.675170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a7d1c-0829-4c9c-acd4-103dbc546b59 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:44.675455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a7d1c-0829-4c9c-acd4-103dbc546b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:44.675734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a7d1c-0829-4c9c-acd4-103dbc546b59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:44.676471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a7d1c-0829-4c9c-acd4-103dbc546b59 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.domain.id=default, user.id=ce735e61d3c64f3e9c5c513c8681f881) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:44.676816 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a7d1c-0829-4c9c-acd4-103dbc546b59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:44.678274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a7d1c-0829-4c9c-acd4-103dbc546b59 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:44.684105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1322 bytes} [Wed Sep 7 15:55:44 2022] GET /identity/v3/role_assignments?user.id=ce735e61d3c64f3e9c5c513c8681f881&scope.domain.id=default&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:44.687802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3da905-bef6-400f-bc16-a208355606bd None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:44.947492 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3da905-bef6-400f-bc16-a208355606bd None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:45.000827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e9100-fd12-46ce-b599-df5faebe3193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:45.001488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e9100-fd12-46ce-b599-df5faebe3193 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:45.001782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e9100-fd12-46ce-b599-df5faebe3193 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:45.002062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e9100-fd12-46ce-b599-df5faebe3193 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:45.003273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e9100-fd12-46ce-b599-df5faebe3193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:45.004756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e9100-fd12-46ce-b599-df5faebe3193 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:45.006379 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 29/56] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:55:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:45.012024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a7d1c-0829-4c9c-acd4-103dbc546b59 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:45.087430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:45.125919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a7d1c-0829-4c9c-acd4-103dbc546b59 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:45.161063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1de6f-f367-4661-9dfd-44b9d3697a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:45.161685 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1de6f-f367-4661-9dfd-44b9d3697a27 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:45.161972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1de6f-f367-4661-9dfd-44b9d3697a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:45.162253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1de6f-f367-4661-9dfd-44b9d3697a27 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:45.162966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1de6f-f367-4661-9dfd-44b9d3697a27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:45.165180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1de6f-f367-4661-9dfd-44b9d3697a27 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:45.194734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 28/57] 10.222.0.43 () {60 vars in 1140 bytes} [Wed Sep 7 15:55:45 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:55:47.425514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76229c9-790d-40e3-b719-80f3f9d24fea None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:47.426010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76229c9-790d-40e3-b719-80f3f9d24fea None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:47.426133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76229c9-790d-40e3-b719-80f3f9d24fea None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:47.427401 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 30/58] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:47.432896 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08101f2-25a8-4da8-8c6e-ccddb26b9bed None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:47.433279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08101f2-25a8-4da8-8c6e-ccddb26b9bed None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:47.433541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08101f2-25a8-4da8-8c6e-ccddb26b9bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:47.454859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e08101f2-25a8-4da8-8c6e-ccddb26b9bed None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:47.456182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e08101f2-25a8-4da8-8c6e-ccddb26b9bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:47.531121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 29/59] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:55:47.813667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76229c9-790d-40e3-b719-80f3f9d24fea None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:47.823174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:47.923013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76229c9-790d-40e3-b719-80f3f9d24fea None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:47.957719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11086f-3df5-45cf-a294-ac3bc2532a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:47.958343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11086f-3df5-45cf-a294-ac3bc2532a3a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:47.958622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11086f-3df5-45cf-a294-ac3bc2532a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:47.958893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11086f-3df5-45cf-a294-ac3bc2532a3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:47.959991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11086f-3df5-45cf-a294-ac3bc2532a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:47.961452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11086f-3df5-45cf-a294-ac3bc2532a3a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:47.963016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 31/60] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:55:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:47.969832 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08101f2-25a8-4da8-8c6e-ccddb26b9bed None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:48.023448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:48.079528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08101f2-25a8-4da8-8c6e-ccddb26b9bed None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:48.115955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f581214-f446-4837-bb4a-19f9a70128bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:48.116578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f581214-f446-4837-bb4a-19f9a70128bb None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:48.116896 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f581214-f446-4837-bb4a-19f9a70128bb None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:48.117180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f581214-f446-4837-bb4a-19f9a70128bb None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:48.117856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f581214-f446-4837-bb4a-19f9a70128bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:48.119334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f581214-f446-4837-bb4a-19f9a70128bb None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:48.149253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 30/61] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:55:47 2022] POST /identity/v3/users => generated 275 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:55:51.884732 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74438f94-519b-4580-b595-c34a850b428e None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:51.884732 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74438f94-519b-4580-b595-c34a850b428e None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:51.884732 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74438f94-519b-4580-b595-c34a850b428e None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:51.886771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 32/62] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:51.894735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bee17-99b3-414f-8f56-f4b55580d371 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:51.895989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bee17-99b3-414f-8f56-f4b55580d371 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:51.896630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bee17-99b3-414f-8f56-f4b55580d371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:51.927824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311e3e-e1a8-4f4f-ae58-1c90b34ca670 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:51.928427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311e3e-e1a8-4f4f-ae58-1c90b34ca670 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:51.928921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311e3e-e1a8-4f4f-ae58-1c90b34ca670 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:51.930483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 33/63] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:55:51.935987 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c21bee17-99b3-414f-8f56-f4b55580d371 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:51.937996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c21bee17-99b3-414f-8f56-f4b55580d371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:51.938340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e163ba-63ce-48bc-997b-ece0f9507e7f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:51.938867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e163ba-63ce-48bc-997b-ece0f9507e7f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:51.939417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e163ba-63ce-48bc-997b-ece0f9507e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:51.960820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-29e163ba-63ce-48bc-997b-ece0f9507e7f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:51.962373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-29e163ba-63ce-48bc-997b-ece0f9507e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:52.031914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 31/64] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:55:52.127019 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 34/65] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:55:52.337112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bee17-99b3-414f-8f56-f4b55580d371 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:52.373618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:52.398147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f833c-2148-4dd8-82f5-f607b3c9e028 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:52.398772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f833c-2148-4dd8-82f5-f607b3c9e028 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:52.399257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f833c-2148-4dd8-82f5-f607b3c9e028 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:52.401135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 35/66] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:52.408406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac8820-51e5-4d06-8497-f5749cfcc6ff None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:52.409008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac8820-51e5-4d06-8497-f5749cfcc6ff None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:52.409492 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac8820-51e5-4d06-8497-f5749cfcc6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:52.439071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:52.451392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bee17-99b3-414f-8f56-f4b55580d371 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:52.465240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-dfac8820-51e5-4d06-8497-f5749cfcc6ff None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:52.466459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-dfac8820-51e5-4d06-8497-f5749cfcc6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:52.500480 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e68493-8021-4a68-b032-a5c2660baeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:52.501648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e68493-8021-4a68-b032-a5c2660baeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:52.502232 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e68493-8021-4a68-b032-a5c2660baeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:52.502700 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e68493-8021-4a68-b032-a5c2660baeb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:52.515316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e68493-8021-4a68-b032-a5c2660baeb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-01e68493-8021-4a68-b032-a5c2660baeb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:55:52.521042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:55:52.521967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:55:52.522733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:55:52.522733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:55:52.522733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:55:52.522733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:55:52.522733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:55:52.522733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:55:52.522733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:55:52.522733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:55:52.522733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:55:52.522733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:55:52.522733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:55:52.522733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:55:52.525132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 32/67] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:55:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:55:52.527311 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b22c4a-ce58-437d-98ca-d61508446a3a None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:52.527590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b22c4a-ce58-437d-98ca-d61508446a3a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:52.528052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b22c4a-ce58-437d-98ca-d61508446a3a None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:52.532859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 33/68] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:52.534028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b22c4a-ce58-437d-98ca-d61508446a3a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:52.560781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 36/69] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:55:52.562712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac8820-51e5-4d06-8497-f5749cfcc6ff None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:52.646297 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:52.655119 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b22c4a-ce58-437d-98ca-d61508446a3a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:52.692661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d15f0b-3da8-46a6-bb9f-effa47d766e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:52.693321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d15f0b-3da8-46a6-bb9f-effa47d766e7 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:52.693606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d15f0b-3da8-46a6-bb9f-effa47d766e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:52.693882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d15f0b-3da8-46a6-bb9f-effa47d766e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:52.696815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac8820-51e5-4d06-8497-f5749cfcc6ff None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:52.704923 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d15f0b-3da8-46a6-bb9f-effa47d766e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-07d15f0b-3da8-46a6-bb9f-effa47d766e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:55:52.709817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:55:52.710841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:55:52.711609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 34/70] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:55:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:55:52.712280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d97b8-ede6-4949-a9a6-919dc4cf2073 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:52.712415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d97b8-ede6-4949-a9a6-919dc4cf2073 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:52.712853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d97b8-ede6-4949-a9a6-919dc4cf2073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:52.733651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-da3d97b8-ede6-4949-a9a6-919dc4cf2073 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:52.734865 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-da3d97b8-ede6-4949-a9a6-919dc4cf2073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:52.748291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af203410-008f-4848-91a2-f4abcbeda573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:52.750446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af203410-008f-4848-91a2-f4abcbeda573 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:52.750883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af203410-008f-4848-91a2-f4abcbeda573 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:52.751166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af203410-008f-4848-91a2-f4abcbeda573 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:52.752036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af203410-008f-4848-91a2-f4abcbeda573 None admin] RBAC: Adding query filter params (name=member) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:52.752352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af203410-008f-4848-91a2-f4abcbeda573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:52.753894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af203410-008f-4848-91a2-f4abcbeda573 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:52.755857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:52.775678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 37/71] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:55:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:52.775678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e9770-346a-4479-8f29-ff442c22a898 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:52.775678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e9770-346a-4479-8f29-ff442c22a898 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:52.775678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e9770-346a-4479-8f29-ff442c22a898 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:52.775678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 38/72] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:52.775678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e9770-346a-4479-8f29-ff442c22a898 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:52.818062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 35/73] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:55:52.818822 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d97b8-ede6-4949-a9a6-919dc4cf2073 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:52.908089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e9770-346a-4479-8f29-ff442c22a898 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:52.918180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:52.937629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d97b8-ede6-4949-a9a6-919dc4cf2073 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:52.952314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e895ad-a050-4df1-a5e3-ddb2df3d7294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:52.953043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e895ad-a050-4df1-a5e3-ddb2df3d7294 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:52.953443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e895ad-a050-4df1-a5e3-ddb2df3d7294 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:52.953724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e895ad-a050-4df1-a5e3-ddb2df3d7294 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:52.954391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e895ad-a050-4df1-a5e3-ddb2df3d7294 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:52.954693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e895ad-a050-4df1-a5e3-ddb2df3d7294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:52.956170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e895ad-a050-4df1-a5e3-ddb2df3d7294 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:52.965819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 39/74] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:55:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:52.966991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133d10-31ec-4c16-922d-2bf20769abd4 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:52.967280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133d10-31ec-4c16-922d-2bf20769abd4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:52.967679 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133d10-31ec-4c16-922d-2bf20769abd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:52.986993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-d0133d10-31ec-4c16-922d-2bf20769abd4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:52.988246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d0133d10-31ec-4c16-922d-2bf20769abd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:52.988945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f55b8d-ba66-4929-b7dd-feca3fb78501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:52.989777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f55b8d-ba66-4929-b7dd-feca3fb78501 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:52.990271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f55b8d-ba66-4929-b7dd-feca3fb78501 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:52.990562 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f55b8d-ba66-4929-b7dd-feca3fb78501 None admin] PATH_INFO: `/v3/users/b0c8c916f4a849b19484742f9e99bd2c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:53.013363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f55b8d-ba66-4929-b7dd-feca3fb78501 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8c916f4a849b19484742f9e99bd2c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:53.016631 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f55b8d-ba66-4929-b7dd-feca3fb78501 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:53.026428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 36/75] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:55:52 2022] GET /identity/v3/users/b0c8c916f4a849b19484742f9e99bd2c => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:53.026428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f55b8d-ba66-4929-b7dd-feca3fb78501 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:53.061849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:53.080520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 40/76] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:55:53.081256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133d10-31ec-4c16-922d-2bf20769abd4 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:53.167268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f55b8d-ba66-4929-b7dd-feca3fb78501 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:53.200366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133d10-31ec-4c16-922d-2bf20769abd4 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:53.212005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4774ad-590d-40c9-afb5-5e88a45a6c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:53.213007 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4774ad-590d-40c9-afb5-5e88a45a6c78 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:53.213491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4774ad-590d-40c9-afb5-5e88a45a6c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:53.214120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4774ad-590d-40c9-afb5-5e88a45a6c78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:53.231187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4774ad-590d-40c9-afb5-5e88a45a6c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-0b4774ad-590d-40c9-afb5-5e88a45a6c78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:55:53.237176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:55:53.238049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:55:53.238800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 37/77] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:55:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:55:53.239422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4774ad-590d-40c9-afb5-5e88a45a6c78 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:53.246989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:53.252978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338d11d-0ef0-4a8e-80ba-afdd749e14ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:53.253627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338d11d-0ef0-4a8e-80ba-afdd749e14ea None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:53.253908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338d11d-0ef0-4a8e-80ba-afdd749e14ea None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:53.254181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338d11d-0ef0-4a8e-80ba-afdd749e14ea None admin] PATH_INFO: `/v3/users/ce735e61d3c64f3e9c5c513c8681f881` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:53.255304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338d11d-0ef0-4a8e-80ba-afdd749e14ea None admin] RBAC: Authorizing `identity:get_user(user_id=ce735e61d3c64f3e9c5c513c8681f881)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:53.256786 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338d11d-0ef0-4a8e-80ba-afdd749e14ea None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:53.258560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 41/78] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:55:53 2022] GET /identity/v3/users/ce735e61d3c64f3e9c5c513c8681f881 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:53.259163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338d11d-0ef0-4a8e-80ba-afdd749e14ea None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:53.327820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:53.379662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338d11d-0ef0-4a8e-80ba-afdd749e14ea None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:53.382672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4774ad-590d-40c9-afb5-5e88a45a6c78 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:53.422422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc310e-fb7a-4f45-9697-fadcdc79aa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:53.422972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc310e-fb7a-4f45-9697-fadcdc79aa52 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:53.423264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc310e-fb7a-4f45-9697-fadcdc79aa52 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:53.423542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc310e-fb7a-4f45-9697-fadcdc79aa52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:53.424075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd46504-fc0a-489c-83b9-bfe5529840b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:53.424798 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd46504-fc0a-489c-83b9-bfe5529840b2 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:53.425169 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd46504-fc0a-489c-83b9-bfe5529840b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:53.425513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd46504-fc0a-489c-83b9-bfe5529840b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:53.438839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd46504-fc0a-489c-83b9-bfe5529840b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-abd46504-fc0a-489c-83b9-bfe5529840b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:55:53.443957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:55:53.445396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 42/79] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:55:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:55:53.446373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd46504-fc0a-489c-83b9-bfe5529840b2 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:53.521474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc310e-fb7a-4f45-9697-fadcdc79aa52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:53.523221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc310e-fb7a-4f45-9697-fadcdc79aa52 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:53.525340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:53.562705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd46504-fc0a-489c-83b9-bfe5529840b2 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:53.579697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:53.598477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa2a31-7b98-4e18-b6ac-39a731354f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:53.599091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa2a31-7b98-4e18-b6ac-39a731354f4f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:53.599371 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa2a31-7b98-4e18-b6ac-39a731354f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:53.599643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa2a31-7b98-4e18-b6ac-39a731354f4f None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:53.600920 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa2a31-7b98-4e18-b6ac-39a731354f4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:53.600920 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa2a31-7b98-4e18-b6ac-39a731354f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:53.602033 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa2a31-7b98-4e18-b6ac-39a731354f4f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:53.621015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 43/80] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:55:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:53.621986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa2a31-7b98-4e18-b6ac-39a731354f4f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:53.642605 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 38/81] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:55:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:55:53.644305 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc310e-fb7a-4f45-9697-fadcdc79aa52 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:53.744026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa2a31-7b98-4e18-b6ac-39a731354f4f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:53.761049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc310e-fb7a-4f45-9697-fadcdc79aa52 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:53.763274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:53.783647 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc9878-fc48-422a-a831-44050bbda2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:53.784313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc9878-fc48-422a-a831-44050bbda2ca None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:53.784601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc9878-fc48-422a-a831-44050bbda2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:53.784928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc9878-fc48-422a-a831-44050bbda2ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:53.799772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827dfe8-71b9-454f-9ecc-90e85dc82bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:53.800410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827dfe8-71b9-454f-9ecc-90e85dc82bfd None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:53.800706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827dfe8-71b9-454f-9ecc-90e85dc82bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:53.800995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827dfe8-71b9-454f-9ecc-90e85dc82bfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:53.802095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827dfe8-71b9-454f-9ecc-90e85dc82bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:53.803569 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827dfe8-71b9-454f-9ecc-90e85dc82bfd None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:53.805189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 39/82] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:55:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:53.805953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827dfe8-71b9-454f-9ecc-90e85dc82bfd None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:53.848350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:53.884749 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc9878-fc48-422a-a831-44050bbda2ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:53.886355 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc9878-fc48-422a-a831-44050bbda2ca None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:53.941144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827dfe8-71b9-454f-9ecc-90e85dc82bfd None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:53.983648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6be26e-9f79-47a9-9b75-56c91e91eb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:53.984396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6be26e-9f79-47a9-9b75-56c91e91eb57 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:53.984776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6be26e-9f79-47a9-9b75-56c91e91eb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:53.984981 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6be26e-9f79-47a9-9b75-56c91e91eb57 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:53.985704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6be26e-9f79-47a9-9b75-56c91e91eb57 None admin] RBAC: Adding query filter params (name=member) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:53.986010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6be26e-9f79-47a9-9b75-56c91e91eb57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:53.987469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6be26e-9f79-47a9-9b75-56c91e91eb57 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:53.997253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 40/83] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:55:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:53.998035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6be26e-9f79-47a9-9b75-56c91e91eb57 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:54.034875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:54.038980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 44/84] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:55:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:55:54.039948 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc9878-fc48-422a-a831-44050bbda2ca None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:54.113788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6be26e-9f79-47a9-9b75-56c91e91eb57 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:54.123235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:54.148212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc9878-fc48-422a-a831-44050bbda2ca None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:54.152102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2d3a8-88a1-4a3c-8ed3-f01bb9c4dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:54.152850 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2d3a8-88a1-4a3c-8ed3-f01bb9c4dc9b None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:54.153186 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2d3a8-88a1-4a3c-8ed3-f01bb9c4dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:54.153506 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2d3a8-88a1-4a3c-8ed3-f01bb9c4dc9b None admin] PATH_INFO: `/v3/users/b0c8c916f4a849b19484742f9e99bd2c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:54.154799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2d3a8-88a1-4a3c-8ed3-f01bb9c4dc9b None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8c916f4a849b19484742f9e99bd2c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:54.156440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2d3a8-88a1-4a3c-8ed3-f01bb9c4dc9b None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:54.162885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 41/85] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:55:53 2022] GET /identity/v3/users/b0c8c916f4a849b19484742f9e99bd2c => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:54.162885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2d3a8-88a1-4a3c-8ed3-f01bb9c4dc9b None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:54.185225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1febc21-f119-4ca8-9b9d-a6b51a07316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:54.185959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1febc21-f119-4ca8-9b9d-a6b51a07316d None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:54.186767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1febc21-f119-4ca8-9b9d-a6b51a07316d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:54.187048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1febc21-f119-4ca8-9b9d-a6b51a07316d None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:54.188229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1febc21-f119-4ca8-9b9d-a6b51a07316d None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:54.189726 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1febc21-f119-4ca8-9b9d-a6b51a07316d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:54.191364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 45/86] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:55:54 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:54.192126 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1febc21-f119-4ca8-9b9d-a6b51a07316d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:54.267016 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:54.271055 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2d3a8-88a1-4a3c-8ed3-f01bb9c4dc9b None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:54.317449 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1febc21-f119-4ca8-9b9d-a6b51a07316d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:54.323557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520bfe0-5c25-4cb6-9cc0-e7994e800c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:54.324588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520bfe0-5c25-4cb6-9cc0-e7994e800c7f None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:54.325089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520bfe0-5c25-4cb6-9cc0-e7994e800c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:54.325557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520bfe0-5c25-4cb6-9cc0-e7994e800c7f None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:54.326670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520bfe0-5c25-4cb6-9cc0-e7994e800c7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:54.329863 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520bfe0-5c25-4cb6-9cc0-e7994e800c7f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:54.357482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 42/87] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:55:54 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:55:54.358922 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520bfe0-5c25-4cb6-9cc0-e7994e800c7f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:54.380292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e6d71-8264-457d-a52f-4b957e0491aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:54.381005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e6d71-8264-457d-a52f-4b957e0491aa None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:54.381278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e6d71-8264-457d-a52f-4b957e0491aa None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:54.381553 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e6d71-8264-457d-a52f-4b957e0491aa None admin] PATH_INFO: `/v3/users/b0c8c916f4a849b19484742f9e99bd2c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:54.383204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e6d71-8264-457d-a52f-4b957e0491aa None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8c916f4a849b19484742f9e99bd2c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:54.385217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e6d71-8264-457d-a52f-4b957e0491aa None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:54.387762 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 46/88] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:55:54 2022] GET /identity/v3/users/b0c8c916f4a849b19484742f9e99bd2c => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:54.388432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e6d71-8264-457d-a52f-4b957e0491aa None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:54.407484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:54.502836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520bfe0-5c25-4cb6-9cc0-e7994e800c7f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:54.523185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e6d71-8264-457d-a52f-4b957e0491aa None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:54.551613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e2073-a5f8-4f79-9f6d-45b70b7c47ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:54.552383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e2073-a5f8-4f79-9f6d-45b70b7c47ab None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:54.552726 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e2073-a5f8-4f79-9f6d-45b70b7c47ab None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:54.553078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e2073-a5f8-4f79-9f6d-45b70b7c47ab None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:54.554469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e2073-a5f8-4f79-9f6d-45b70b7c47ab None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:54.556182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e2073-a5f8-4f79-9f6d-45b70b7c47ab None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:54.558865 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 43/89] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:55:54 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:54.560000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e2073-a5f8-4f79-9f6d-45b70b7c47ab None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:54.571374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0a213-a56d-49d3-be2d-504cee53e87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:54.572018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0a213-a56d-49d3-be2d-504cee53e87e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:54.572301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0a213-a56d-49d3-be2d-504cee53e87e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:54.572582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0a213-a56d-49d3-be2d-504cee53e87e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:54.601957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:54.665495 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0a213-a56d-49d3-be2d-504cee53e87e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:54.667274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0a213-a56d-49d3-be2d-504cee53e87e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:54.691481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:54.741959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e2073-a5f8-4f79-9f6d-45b70b7c47ab None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:54.812238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc114a-dc9e-407a-b991-a0079c6edadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:54.812837 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc114a-dc9e-407a-b991-a0079c6edadd None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:54.813322 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc114a-dc9e-407a-b991-a0079c6edadd None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:54.813790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc114a-dc9e-407a-b991-a0079c6edadd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:54.815359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc114a-dc9e-407a-b991-a0079c6edadd None admin] RBAC: Adding query filter params (role.id=068a24594f0b4d01aab3485c009314d4, scope.project.id=093594e09a464d69aa54068e56284d4c, user.id=b0c8c916f4a849b19484742f9e99bd2c) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:54.815908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc114a-dc9e-407a-b991-a0079c6edadd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:54.818800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc114a-dc9e-407a-b991-a0079c6edadd None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:54.834567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 47/90] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:55:54.835594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0a213-a56d-49d3-be2d-504cee53e87e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:54.836468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 44/91] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:55:54 2022] GET /identity/v3/role_assignments?user.id=b0c8c916f4a849b19484742f9e99bd2c&scope.project.id=093594e09a464d69aa54068e56284d4c&role.id=068a24594f0b4d01aab3485c009314d4 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:54.838252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc114a-dc9e-407a-b991-a0079c6edadd None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:55.008706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc114a-dc9e-407a-b991-a0079c6edadd None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:55.013085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:55.044481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0a213-a56d-49d3-be2d-504cee53e87e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:55.066163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:55.098702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25408f6-1acc-4314-918e-a216696bec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:55.099394 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25408f6-1acc-4314-918e-a216696bec3e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:55.099740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25408f6-1acc-4314-918e-a216696bec3e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:55.100025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25408f6-1acc-4314-918e-a216696bec3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:55.100490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e107e-81e3-4bc1-b588-a16910bdcb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:55.101707 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e107e-81e3-4bc1-b588-a16910bdcb09 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:55.102390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e107e-81e3-4bc1-b588-a16910bdcb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:55.104521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e107e-81e3-4bc1-b588-a16910bdcb09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:55.106045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e107e-81e3-4bc1-b588-a16910bdcb09 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=093594e09a464d69aa54068e56284d4c, user.id=ce735e61d3c64f3e9c5c513c8681f881) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:55.106778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e107e-81e3-4bc1-b588-a16910bdcb09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:55.110327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e107e-81e3-4bc1-b588-a16910bdcb09 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:55.118558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 45/92] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:55:54 2022] GET /identity/v3/role_assignments?user.id=ce735e61d3c64f3e9c5c513c8681f881&scope.project.id=093594e09a464d69aa54068e56284d4c&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:55.119686 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e107e-81e3-4bc1-b588-a16910bdcb09 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:55.260727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25408f6-1acc-4314-918e-a216696bec3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:55.262496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25408f6-1acc-4314-918e-a216696bec3e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:55.363808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e107e-81e3-4bc1-b588-a16910bdcb09 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:55.466590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313bba8-89ad-4636-bff5-073ba9cdb65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:55.467340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313bba8-89ad-4636-bff5-073ba9cdb65f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:55.468200 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313bba8-89ad-4636-bff5-073ba9cdb65f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:55.468561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313bba8-89ad-4636-bff5-073ba9cdb65f None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:55.470122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313bba8-89ad-4636-bff5-073ba9cdb65f None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:55.472657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313bba8-89ad-4636-bff5-073ba9cdb65f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:55.474862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 46/93] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:55:55 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:55.478036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 48/94] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:55:55.484338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25408f6-1acc-4314-918e-a216696bec3e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:55.484540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313bba8-89ad-4636-bff5-073ba9cdb65f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:55.504423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:55.538183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:55.651923 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313bba8-89ad-4636-bff5-073ba9cdb65f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:55.689009 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8389-2eab-415f-9663-58d54dc2b9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:55.689633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8389-2eab-415f-9663-58d54dc2b9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:55.689918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8389-2eab-415f-9663-58d54dc2b9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:55.690422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca8389-2eab-415f-9663-58d54dc2b9a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:55.691256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca8389-2eab-415f-9663-58d54dc2b9a6 None admin] RBAC: Adding query filter params (role.id=62c69ea249044f258a2a6f2138ff4ceb, scope.project.id=093594e09a464d69aa54068e56284d4c, user.id=b0c8c916f4a849b19484742f9e99bd2c) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:55.691687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca8389-2eab-415f-9663-58d54dc2b9a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:55.693296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca8389-2eab-415f-9663-58d54dc2b9a6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:55.696599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25408f6-1acc-4314-918e-a216696bec3e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:55.700140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 47/95] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:55:55 2022] GET /identity/v3/role_assignments?user.id=b0c8c916f4a849b19484742f9e99bd2c&scope.project.id=093594e09a464d69aa54068e56284d4c&role.id=62c69ea249044f258a2a6f2138ff4ceb => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:55:55.768616 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd240ecf-a175-4cf5-91ee-9e06daa9b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:55.769517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd240ecf-a175-4cf5-91ee-9e06daa9b019 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:55.769866 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd240ecf-a175-4cf5-91ee-9e06daa9b019 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:55.770209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd240ecf-a175-4cf5-91ee-9e06daa9b019 None admin] PATH_INFO: `/v3/projects/2551fc7ddfc941d6805c8ed9874fca42` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:55.771600 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd240ecf-a175-4cf5-91ee-9e06daa9b019 None admin] RBAC: Authorizing `identity:get_project(project_id=2551fc7ddfc941d6805c8ed9874fca42)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:55.773134 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd240ecf-a175-4cf5-91ee-9e06daa9b019 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:55.781224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 49/96] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:55:55 2022] GET /identity/v3/projects/2551fc7ddfc941d6805c8ed9874fca42 => generated 312 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:55:55.790044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8389-2eab-415f-9663-58d54dc2b9a6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:55.933094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:55.944986 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca8389-2eab-415f-9663-58d54dc2b9a6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:55.998568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2976e5-7de7-4101-96c9-0151c1884e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:55.999406 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2976e5-7de7-4101-96c9-0151c1884e2c None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:55.999879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2976e5-7de7-4101-96c9-0151c1884e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:56.000168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2976e5-7de7-4101-96c9-0151c1884e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:56.000975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2976e5-7de7-4101-96c9-0151c1884e2c None admin] RBAC: Adding query filter params (role.id=068a24594f0b4d01aab3485c009314d4, scope.project.id=2551fc7ddfc941d6805c8ed9874fca42, user.id=b0c8c916f4a849b19484742f9e99bd2c) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:56.001292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2976e5-7de7-4101-96c9-0151c1884e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:56.002764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2976e5-7de7-4101-96c9-0151c1884e2c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:56.012932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 48/97] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:55:55 2022] GET /identity/v3/role_assignments?user.id=b0c8c916f4a849b19484742f9e99bd2c&scope.project.id=2551fc7ddfc941d6805c8ed9874fca42&role.id=068a24594f0b4d01aab3485c009314d4 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:57.832267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2aa46-94ba-4744-a0b1-f5484b1fc7dc None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:57.832805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2aa46-94ba-4744-a0b1-f5484b1fc7dc None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:57.833096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2aa46-94ba-4744-a0b1-f5484b1fc7dc None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:57.834496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 50/98] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:57.845393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cfcc7-2de5-40b9-8538-151d691809ea None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:57.846027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cfcc7-2de5-40b9-8538-151d691809ea None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:57.846027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cfcc7-2de5-40b9-8538-151d691809ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:57.882143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-bf4cfcc7-2de5-40b9-8538-151d691809ea None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:57.883741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-bf4cfcc7-2de5-40b9-8538-151d691809ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:57.921690 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706ec8-526d-4558-bb8c-568eb021551d None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:57.922037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706ec8-526d-4558-bb8c-568eb021551d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:57.922330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706ec8-526d-4558-bb8c-568eb021551d None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:57.924182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 51/99] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:57.929620 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27c25c-d737-426f-96ff-24a4bef088ca None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:57.929941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27c25c-d737-426f-96ff-24a4bef088ca None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:57.930231 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27c25c-d737-426f-96ff-24a4bef088ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:57.961506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7b27c25c-d737-426f-96ff-24a4bef088ca None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:57.962902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7b27c25c-d737-426f-96ff-24a4bef088ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:57.981356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 49/100] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:55:58.091689 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 52/101] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:55:58.457473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cfcc7-2de5-40b9-8538-151d691809ea None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:58.565204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:58.594291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cfcc7-2de5-40b9-8538-151d691809ea None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:58.649965 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95225418-dfd6-44ba-bc99-f99547d0c312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:58.650614 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95225418-dfd6-44ba-bc99-f99547d0c312 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:58.650895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95225418-dfd6-44ba-bc99-f99547d0c312 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:58.651173 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95225418-dfd6-44ba-bc99-f99547d0c312 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:58.652297 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95225418-dfd6-44ba-bc99-f99547d0c312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:58.653778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95225418-dfd6-44ba-bc99-f99547d0c312 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:58.657757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 50/102] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:55:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:55:58.662583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27c25c-d737-426f-96ff-24a4bef088ca None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:58.683012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:58.740879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95225418-dfd6-44ba-bc99-f99547d0c312 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:58.841008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27c25c-d737-426f-96ff-24a4bef088ca None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:58.923352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e990e9d-3f8a-407e-bc7b-c8c7d48e5a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:58.923978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e990e9d-3f8a-407e-bc7b-c8c7d48e5a42 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:58.924259 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e990e9d-3f8a-407e-bc7b-c8c7d48e5a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:58.924533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e990e9d-3f8a-407e-bc7b-c8c7d48e5a42 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:58.925236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e990e9d-3f8a-407e-bc7b-c8c7d48e5a42 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:58.926701 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e990e9d-3f8a-407e-bc7b-c8c7d48e5a42 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:58.950891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95225418-dfd6-44ba-bc99-f99547d0c312 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:58.976674 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 53/103] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:55:58 2022] POST /identity/v3/projects => generated 302 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:55:59.016911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17351e-281f-4fba-9b1e-85957f753b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:59.017495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17351e-281f-4fba-9b1e-85957f753b17 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:59.017732 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894ccfb-6ea7-41f3-b72e-4a547791958a None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:59.018080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17351e-281f-4fba-9b1e-85957f753b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:59.018287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17351e-281f-4fba-9b1e-85957f753b17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:59.018397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894ccfb-6ea7-41f3-b72e-4a547791958a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:59.018679 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894ccfb-6ea7-41f3-b72e-4a547791958a None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:59.020365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 54/104] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:59.027186 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2531c71-9bed-4598-8faf-fdc6c11e2d79 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:59.027498 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2531c71-9bed-4598-8faf-fdc6c11e2d79 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:59.027830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2531c71-9bed-4598-8faf-fdc6c11e2d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:59.043724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17351e-281f-4fba-9b1e-85957f753b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-2a17351e-281f-4fba-9b1e-85957f753b17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:55:59.050166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:55:59.051066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:55:59.051958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:55:59.051958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:55:59.051958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:55:59.051958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:55:59.051958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:55:59.051958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:55:59.051958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:55:59.051958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:55:59.051958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:55:59.051958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:55:59.051958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:55:59.051958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:55:59.052544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-e2531c71-9bed-4598-8faf-fdc6c11e2d79 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:59.053817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e2531c71-9bed-4598-8faf-fdc6c11e2d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:59.057415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 51/105] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:55:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:55:59.058939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079ee5d-5b73-4cc8-89e4-e9e5da1c0760 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:59.059228 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079ee5d-5b73-4cc8-89e4-e9e5da1c0760 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:59.059507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079ee5d-5b73-4cc8-89e4-e9e5da1c0760 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:59.060877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 52/106] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:59.069765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079ee5d-5b73-4cc8-89e4-e9e5da1c0760 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:59.080170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:59.193281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079ee5d-5b73-4cc8-89e4-e9e5da1c0760 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:59.232665 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13039c14-0d45-4ad8-af62-2a0061ac1432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:59.234222 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13039c14-0d45-4ad8-af62-2a0061ac1432 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:59.234704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13039c14-0d45-4ad8-af62-2a0061ac1432 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:59.235173 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13039c14-0d45-4ad8-af62-2a0061ac1432 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:59.235824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:59.237003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13039c14-0d45-4ad8-af62-2a0061ac1432 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:55:59.237563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13039c14-0d45-4ad8-af62-2a0061ac1432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:59.240047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13039c14-0d45-4ad8-af62-2a0061ac1432 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:59.251860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 53/107] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:55:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:55:59.253485 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24f5ae-cada-4c4a-be15-3b80f924eca1 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:59.254122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24f5ae-cada-4c4a-be15-3b80f924eca1 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:59.254593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24f5ae-cada-4c4a-be15-3b80f924eca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:59.255653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 55/108] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:55:59.260563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2531c71-9bed-4598-8faf-fdc6c11e2d79 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:59.276263 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-5a24f5ae-cada-4c4a-be15-3b80f924eca1 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:59.277930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-5a24f5ae-cada-4c4a-be15-3b80f924eca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:59.352831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:59.361222 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 54/109] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:55:59.362650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe30d9-d229-45bf-8714-a94b972100bd None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:59.363302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe30d9-d229-45bf-8714-a94b972100bd None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:59.363888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe30d9-d229-45bf-8714-a94b972100bd None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:59.365600 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 55/110] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:55:59.371567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98899cb-37ea-4cd3-8eda-722fb4f82901 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:59.372035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98899cb-37ea-4cd3-8eda-722fb4f82901 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:59.372330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98899cb-37ea-4cd3-8eda-722fb4f82901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:59.394179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c98899cb-37ea-4cd3-8eda-722fb4f82901 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:59.395530 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c98899cb-37ea-4cd3-8eda-722fb4f82901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:59.446043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2531c71-9bed-4598-8faf-fdc6c11e2d79 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:59.472260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 56/111] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:55:59.503354 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5accf3-204a-425f-824f-2a85e8e66c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:59.504261 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5accf3-204a-425f-824f-2a85e8e66c29 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:59.504796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5accf3-204a-425f-824f-2a85e8e66c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:59.505264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5accf3-204a-425f-824f-2a85e8e66c29 None admin] PATH_INFO: `/v3/users/7603f99a8e8b4c4188c637c95ee98884` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:59.524974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5accf3-204a-425f-824f-2a85e8e66c29 None admin] RBAC: Authorizing `identity:get_user(user_id=7603f99a8e8b4c4188c637c95ee98884)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:59.526988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5accf3-204a-425f-824f-2a85e8e66c29 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:55:59.529140 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 56/112] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:55:59 2022] GET /identity/v3/users/7603f99a8e8b4c4188c637c95ee98884 => generated 289 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:55:59.535216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98899cb-37ea-4cd3-8eda-722fb4f82901 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:59.683269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98899cb-37ea-4cd3-8eda-722fb4f82901 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:55:59.725913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:59.727933 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054a946-c0b1-421b-bc42-fa47ac205c7a None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:59.729481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054a946-c0b1-421b-bc42-fa47ac205c7a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:59.730124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054a946-c0b1-421b-bc42-fa47ac205c7a None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:59.732866 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 57/113] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:55:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:55:59.739737 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc85e7a-1bd4-4b36-92d6-17c664c7f2c1 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:59.740400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc85e7a-1bd4-4b36-92d6-17c664c7f2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:59.740978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc85e7a-1bd4-4b36-92d6-17c664c7f2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:59.762380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3593d-62ab-4821-bcfa-e0cd3ff3eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:55:59.763465 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3593d-62ab-4821-bcfa-e0cd3ff3eb1a None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:55:59.764038 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3593d-62ab-4821-bcfa-e0cd3ff3eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:55:59.765155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3593d-62ab-4821-bcfa-e0cd3ff3eb1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:55:59.776954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-edc85e7a-1bd4-4b36-92d6-17c664c7f2c1 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:55:59.783407 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-edc85e7a-1bd4-4b36-92d6-17c664c7f2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:55:59.847133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:59.872634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 58/114] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:55:59.874159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc85e7a-1bd4-4b36-92d6-17c664c7f2c1 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:55:59.919774 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3593d-62ab-4821-bcfa-e0cd3ff3eb1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:55:59.922692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3593d-62ab-4821-bcfa-e0cd3ff3eb1a None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:00.037635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc85e7a-1bd4-4b36-92d6-17c664c7f2c1 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:00.062053 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 57/115] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:00.062948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3593d-62ab-4821-bcfa-e0cd3ff3eb1a None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.079893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79abf2-1ed8-4249-a653-6e0330813b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:00.080970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79abf2-1ed8-4249-a653-6e0330813b7e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.081417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79abf2-1ed8-4249-a653-6e0330813b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.081960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79abf2-1ed8-4249-a653-6e0330813b7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.093468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:00.097148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79abf2-1ed8-4249-a653-6e0330813b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-7b79abf2-1ed8-4249-a653-6e0330813b7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:00.104247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:00.105360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:00.106258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:00.106258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:00.106258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:00.106258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:00.106258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:00.106258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:00.106258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:00.106258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:00.106258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:00.106258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:00.106258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:00.106258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:00.109198 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 59/116] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:55:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:00.110432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79abf2-1ed8-4249-a653-6e0330813b7e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.169993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:00.174347 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3593d-62ab-4821-bcfa-e0cd3ff3eb1a None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:00.216319 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d46e2-25e9-4002-a123-8c92f4b975f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:00.217071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d46e2-25e9-4002-a123-8c92f4b975f5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.217447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d46e2-25e9-4002-a123-8c92f4b975f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.217813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d46e2-25e9-4002-a123-8c92f4b975f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.230672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d46e2-25e9-4002-a123-8c92f4b975f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-f29d46e2-25e9-4002-a123-8c92f4b975f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:00.236292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:00.237836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 58/117] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:56:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:00.238813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d46e2-25e9-4002-a123-8c92f4b975f5 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.253706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79abf2-1ed8-4249-a653-6e0330813b7e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:00.299281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21631018-817f-47aa-934a-34d05e56f15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:00.299997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21631018-817f-47aa-934a-34d05e56f15b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.300278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21631018-817f-47aa-934a-34d05e56f15b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.300610 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21631018-817f-47aa-934a-34d05e56f15b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.314300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21631018-817f-47aa-934a-34d05e56f15b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-21631018-817f-47aa-934a-34d05e56f15b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:00.320014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:00.321235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:00.322011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 60/118] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:00.323128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21631018-817f-47aa-934a-34d05e56f15b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.354008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:00.371019 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d46e2-25e9-4002-a123-8c92f4b975f5 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:00.410780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155bb6b-c40a-4d18-83ba-5c8ae921900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:00.411415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155bb6b-c40a-4d18-83ba-5c8ae921900b None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.411700 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155bb6b-c40a-4d18-83ba-5c8ae921900b None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.411974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155bb6b-c40a-4d18-83ba-5c8ae921900b None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.413169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155bb6b-c40a-4d18-83ba-5c8ae921900b None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:00.414659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155bb6b-c40a-4d18-83ba-5c8ae921900b None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:00.421642 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 59/119] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:00 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:00.422589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155bb6b-c40a-4d18-83ba-5c8ae921900b None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.458225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21631018-817f-47aa-934a-34d05e56f15b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:00.460094 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:00.502531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9d592-fc6b-4301-9508-1ea3f1ed85f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:00.503258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9d592-fc6b-4301-9508-1ea3f1ed85f0 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.503548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9d592-fc6b-4301-9508-1ea3f1ed85f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.503831 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9d592-fc6b-4301-9508-1ea3f1ed85f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.504504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9d592-fc6b-4301-9508-1ea3f1ed85f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:00.504922 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9d592-fc6b-4301-9508-1ea3f1ed85f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:00.506399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9d592-fc6b-4301-9508-1ea3f1ed85f0 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:00.520773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 61/120] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:00.520773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9d592-fc6b-4301-9508-1ea3f1ed85f0 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.562060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155bb6b-c40a-4d18-83ba-5c8ae921900b None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:00.603646 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117539d-7e74-436a-863c-9f8b6fd0f77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:00.604588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117539d-7e74-436a-863c-9f8b6fd0f77d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.604909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117539d-7e74-436a-863c-9f8b6fd0f77d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.605186 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117539d-7e74-436a-863c-9f8b6fd0f77d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.617039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117539d-7e74-436a-863c-9f8b6fd0f77d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-2117539d-7e74-436a-863c-9f8b6fd0f77d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:00.622320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:00.623215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:00.624221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 60/121] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:00.625900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117539d-7e74-436a-863c-9f8b6fd0f77d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.646493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9d592-fc6b-4301-9508-1ea3f1ed85f0 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:00.649276 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:00.687652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fcf50-523a-4fc2-95f8-804f87547d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:00.688276 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fcf50-523a-4fc2-95f8-804f87547d6a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.688560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fcf50-523a-4fc2-95f8-804f87547d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.688867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fcf50-523a-4fc2-95f8-804f87547d6a None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.689598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fcf50-523a-4fc2-95f8-804f87547d6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:00.689908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fcf50-523a-4fc2-95f8-804f87547d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:00.691314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fcf50-523a-4fc2-95f8-804f87547d6a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:00.700013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 62/122] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:56:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:00.700013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fcf50-523a-4fc2-95f8-804f87547d6a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.735949 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:00.767224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117539d-7e74-436a-863c-9f8b6fd0f77d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:00.813687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713d194-5717-486a-8256-8e9b397e1f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:00.814230 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713d194-5717-486a-8256-8e9b397e1f68 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.814516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713d194-5717-486a-8256-8e9b397e1f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.814796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713d194-5717-486a-8256-8e9b397e1f68 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.815475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713d194-5717-486a-8256-8e9b397e1f68 None admin] RBAC: Adding query filter params (name=member) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:00.815785 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713d194-5717-486a-8256-8e9b397e1f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:00.817226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713d194-5717-486a-8256-8e9b397e1f68 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:00.821503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fcf50-523a-4fc2-95f8-804f87547d6a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:00.828741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 61/123] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:00.830491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713d194-5717-486a-8256-8e9b397e1f68 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.862612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe0932-c887-44fd-8704-9f4ff4c35c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:00.863250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe0932-c887-44fd-8704-9f4ff4c35c05 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.863771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe0932-c887-44fd-8704-9f4ff4c35c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.863771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe0932-c887-44fd-8704-9f4ff4c35c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.864509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe0932-c887-44fd-8704-9f4ff4c35c05 None admin] RBAC: Adding query filter params (role.id=1084d899c92849ce9ba431f0fecfe796, scope.project.id=093594e09a464d69aa54068e56284d4c, user.id=7603f99a8e8b4c4188c637c95ee98884) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:00.864860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe0932-c887-44fd-8704-9f4ff4c35c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:00.866319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe0932-c887-44fd-8704-9f4ff4c35c05 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:00.884713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 63/124] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:00 2022] GET /identity/v3/role_assignments?user.id=7603f99a8e8b4c4188c637c95ee98884&scope.project.id=093594e09a464d69aa54068e56284d4c&role.id=1084d899c92849ce9ba431f0fecfe796 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:00.884713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe0932-c887-44fd-8704-9f4ff4c35c05 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.954215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:00.986551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713d194-5717-486a-8256-8e9b397e1f68 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.010361 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:01.025068 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe0932-c887-44fd-8704-9f4ff4c35c05 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.040616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e12c6-adcc-4d9d-bcc7-05d389a7d8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.042008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e12c6-adcc-4d9d-bcc7-05d389a7d8fb None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.042669 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e12c6-adcc-4d9d-bcc7-05d389a7d8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.043356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e12c6-adcc-4d9d-bcc7-05d389a7d8fb None admin] PATH_INFO: `/v3/users/ce735e61d3c64f3e9c5c513c8681f881` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.046273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e12c6-adcc-4d9d-bcc7-05d389a7d8fb None admin] RBAC: Authorizing `identity:get_user(user_id=ce735e61d3c64f3e9c5c513c8681f881)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.048701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e12c6-adcc-4d9d-bcc7-05d389a7d8fb None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.050905 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 62/125] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:00 2022] GET /identity/v3/users/ce735e61d3c64f3e9c5c513c8681f881 => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.052258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e12c6-adcc-4d9d-bcc7-05d389a7d8fb None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.078223 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adf3cc-df3a-4742-8a5e-5538f817a6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.079283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adf3cc-df3a-4742-8a5e-5538f817a6ba None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.079578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adf3cc-df3a-4742-8a5e-5538f817a6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.079861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adf3cc-df3a-4742-8a5e-5538f817a6ba None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.080867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adf3cc-df3a-4742-8a5e-5538f817a6ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:01.081182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adf3cc-df3a-4742-8a5e-5538f817a6ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.082765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adf3cc-df3a-4742-8a5e-5538f817a6ba None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.100600 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 64/126] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.101510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adf3cc-df3a-4742-8a5e-5538f817a6ba None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.174232 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e12c6-adcc-4d9d-bcc7-05d389a7d8fb None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.219035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d310e-d0a5-48e0-88ac-6f1b51d7bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.220459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d310e-d0a5-48e0-88ac-6f1b51d7bf23 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.221081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d310e-d0a5-48e0-88ac-6f1b51d7bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.221682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d310e-d0a5-48e0-88ac-6f1b51d7bf23 None admin] PATH_INFO: `/v3/users/b0c8c916f4a849b19484742f9e99bd2c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.223515 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d310e-d0a5-48e0-88ac-6f1b51d7bf23 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8c916f4a849b19484742f9e99bd2c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.225636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d310e-d0a5-48e0-88ac-6f1b51d7bf23 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.227779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 63/127] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/users/b0c8c916f4a849b19484742f9e99bd2c => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.229921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d310e-d0a5-48e0-88ac-6f1b51d7bf23 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.233517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adf3cc-df3a-4742-8a5e-5538f817a6ba None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.254477 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:01.272393 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da57397-3ca8-469b-822d-54c4643babd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.273339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57397-3ca8-469b-822d-54c4643babd1 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.273626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57397-3ca8-469b-822d-54c4643babd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.273904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57397-3ca8-469b-822d-54c4643babd1 None admin] PATH_INFO: `/v3/users/b0c8c916f4a849b19484742f9e99bd2c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.275261 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da57397-3ca8-469b-822d-54c4643babd1 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8c916f4a849b19484742f9e99bd2c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.277409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da57397-3ca8-469b-822d-54c4643babd1 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.279391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 65/128] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/users/b0c8c916f4a849b19484742f9e99bd2c => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.284972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da57397-3ca8-469b-822d-54c4643babd1 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.329746 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:01.381510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d310e-d0a5-48e0-88ac-6f1b51d7bf23 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.428007 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69122253-3946-429d-b508-15d595a47f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.428946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69122253-3946-429d-b508-15d595a47f54 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.429391 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69122253-3946-429d-b508-15d595a47f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.429815 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69122253-3946-429d-b508-15d595a47f54 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.429992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da57397-3ca8-469b-822d-54c4643babd1 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.431346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69122253-3946-429d-b508-15d595a47f54 None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.434212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69122253-3946-429d-b508-15d595a47f54 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.436090 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 64/129] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.437045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69122253-3946-429d-b508-15d595a47f54 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.471701 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98219df-f513-4644-9520-f8b684b202b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.472811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98219df-f513-4644-9520-f8b684b202b3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.473200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98219df-f513-4644-9520-f8b684b202b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.473635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98219df-f513-4644-9520-f8b684b202b3 None admin] PATH_INFO: `/v3/users/b0c8c916f4a849b19484742f9e99bd2c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.475689 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98219df-f513-4644-9520-f8b684b202b3 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8c916f4a849b19484742f9e99bd2c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.478146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98219df-f513-4644-9520-f8b684b202b3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.480794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 66/130] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/users/b0c8c916f4a849b19484742f9e99bd2c => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.481994 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98219df-f513-4644-9520-f8b684b202b3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.544792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:01.567262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69122253-3946-429d-b508-15d595a47f54 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.619282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:01.626015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c255a-091b-4084-a954-7a09f289996e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.627330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c255a-091b-4084-a954-7a09f289996e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.628313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c255a-091b-4084-a954-7a09f289996e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.628833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c255a-091b-4084-a954-7a09f289996e None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.630477 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c255a-091b-4084-a954-7a09f289996e None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.633028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c255a-091b-4084-a954-7a09f289996e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.635230 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 65/131] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.636477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98219df-f513-4644-9520-f8b684b202b3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.637751 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c255a-091b-4084-a954-7a09f289996e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.677655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dff410-672e-49d2-80ed-0eb1ea0afd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.678309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dff410-672e-49d2-80ed-0eb1ea0afd03 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.678589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dff410-672e-49d2-80ed-0eb1ea0afd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.678859 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dff410-672e-49d2-80ed-0eb1ea0afd03 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.680016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dff410-672e-49d2-80ed-0eb1ea0afd03 None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.681493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dff410-672e-49d2-80ed-0eb1ea0afd03 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.683413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 67/132] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.683863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dff410-672e-49d2-80ed-0eb1ea0afd03 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.778535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c255a-091b-4084-a954-7a09f289996e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.799489 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dff410-672e-49d2-80ed-0eb1ea0afd03 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.819382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f01179-9ba8-485a-9332-efcfa315b93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.820590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f01179-9ba8-485a-9332-efcfa315b93b None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.821230 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f01179-9ba8-485a-9332-efcfa315b93b None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.821729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f01179-9ba8-485a-9332-efcfa315b93b None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c/users/ce735e61d3c64f3e9c5c513c8681f881/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.824082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f01179-9ba8-485a-9332-efcfa315b93b None admin] RBAC: Authorizing `identity:create_grant(project_id=093594e09a464d69aa54068e56284d4c, user_id=ce735e61d3c64f3e9c5c513c8681f881, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.825964 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f01179-9ba8-485a-9332-efcfa315b93b None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.836050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a634a89-d54f-4771-84d6-fb0597f48fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.836712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a634a89-d54f-4771-84d6-fb0597f48fba None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.837025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a634a89-d54f-4771-84d6-fb0597f48fba None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.837310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a634a89-d54f-4771-84d6-fb0597f48fba None admin] PATH_INFO: `/v3/projects/2551fc7ddfc941d6805c8ed9874fca42` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.839439 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a634a89-d54f-4771-84d6-fb0597f48fba None admin] RBAC: Authorizing `identity:get_project(project_id=2551fc7ddfc941d6805c8ed9874fca42)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.841078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a634a89-d54f-4771-84d6-fb0597f48fba None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.844057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 68/133] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/projects/2551fc7ddfc941d6805c8ed9874fca42 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.844281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a634a89-d54f-4771-84d6-fb0597f48fba None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.852924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 66/134] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:56:01 2022] PUT /identity/v3/projects/093594e09a464d69aa54068e56284d4c/users/ce735e61d3c64f3e9c5c513c8681f881/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:01.854398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f01179-9ba8-485a-9332-efcfa315b93b None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.873743 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:01.874678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:01.963256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a634a89-d54f-4771-84d6-fb0597f48fba None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.002374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f01179-9ba8-485a-9332-efcfa315b93b None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.003802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d77e-7e68-4f16-941e-076e05b9421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.004493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d77e-7e68-4f16-941e-076e05b9421f None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.004817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d77e-7e68-4f16-941e-076e05b9421f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.005108 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d77e-7e68-4f16-941e-076e05b9421f None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c/users/b0c8c916f4a849b19484742f9e99bd2c/roles/62c69ea249044f258a2a6f2138ff4ceb` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.007386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979d77e-7e68-4f16-941e-076e05b9421f None admin] RBAC: Authorizing `identity:create_grant(project_id=093594e09a464d69aa54068e56284d4c, user_id=b0c8c916f4a849b19484742f9e99bd2c, role_id=62c69ea249044f258a2a6f2138ff4ceb)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.008939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979d77e-7e68-4f16-941e-076e05b9421f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.036423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 69/135] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:56:01 2022] PUT /identity/v3/projects/093594e09a464d69aa54068e56284d4c/users/b0c8c916f4a849b19484742f9e99bd2c/roles/62c69ea249044f258a2a6f2138ff4ceb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:02.036423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d77e-7e68-4f16-941e-076e05b9421f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.065037 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525b60d-fe01-4cf6-95bf-171129dda26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.065729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525b60d-fe01-4cf6-95bf-171129dda26f None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.066020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525b60d-fe01-4cf6-95bf-171129dda26f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.066301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525b60d-fe01-4cf6-95bf-171129dda26f None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c/users/b0c8c916f4a849b19484742f9e99bd2c/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.068355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525b60d-fe01-4cf6-95bf-171129dda26f None admin] RBAC: Authorizing `identity:create_grant(project_id=093594e09a464d69aa54068e56284d4c, user_id=b0c8c916f4a849b19484742f9e99bd2c, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.070784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525b60d-fe01-4cf6-95bf-171129dda26f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.089590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 67/136] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:56:01 2022] PUT /identity/v3/projects/093594e09a464d69aa54068e56284d4c/users/b0c8c916f4a849b19484742f9e99bd2c/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:02.091114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe624a-4b3b-4d34-93d8-c386ecbb276b None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.091417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe624a-4b3b-4d34-93d8-c386ecbb276b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.091689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe624a-4b3b-4d34-93d8-c386ecbb276b None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.094190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 68/137] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:02.100560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618b190-ba4d-46d6-b542-53df8dc4f479 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.100936 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618b190-ba4d-46d6-b542-53df8dc4f479 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.101158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618b190-ba4d-46d6-b542-53df8dc4f479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.145673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-1618b190-ba4d-46d6-b542-53df8dc4f479 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:02.147101 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1618b190-ba4d-46d6-b542-53df8dc4f479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:02.189762 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:02.229930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d77e-7e68-4f16-941e-076e05b9421f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.311855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207de262-15f4-47eb-8ca2-0b9b6f81f84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.312748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207de262-15f4-47eb-8ca2-0b9b6f81f84d None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.313041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207de262-15f4-47eb-8ca2-0b9b6f81f84d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.313326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207de262-15f4-47eb-8ca2-0b9b6f81f84d None admin] PATH_INFO: `/v3/projects/2551fc7ddfc941d6805c8ed9874fca42/users/b0c8c916f4a849b19484742f9e99bd2c/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.315724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207de262-15f4-47eb-8ca2-0b9b6f81f84d None admin] RBAC: Authorizing `identity:create_grant(project_id=2551fc7ddfc941d6805c8ed9874fca42, user_id=b0c8c916f4a849b19484742f9e99bd2c, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.317492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:02.317958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207de262-15f4-47eb-8ca2-0b9b6f81f84d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.334128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 70/138] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:56:02 2022] PUT /identity/v3/projects/2551fc7ddfc941d6805c8ed9874fca42/users/b0c8c916f4a849b19484742f9e99bd2c/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:02.334844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 69/139] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:02.763945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207de262-15f4-47eb-8ca2-0b9b6f81f84d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.903698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207de262-15f4-47eb-8ca2-0b9b6f81f84d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.947173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efbbca-a06b-40d3-946a-5e93ddfafdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.948165 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efbbca-a06b-40d3-946a-5e93ddfafdab None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.948640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efbbca-a06b-40d3-946a-5e93ddfafdab None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.949152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efbbca-a06b-40d3-946a-5e93ddfafdab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.950470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efbbca-a06b-40d3-946a-5e93ddfafdab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.952923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efbbca-a06b-40d3-946a-5e93ddfafdab None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.955440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 71/140] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:02.962251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618b190-ba4d-46d6-b542-53df8dc4f479 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.152095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618b190-ba4d-46d6-b542-53df8dc4f479 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.211018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d446c-b87b-4471-9cee-f702b09eed5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.212181 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d446c-b87b-4471-9cee-f702b09eed5a None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.212794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d446c-b87b-4471-9cee-f702b09eed5a None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.213368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d446c-b87b-4471-9cee-f702b09eed5a None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.214318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d446c-b87b-4471-9cee-f702b09eed5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.216175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d446c-b87b-4471-9cee-f702b09eed5a None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.250635 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 70/141] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:56:02 2022] POST /identity/v3/users => generated 283 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:03.818029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0bb59-79e6-46a4-8d87-caad76d4b496 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.818429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0bb59-79e6-46a4-8d87-caad76d4b496 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.818561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0bb59-79e6-46a4-8d87-caad76d4b496 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.820214 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 72/142] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:03.828805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf0925-b5fa-46d2-bfd3-07f7c659826f None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.829888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf0925-b5fa-46d2-bfd3-07f7c659826f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.830567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf0925-b5fa-46d2-bfd3-07f7c659826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.860505 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-0caf0925-b5fa-46d2-bfd3-07f7c659826f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:03.862406 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0caf0925-b5fa-46d2-bfd3-07f7c659826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:03.948650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:03.973695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 71/143] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:04.343085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0bb59-79e6-46a4-8d87-caad76d4b496 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:04.367026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:04.490139 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0bb59-79e6-46a4-8d87-caad76d4b496 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:04.537256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e53207-572e-4f48-937f-a9f7eb117b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:04.537912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e53207-572e-4f48-937f-a9f7eb117b77 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.538194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e53207-572e-4f48-937f-a9f7eb117b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.538465 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e53207-572e-4f48-937f-a9f7eb117b77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.553014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e53207-572e-4f48-937f-a9f7eb117b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-b5e53207-572e-4f48-937f-a9f7eb117b77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:04.558029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:04.558880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:04.560152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 73/144] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:04.565992 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf0925-b5fa-46d2-bfd3-07f7c659826f None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:04.715422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf0925-b5fa-46d2-bfd3-07f7c659826f None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:04.774996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cabd25-a6f4-4e81-88db-f1aab7b09f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:04.775854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cabd25-a6f4-4e81-88db-f1aab7b09f26 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.776222 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cabd25-a6f4-4e81-88db-f1aab7b09f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.776712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cabd25-a6f4-4e81-88db-f1aab7b09f26 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.777677 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cabd25-a6f4-4e81-88db-f1aab7b09f26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:04.777981 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cabd25-a6f4-4e81-88db-f1aab7b09f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:04.779454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cabd25-a6f4-4e81-88db-f1aab7b09f26 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:04.796161 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 72/145] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:04.803033 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e53207-572e-4f48-937f-a9f7eb117b77 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:04.893189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:04.932469 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e53207-572e-4f48-937f-a9f7eb117b77 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:04.975713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c3872-326f-4496-9ed2-24706b00fa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:04.976641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c3872-326f-4496-9ed2-24706b00fa71 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.977071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c3872-326f-4496-9ed2-24706b00fa71 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.977468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c3872-326f-4496-9ed2-24706b00fa71 None admin] PATH_INFO: `/v3/users/7603f99a8e8b4c4188c637c95ee98884` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.979507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c3872-326f-4496-9ed2-24706b00fa71 None admin] RBAC: Authorizing `identity:get_user(user_id=7603f99a8e8b4c4188c637c95ee98884)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:04.981102 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c3872-326f-4496-9ed2-24706b00fa71 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:04.984611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 74/146] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:04 2022] GET /identity/v3/users/7603f99a8e8b4c4188c637c95ee98884 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:04.992251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cabd25-a6f4-4e81-88db-f1aab7b09f26 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:05.055940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:05.129789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cabd25-a6f4-4e81-88db-f1aab7b09f26 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:05.198148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323792b1-6f13-464a-bd2c-bbe73f0563f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:05.199205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323792b1-6f13-464a-bd2c-bbe73f0563f3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:05.199713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323792b1-6f13-464a-bd2c-bbe73f0563f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:05.200200 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323792b1-6f13-464a-bd2c-bbe73f0563f3 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:05.203290 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323792b1-6f13-464a-bd2c-bbe73f0563f3 None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:05.205495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323792b1-6f13-464a-bd2c-bbe73f0563f3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:05.208727 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 73/147] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:04 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:05.218839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c3872-326f-4496-9ed2-24706b00fa71 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:05.424946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c3872-326f-4496-9ed2-24706b00fa71 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:05.493126 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a48fc-a017-4774-b8c4-e942779fd856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:05.494260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a48fc-a017-4774-b8c4-e942779fd856 None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:05.494595 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a48fc-a017-4774-b8c4-e942779fd856 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:05.494957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a48fc-a017-4774-b8c4-e942779fd856 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c/users/7603f99a8e8b4c4188c637c95ee98884/roles/1084d899c92849ce9ba431f0fecfe796` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:05.499041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a48fc-a017-4774-b8c4-e942779fd856 None admin] RBAC: Authorizing `identity:create_grant(project_id=093594e09a464d69aa54068e56284d4c, user_id=7603f99a8e8b4c4188c637c95ee98884, role_id=1084d899c92849ce9ba431f0fecfe796)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:05.501617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a48fc-a017-4774-b8c4-e942779fd856 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:05.514437 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:05.520702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 75/148] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:56:05 2022] PUT /identity/v3/projects/093594e09a464d69aa54068e56284d4c/users/7603f99a8e8b4c4188c637c95ee98884/roles/1084d899c92849ce9ba431f0fecfe796 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:06.144516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febde234-e091-42dd-a6b2-e818e093fd19 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.145278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febde234-e091-42dd-a6b2-e818e093fd19 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.145278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febde234-e091-42dd-a6b2-e818e093fd19 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.146787 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 74/149] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:06.152432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996cd7b-51bc-4651-aa1d-4e410602bd3a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.152809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996cd7b-51bc-4651-aa1d-4e410602bd3a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.153112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996cd7b-51bc-4651-aa1d-4e410602bd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.182202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-5996cd7b-51bc-4651-aa1d-4e410602bd3a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:06.184540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6fb02-0b9a-45b6-a8af-8e76bad391e8 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.184845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6fb02-0b9a-45b6-a8af-8e76bad391e8 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.185117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6fb02-0b9a-45b6-a8af-8e76bad391e8 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.187152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 75/150] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:56:06.187774 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5996cd7b-51bc-4651-aa1d-4e410602bd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:06.193365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877314-46cc-4607-bb8b-20cfb0ec0d9a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.193649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877314-46cc-4607-bb8b-20cfb0ec0d9a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.194041 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877314-46cc-4607-bb8b-20cfb0ec0d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.234643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9b877314-46cc-4607-bb8b-20cfb0ec0d9a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:06.236459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9b877314-46cc-4607-bb8b-20cfb0ec0d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:06.338851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 76/151] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:06.410200 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 76/152] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:06.456998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bf187-82e1-4106-aa4b-91d791a86539 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.457500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bf187-82e1-4106-aa4b-91d791a86539 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.457605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bf187-82e1-4106-aa4b-91d791a86539 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.458947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 77/153] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:06.469695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475f77a-7767-49c8-84db-537ed760e9a0 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.469984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475f77a-7767-49c8-84db-537ed760e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.470252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475f77a-7767-49c8-84db-537ed760e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.498360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f475f77a-7767-49c8-84db-537ed760e9a0 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:06.499806 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f475f77a-7767-49c8-84db-537ed760e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:06.552522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:06.583284 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 77/154] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:06.813378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6b1ce-43df-46c9-9382-06338fc9786d None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.813825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6b1ce-43df-46c9-9382-06338fc9786d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.814392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6b1ce-43df-46c9-9382-06338fc9786d None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.816323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 78/155] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:06.838666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bac82-d7b0-4d54-a2fa-59156e9f76ce None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.838985 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bac82-d7b0-4d54-a2fa-59156e9f76ce None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.839214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bac82-d7b0-4d54-a2fa-59156e9f76ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.861653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-7b4bac82-d7b0-4d54-a2fa-59156e9f76ce None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:06.862838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7b4bac82-d7b0-4d54-a2fa-59156e9f76ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:06.948268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 78/156] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:06.982747 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6b1ce-43df-46c9-9382-06338fc9786d None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:07.078737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bac82-d7b0-4d54-a2fa-59156e9f76ce None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:07.189709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6b1ce-43df-46c9-9382-06338fc9786d None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:07.277261 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:07.295306 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d955d-1d35-452c-9402-36858255fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:07.296758 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d955d-1d35-452c-9402-36858255fd89 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:07.297134 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d955d-1d35-452c-9402-36858255fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:07.297306 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d955d-1d35-452c-9402-36858255fd89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:07.328016 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bac82-d7b0-4d54-a2fa-59156e9f76ce None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:07.331128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d955d-1d35-452c-9402-36858255fd89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-259d955d-1d35-452c-9402-36858255fd89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:07.336067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:07.336976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:07.337741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:07.337741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:07.337741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:07.337741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:07.337741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:07.337741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:07.337741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:07.337741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:07.337741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:07.337741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:07.337741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:07.337741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:07.346632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 79/157] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:07.346632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d955d-1d35-452c-9402-36858255fd89 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:07.352322 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:07.450835 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb71de-830d-4c93-865c-7b56ee6a5a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:07.451474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb71de-830d-4c93-865c-7b56ee6a5a3d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:07.452377 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb71de-830d-4c93-865c-7b56ee6a5a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:07.452827 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb71de-830d-4c93-865c-7b56ee6a5a3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:07.481637 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb71de-830d-4c93-865c-7b56ee6a5a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-94bb71de-830d-4c93-865c-7b56ee6a5a3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:07.487110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:07.488237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:07.489139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:07.489139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:07.489139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:07.489139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:07.489139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:07.489139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:07.489139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:07.489139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:07.489139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:07.489139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:07.489139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:07.489139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:07.493094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 79/158] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:07.494065 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb71de-830d-4c93-865c-7b56ee6a5a3d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:07.521689 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d955d-1d35-452c-9402-36858255fd89 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:07.582127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4c796-7bb7-4466-a74f-4c46a3f56b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:07.583315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4c796-7bb7-4466-a74f-4c46a3f56b31 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:07.583952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4c796-7bb7-4466-a74f-4c46a3f56b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:07.584492 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4c796-7bb7-4466-a74f-4c46a3f56b31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:07.599037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4c796-7bb7-4466-a74f-4c46a3f56b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-eaa4c796-7bb7-4466-a74f-4c46a3f56b31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:07.605519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:07.606588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:07.607530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:07.607530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:07.607530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:07.607530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:07.607530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:07.607530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:07.607530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:07.607530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:07.607530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:07.607530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:07.607530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:07.607530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:07.610928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 80/159] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:56:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:07.612135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4c796-7bb7-4466-a74f-4c46a3f56b31 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:07.676833 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:07.716100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb71de-830d-4c93-865c-7b56ee6a5a3d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:07.740850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4c796-7bb7-4466-a74f-4c46a3f56b31 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:07.784001 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb411-2714-4f65-a18c-c3cb3d5260bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:07.785202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb411-2714-4f65-a18c-c3cb3d5260bd None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:07.785708 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb411-2714-4f65-a18c-c3cb3d5260bd None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:07.786256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb411-2714-4f65-a18c-c3cb3d5260bd None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:07.787212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bb411-2714-4f65-a18c-c3cb3d5260bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:07.787952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bb411-2714-4f65-a18c-c3cb3d5260bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:07.790401 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bb411-2714-4f65-a18c-c3cb3d5260bd None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:07.799100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55041823-5bfa-4894-ad15-6a2b7382cb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:07.799733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55041823-5bfa-4894-ad15-6a2b7382cb82 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:07.800024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55041823-5bfa-4894-ad15-6a2b7382cb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:07.800303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55041823-5bfa-4894-ad15-6a2b7382cb82 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:07.801033 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55041823-5bfa-4894-ad15-6a2b7382cb82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:07.801346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55041823-5bfa-4894-ad15-6a2b7382cb82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:07.803030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55041823-5bfa-4894-ad15-6a2b7382cb82 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:07.808918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 81/160] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:07.810909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb411-2714-4f65-a18c-c3cb3d5260bd None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:07.822982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 80/161] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:07.823943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55041823-5bfa-4894-ad15-6a2b7382cb82 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:07.894449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:07.954507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb411-2714-4f65-a18c-c3cb3d5260bd None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:07.972107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:07.999943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f0b89-c401-41a9-aa68-d529b443e459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:08.001091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f0b89-c401-41a9-aa68-d529b443e459 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:08.001663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f0b89-c401-41a9-aa68-d529b443e459 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:08.002165 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f0b89-c401-41a9-aa68-d529b443e459 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:08.015815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f0b89-c401-41a9-aa68-d529b443e459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:08.022564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55041823-5bfa-4894-ad15-6a2b7382cb82 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-9e6f0b89-c401-41a9-aa68-d529b443e459 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:08.023333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:08.024293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:08.025457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:08.025457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:08.025457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:08.025457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:08.025457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:08.025457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:08.025457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:08.025457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:08.025457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:08.025457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:08.025457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:08.025457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:08.028392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 82/162] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:08.033923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f0b89-c401-41a9-aa68-d529b443e459 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:08.129490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bf16b-3daa-44a3-a500-3d95d9adb58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:08.130130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bf16b-3daa-44a3-a500-3d95d9adb58f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:08.130412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bf16b-3daa-44a3-a500-3d95d9adb58f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:08.130686 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bf16b-3daa-44a3-a500-3d95d9adb58f None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:08.131370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bf16b-3daa-44a3-a500-3d95d9adb58f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:08.131674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bf16b-3daa-44a3-a500-3d95d9adb58f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:08.133136 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bf16b-3daa-44a3-a500-3d95d9adb58f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:08.148276 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 81/163] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:56:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:08.149142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bf16b-3daa-44a3-a500-3d95d9adb58f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:08.169799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f0b89-c401-41a9-aa68-d529b443e459 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:08.211539 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dd137-b7b9-4213-b541-5329b318bdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:08.212675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dd137-b7b9-4213-b541-5329b318bdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:08.213334 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dd137-b7b9-4213-b541-5329b318bdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:08.213876 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dd137-b7b9-4213-b541-5329b318bdc5 None admin] PATH_INFO: `/v3/users/b0c8c916f4a849b19484742f9e99bd2c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:08.216403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dd137-b7b9-4213-b541-5329b318bdc5 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8c916f4a849b19484742f9e99bd2c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:08.218986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dd137-b7b9-4213-b541-5329b318bdc5 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:08.221227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 83/164] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:08 2022] GET /identity/v3/users/b0c8c916f4a849b19484742f9e99bd2c => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:08.222473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dd137-b7b9-4213-b541-5329b318bdc5 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:08.275838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:08.323428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:08.348999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bf16b-3daa-44a3-a500-3d95d9adb58f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:08.395888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dd137-b7b9-4213-b541-5329b318bdc5 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:08.426087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39859-4e61-461d-8ecc-94951bf38f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:08.427187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39859-4e61-461d-8ecc-94951bf38f6e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:08.427674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39859-4e61-461d-8ecc-94951bf38f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:08.428168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39859-4e61-461d-8ecc-94951bf38f6e None admin] PATH_INFO: `/v3/users/ce735e61d3c64f3e9c5c513c8681f881` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:08.433547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c39859-4e61-461d-8ecc-94951bf38f6e None admin] RBAC: Authorizing `identity:get_user(user_id=ce735e61d3c64f3e9c5c513c8681f881)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:08.435358 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c39859-4e61-461d-8ecc-94951bf38f6e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:08.438278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 82/165] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:08 2022] GET /identity/v3/users/ce735e61d3c64f3e9c5c513c8681f881 => generated 247 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:08.439408 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071723b-3ca9-4bad-bf14-87fefd4e8654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:08.439536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39859-4e61-461d-8ecc-94951bf38f6e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:08.441760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071723b-3ca9-4bad-bf14-87fefd4e8654 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:08.441760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071723b-3ca9-4bad-bf14-87fefd4e8654 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:08.445044 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071723b-3ca9-4bad-bf14-87fefd4e8654 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:08.447045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071723b-3ca9-4bad-bf14-87fefd4e8654 None admin] RBAC: Adding query filter params (name=member) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:08.447456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071723b-3ca9-4bad-bf14-87fefd4e8654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:08.450064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071723b-3ca9-4bad-bf14-87fefd4e8654 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:08.464345 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 84/166] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:08.465200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071723b-3ca9-4bad-bf14-87fefd4e8654 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:08.621849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071723b-3ca9-4bad-bf14-87fefd4e8654 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:08.624919 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:08.673988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39859-4e61-461d-8ecc-94951bf38f6e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:08.677161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c75987-ad8d-49c4-96e7-233cc166db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:08.678149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c75987-ad8d-49c4-96e7-233cc166db7a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:08.678638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c75987-ad8d-49c4-96e7-233cc166db7a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:08.678976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c75987-ad8d-49c4-96e7-233cc166db7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:08.753522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cd122-dea5-4447-9c7f-9bce9d771924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:08.754250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cd122-dea5-4447-9c7f-9bce9d771924 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:08.754528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cd122-dea5-4447-9c7f-9bce9d771924 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:08.754799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cd122-dea5-4447-9c7f-9bce9d771924 None admin] PATH_INFO: `/v3/users/b0c8c916f4a849b19484742f9e99bd2c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:08.756020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cd122-dea5-4447-9c7f-9bce9d771924 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8c916f4a849b19484742f9e99bd2c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:08.757606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cd122-dea5-4447-9c7f-9bce9d771924 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:08.761671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 83/167] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:08 2022] GET /identity/v3/users/b0c8c916f4a849b19484742f9e99bd2c => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:08.762563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cd122-dea5-4447-9c7f-9bce9d771924 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:08.835084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c75987-ad8d-49c4-96e7-233cc166db7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:08.836578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c75987-ad8d-49c4-96e7-233cc166db7a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:08.845779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:09.053063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cd122-dea5-4447-9c7f-9bce9d771924 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.096215 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 85/168] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:09.097146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c75987-ad8d-49c4-96e7-233cc166db7a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:09.100010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:09.117357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa16f4f-64b9-4d56-94bd-03d2bed52042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:09.118329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa16f4f-64b9-4d56-94bd-03d2bed52042 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.118548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa16f4f-64b9-4d56-94bd-03d2bed52042 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.118921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa16f4f-64b9-4d56-94bd-03d2bed52042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.228265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa16f4f-64b9-4d56-94bd-03d2bed52042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:09.231261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa16f4f-64b9-4d56-94bd-03d2bed52042 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:09.266156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c75987-ad8d-49c4-96e7-233cc166db7a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.267198 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:09.320536 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98336c-4429-4f7a-a546-d18194a0b163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:09.321432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98336c-4429-4f7a-a546-d18194a0b163 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.321870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98336c-4429-4f7a-a546-d18194a0b163 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.322287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98336c-4429-4f7a-a546-d18194a0b163 None admin] PATH_INFO: `/v3/users/b0c8c916f4a849b19484742f9e99bd2c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.324360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98336c-4429-4f7a-a546-d18194a0b163 None admin] RBAC: Authorizing `identity:get_user(user_id=b0c8c916f4a849b19484742f9e99bd2c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:09.326859 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98336c-4429-4f7a-a546-d18194a0b163 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:09.329978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 86/169] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:09 2022] GET /identity/v3/users/b0c8c916f4a849b19484742f9e99bd2c => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:09.331737 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98336c-4429-4f7a-a546-d18194a0b163 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:09.398388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 84/170] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:09.400014 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa16f4f-64b9-4d56-94bd-03d2bed52042 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:09.466025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:09.522385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98336c-4429-4f7a-a546-d18194a0b163 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.567909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9a8b7-c4f6-483b-9ac3-3e15681dc678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:09.568531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9a8b7-c4f6-483b-9ac3-3e15681dc678 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.568853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9a8b7-c4f6-483b-9ac3-3e15681dc678 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.569127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9a8b7-c4f6-483b-9ac3-3e15681dc678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.587467 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa16f4f-64b9-4d56-94bd-03d2bed52042 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.632503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:09.644422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53104a-2398-434a-816a-6778b8ca2069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:09.645095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53104a-2398-434a-816a-6778b8ca2069 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.645385 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53104a-2398-434a-816a-6778b8ca2069 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.645705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53104a-2398-434a-816a-6778b8ca2069 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.661422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53104a-2398-434a-816a-6778b8ca2069 None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:09.661422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53104a-2398-434a-816a-6778b8ca2069 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:09.661422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 85/171] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:09 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:09.661422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848d841-2e67-4116-a983-2c155a25035c None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.661422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848d841-2e67-4116-a983-2c155a25035c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.661422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848d841-2e67-4116-a983-2c155a25035c None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.662067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 86/172] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:09.662067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8cb89-3093-4723-9702-73b67bcf9b2a None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.662067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8cb89-3093-4723-9702-73b67bcf9b2a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.662067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8cb89-3093-4723-9702-73b67bcf9b2a None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.662067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 87/173] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:09.662067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8cb89-3093-4723-9702-73b67bcf9b2a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:09.671464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9a8b7-c4f6-483b-9ac3-3e15681dc678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:09.674357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9a8b7-c4f6-483b-9ac3-3e15681dc678 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:09.760551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:09.813656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 87/174] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:09.813656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9a8b7-c4f6-483b-9ac3-3e15681dc678 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:09.821105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8cb89-3093-4723-9702-73b67bcf9b2a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.871993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f0e06-3479-4831-a983-f12b5eaa2a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:09.872531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f0e06-3479-4831-a983-f12b5eaa2a1f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.872853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f0e06-3479-4831-a983-f12b5eaa2a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.873124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f0e06-3479-4831-a983-f12b5eaa2a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.949414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:09.958894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f0e06-3479-4831-a983-f12b5eaa2a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:09.960330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9a8b7-c4f6-483b-9ac3-3e15681dc678 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.960832 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f0e06-3479-4831-a983-f12b5eaa2a1f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:09.998287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c4425-ad9b-4d04-b946-b9f4930e2f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:09.999391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c4425-ad9b-4d04-b946-b9f4930e2f50 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.999883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c4425-ad9b-4d04-b946-b9f4930e2f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.000337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c4425-ad9b-4d04-b946-b9f4930e2f50 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.001396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c4425-ad9b-4d04-b946-b9f4930e2f50 None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:10.003114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c4425-ad9b-4d04-b946-b9f4930e2f50 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:10.004989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 88/175] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:09 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:10.005927 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4826f9b-2494-4c3c-ae6a-c5ced4bb8d48 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.005927 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4826f9b-2494-4c3c-ae6a-c5ced4bb8d48 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.006657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4826f9b-2494-4c3c-ae6a-c5ced4bb8d48 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.012989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 89/176] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:10.012989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313f76e-587b-48b3-804e-c6e88164b642 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.012989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313f76e-587b-48b3-804e-c6e88164b642 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.012989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313f76e-587b-48b3-804e-c6e88164b642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.032031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-c313f76e-587b-48b3-804e-c6e88164b642 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:10.033300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c313f76e-587b-48b3-804e-c6e88164b642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:10.070843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:10.116417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 88/177] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:10.116417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb86f8-6e5d-46eb-b7cb-3c1c2f91dc2e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.116417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb86f8-6e5d-46eb-b7cb-3c1c2f91dc2e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.116417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb86f8-6e5d-46eb-b7cb-3c1c2f91dc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.125566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 90/178] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:10.131582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-24cb86f8-6e5d-46eb-b7cb-3c1c2f91dc2e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:10.132866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-24cb86f8-6e5d-46eb-b7cb-3c1c2f91dc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:10.134409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313f76e-587b-48b3-804e-c6e88164b642 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:10.212839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 89/179] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:10.213695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb86f8-6e5d-46eb-b7cb-3c1c2f91dc2e None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:10.253525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:10.274613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313f76e-587b-48b3-804e-c6e88164b642 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:10.318786 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9338960-cf2a-4efe-abe3-78709fc96a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:10.319431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9338960-cf2a-4efe-abe3-78709fc96a5f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.319665 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9338960-cf2a-4efe-abe3-78709fc96a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.319933 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9338960-cf2a-4efe-abe3-78709fc96a5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.320661 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9338960-cf2a-4efe-abe3-78709fc96a5f None admin] RBAC: Adding query filter params (role.id=068a24594f0b4d01aab3485c009314d4, scope.project.id=093594e09a464d69aa54068e56284d4c, user.id=b0c8c916f4a849b19484742f9e99bd2c) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:10.321009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9338960-cf2a-4efe-abe3-78709fc96a5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:10.322454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9338960-cf2a-4efe-abe3-78709fc96a5f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:10.329281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 91/180] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:10 2022] GET /identity/v3/role_assignments?user.id=b0c8c916f4a849b19484742f9e99bd2c&scope.project.id=093594e09a464d69aa54068e56284d4c&role.id=068a24594f0b4d01aab3485c009314d4 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:10.330180 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9338960-cf2a-4efe-abe3-78709fc96a5f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:10.376748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb86f8-6e5d-46eb-b7cb-3c1c2f91dc2e None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:10.410432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:10.452998 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972c5f7-924e-4c0a-81af-f6d9434a33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:10.453670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972c5f7-924e-4c0a-81af-f6d9434a33a4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.453943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972c5f7-924e-4c0a-81af-f6d9434a33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.454195 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972c5f7-924e-4c0a-81af-f6d9434a33a4 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.455575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972c5f7-924e-4c0a-81af-f6d9434a33a4 None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:10.457248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972c5f7-924e-4c0a-81af-f6d9434a33a4 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:10.459012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 90/181] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:10 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:10.460397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03dc91-fe43-47ea-98fe-a6e0e1ec6c09 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.460701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03dc91-fe43-47ea-98fe-a6e0e1ec6c09 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.460984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03dc91-fe43-47ea-98fe-a6e0e1ec6c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.481066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-aa03dc91-fe43-47ea-98fe-a6e0e1ec6c09 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:10.482427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-aa03dc91-fe43-47ea-98fe-a6e0e1ec6c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:10.515210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9338960-cf2a-4efe-abe3-78709fc96a5f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:10.556821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044b3aa-aae4-4f13-8ae4-c99fbe4509c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:10.557808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044b3aa-aae4-4f13-8ae4-c99fbe4509c6 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.558294 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044b3aa-aae4-4f13-8ae4-c99fbe4509c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.558794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044b3aa-aae4-4f13-8ae4-c99fbe4509c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.559743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044b3aa-aae4-4f13-8ae4-c99fbe4509c6 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=093594e09a464d69aa54068e56284d4c, user.id=ce735e61d3c64f3e9c5c513c8681f881) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:10.560062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044b3aa-aae4-4f13-8ae4-c99fbe4509c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:10.563062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044b3aa-aae4-4f13-8ae4-c99fbe4509c6 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:10.569291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 92/182] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:10 2022] GET /identity/v3/role_assignments?user.id=ce735e61d3c64f3e9c5c513c8681f881&scope.project.id=093594e09a464d69aa54068e56284d4c&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:10.571436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044b3aa-aae4-4f13-8ae4-c99fbe4509c6 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:10.593829 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 91/183] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:10.595914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4e1a1-ef5b-42b2-aceb-740736be36d4 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.596353 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4e1a1-ef5b-42b2-aceb-740736be36d4 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.596792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4e1a1-ef5b-42b2-aceb-740736be36d4 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.599249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 92/184] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:10.600241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4e1a1-ef5b-42b2-aceb-740736be36d4 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:10.652450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:10.722999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:10.729971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044b3aa-aae4-4f13-8ae4-c99fbe4509c6 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:10.774054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4e1a1-ef5b-42b2-aceb-740736be36d4 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:10.801339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89406dd0-157a-445a-bf0d-6b26a8b5b0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:10.802103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89406dd0-157a-445a-bf0d-6b26a8b5b0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.802398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89406dd0-157a-445a-bf0d-6b26a8b5b0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.802681 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89406dd0-157a-445a-bf0d-6b26a8b5b0e9 None admin] PATH_INFO: `/v3/projects/2551fc7ddfc941d6805c8ed9874fca42` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.803902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89406dd0-157a-445a-bf0d-6b26a8b5b0e9 None admin] RBAC: Authorizing `identity:get_project(project_id=2551fc7ddfc941d6805c8ed9874fca42)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:10.805451 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89406dd0-157a-445a-bf0d-6b26a8b5b0e9 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:10.807496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 93/185] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:10 2022] GET /identity/v3/projects/2551fc7ddfc941d6805c8ed9874fca42 => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:10.808413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89406dd0-157a-445a-bf0d-6b26a8b5b0e9 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:10.825223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6979dd-7e9b-47d6-a88a-84680579a82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:10.826102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6979dd-7e9b-47d6-a88a-84680579a82f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.826453 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6979dd-7e9b-47d6-a88a-84680579a82f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.827387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6979dd-7e9b-47d6-a88a-84680579a82f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.840865 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6979dd-7e9b-47d6-a88a-84680579a82f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-fe6979dd-7e9b-47d6-a88a-84680579a82f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:10.847594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:10.848493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:10.849329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 93/186] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:10.850861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6979dd-7e9b-47d6-a88a-84680579a82f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:10.966164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89406dd0-157a-445a-bf0d-6b26a8b5b0e9 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:10.966629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:10.996285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6979dd-7e9b-47d6-a88a-84680579a82f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.007558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859932d-266f-46e2-bec3-b71d0bbd02f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.008176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859932d-266f-46e2-bec3-b71d0bbd02f8 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.008457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859932d-266f-46e2-bec3-b71d0bbd02f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.008764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859932d-266f-46e2-bec3-b71d0bbd02f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.009491 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859932d-266f-46e2-bec3-b71d0bbd02f8 None admin] RBAC: Adding query filter params (role.id=62c69ea249044f258a2a6f2138ff4ceb, scope.project.id=093594e09a464d69aa54068e56284d4c, user.id=b0c8c916f4a849b19484742f9e99bd2c) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:11.009797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859932d-266f-46e2-bec3-b71d0bbd02f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.011240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859932d-266f-46e2-bec3-b71d0bbd02f8 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.018432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 94/187] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:10 2022] GET /identity/v3/role_assignments?user.id=b0c8c916f4a849b19484742f9e99bd2c&scope.project.id=093594e09a464d69aa54068e56284d4c&role.id=62c69ea249044f258a2a6f2138ff4ceb => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:11.019683 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a2312-b384-4f75-90e3-8300ebe3ff25 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.019970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a2312-b384-4f75-90e3-8300ebe3ff25 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.020248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a2312-b384-4f75-90e3-8300ebe3ff25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.039936 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f90373-1c80-464d-bd7f-6d2699a864e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.040605 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90373-1c80-464d-bd7f-6d2699a864e6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.040926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90373-1c80-464d-bd7f-6d2699a864e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.041203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90373-1c80-464d-bd7f-6d2699a864e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.042491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f90373-1c80-464d-bd7f-6d2699a864e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.043989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f90373-1c80-464d-bd7f-6d2699a864e6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.046301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 94/188] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:56:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:11.046930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f90373-1c80-464d-bd7f-6d2699a864e6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.052225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-496a2312-b384-4f75-90e3-8300ebe3ff25 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:11.053571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-496a2312-b384-4f75-90e3-8300ebe3ff25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:11.088761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:11.145354 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 95/189] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:11.157805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a2312-b384-4f75-90e3-8300ebe3ff25 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.185372 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f90373-1c80-464d-bd7f-6d2699a864e6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.239808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b672e-d98e-4133-b1da-e80a305f83df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.241270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b672e-d98e-4133-b1da-e80a305f83df None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.241270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b672e-d98e-4133-b1da-e80a305f83df None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.241270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b672e-d98e-4133-b1da-e80a305f83df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.241913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b672e-d98e-4133-b1da-e80a305f83df None admin] RBAC: Adding query filter params (role.id=068a24594f0b4d01aab3485c009314d4, scope.project.id=2551fc7ddfc941d6805c8ed9874fca42, user.id=b0c8c916f4a849b19484742f9e99bd2c) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:11.242207 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b672e-d98e-4133-b1da-e80a305f83df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.243756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b672e-d98e-4133-b1da-e80a305f83df None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.255548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 95/190] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:11 2022] GET /identity/v3/role_assignments?user.id=b0c8c916f4a849b19484742f9e99bd2c&scope.project.id=2551fc7ddfc941d6805c8ed9874fca42&role.id=068a24594f0b4d01aab3485c009314d4 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:11.256516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b672e-d98e-4133-b1da-e80a305f83df None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.287315 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:11.349566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a2312-b384-4f75-90e3-8300ebe3ff25 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.406847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2741a6-6d56-498a-b2a5-167bffde1c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.407235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2741a6-6d56-498a-b2a5-167bffde1c98 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.407513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2741a6-6d56-498a-b2a5-167bffde1c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.407784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2741a6-6d56-498a-b2a5-167bffde1c98 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.408474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2741a6-6d56-498a-b2a5-167bffde1c98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:11.408856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2741a6-6d56-498a-b2a5-167bffde1c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.410628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2741a6-6d56-498a-b2a5-167bffde1c98 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.422509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 96/191] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:11.428135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2741a6-6d56-498a-b2a5-167bffde1c98 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.445670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b672e-d98e-4133-b1da-e80a305f83df None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.472403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:11.502928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec527ff0-7eaf-4362-b593-10aeecbe54be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.503853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec527ff0-7eaf-4362-b593-10aeecbe54be None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.504143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec527ff0-7eaf-4362-b593-10aeecbe54be None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.504427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec527ff0-7eaf-4362-b593-10aeecbe54be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.516350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec527ff0-7eaf-4362-b593-10aeecbe54be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-ec527ff0-7eaf-4362-b593-10aeecbe54be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:11.522114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:11.523158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:11.523956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 96/192] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:56:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:11.524606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec527ff0-7eaf-4362-b593-10aeecbe54be None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.577768 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2741a6-6d56-498a-b2a5-167bffde1c98 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.623612 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:11.626151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6347ce0-d937-42ad-bced-01e1e1da88b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.626933 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6347ce0-d937-42ad-bced-01e1e1da88b8 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.627214 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6347ce0-d937-42ad-bced-01e1e1da88b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.627484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6347ce0-d937-42ad-bced-01e1e1da88b8 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.628889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6347ce0-d937-42ad-bced-01e1e1da88b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.629620 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6347ce0-d937-42ad-bced-01e1e1da88b8 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.658880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec527ff0-7eaf-4362-b593-10aeecbe54be None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.663766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 97/193] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:56:11 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:11.669807 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6347ce0-d937-42ad-bced-01e1e1da88b8 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.712260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e407564-b0fb-4a54-969e-f4fa630ef5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.712947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e407564-b0fb-4a54-969e-f4fa630ef5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.713234 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e407564-b0fb-4a54-969e-f4fa630ef5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.713510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e407564-b0fb-4a54-969e-f4fa630ef5b9 None admin] PATH_INFO: `/v3/users/5ec51f93d5a442c0a65c719f2ae2ac18` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.731998 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e407564-b0fb-4a54-969e-f4fa630ef5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec51f93d5a442c0a65c719f2ae2ac18)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.733759 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e407564-b0fb-4a54-969e-f4fa630ef5b9 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.735582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 97/194] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:11 2022] GET /identity/v3/users/5ec51f93d5a442c0a65c719f2ae2ac18 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:11.736404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e407564-b0fb-4a54-969e-f4fa630ef5b9 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.796544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:11.830508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6347ce0-d937-42ad-bced-01e1e1da88b8 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.874237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fedfce-dd86-4edb-93c3-ec9286d1e8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.875069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fedfce-dd86-4edb-93c3-ec9286d1e8fe None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.875367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fedfce-dd86-4edb-93c3-ec9286d1e8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.875641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fedfce-dd86-4edb-93c3-ec9286d1e8fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.885262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e407564-b0fb-4a54-969e-f4fa630ef5b9 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.888754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fedfce-dd86-4edb-93c3-ec9286d1e8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-41fedfce-dd86-4edb-93c3-ec9286d1e8fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:11.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:11.897634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:11.898463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:11.898463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:11.898463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:11.898463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:11.898463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:11.898463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:11.898463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:11.898463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:11.898463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:11.898463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:11.898463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:11.898463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:11.900733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 98/195] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:11.901928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fedfce-dd86-4edb-93c3-ec9286d1e8fe None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.934150 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:11.940239 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5344a-c0c0-463d-9784-84ca45b732dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.940974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5344a-c0c0-463d-9784-84ca45b732dc None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.941251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5344a-c0c0-463d-9784-84ca45b732dc None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.941518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5344a-c0c0-463d-9784-84ca45b732dc None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.942189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5344a-c0c0-463d-9784-84ca45b732dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:11.942479 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5344a-c0c0-463d-9784-84ca45b732dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.943861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5344a-c0c0-463d-9784-84ca45b732dc None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.957812 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 98/196] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:56:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:11.958311 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5344a-c0c0-463d-9784-84ca45b732dc None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:12.073230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fedfce-dd86-4edb-93c3-ec9286d1e8fe None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:12.110652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5344a-c0c0-463d-9784-84ca45b732dc None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:12.131194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332aeda-93da-496e-ac93-665f4e8a0f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.131972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332aeda-93da-496e-ac93-665f4e8a0f48 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.132418 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332aeda-93da-496e-ac93-665f4e8a0f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.132941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332aeda-93da-496e-ac93-665f4e8a0f48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.141075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:12.156278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4d582-f9e8-4596-9598-fedd10d2e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.157125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4d582-f9e8-4596-9598-fedd10d2e810 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.157400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4d582-f9e8-4596-9598-fedd10d2e810 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.157670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4d582-f9e8-4596-9598-fedd10d2e810 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.158331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4d582-f9e8-4596-9598-fedd10d2e810 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:12.158632 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4d582-f9e8-4596-9598-fedd10d2e810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.160078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4d582-f9e8-4596-9598-fedd10d2e810 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.169403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 99/197] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:12.170458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4d582-f9e8-4596-9598-fedd10d2e810 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:12.245440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332aeda-93da-496e-ac93-665f4e8a0f48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.246936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332aeda-93da-496e-ac93-665f4e8a0f48 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.249384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:12.306365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4d582-f9e8-4596-9598-fedd10d2e810 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:12.348825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebd5b7-f409-4338-a002-fa9e98b7ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.350045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebd5b7-f409-4338-a002-fa9e98b7ee18 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.350769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebd5b7-f409-4338-a002-fa9e98b7ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.351658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebd5b7-f409-4338-a002-fa9e98b7ee18 None admin] PATH_INFO: `/v3/users/5ec51f93d5a442c0a65c719f2ae2ac18` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.353335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebd5b7-f409-4338-a002-fa9e98b7ee18 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec51f93d5a442c0a65c719f2ae2ac18)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.355962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebd5b7-f409-4338-a002-fa9e98b7ee18 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.357902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 100/198] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:12 2022] GET /identity/v3/users/5ec51f93d5a442c0a65c719f2ae2ac18 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:12.358993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 99/199] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:12.363164 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebd5b7-f409-4338-a002-fa9e98b7ee18 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:12.365031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332aeda-93da-496e-ac93-665f4e8a0f48 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:12.421420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:12.488086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebd5b7-f409-4338-a002-fa9e98b7ee18 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:12.501116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332aeda-93da-496e-ac93-665f4e8a0f48 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:12.515964 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:12.529015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399ec2e-875e-49e7-839b-601851fb1aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.529663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399ec2e-875e-49e7-839b-601851fb1aca None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.530565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399ec2e-875e-49e7-839b-601851fb1aca None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.530756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399ec2e-875e-49e7-839b-601851fb1aca None admin] PATH_INFO: `/v3/users/7603f99a8e8b4c4188c637c95ee98884` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.532117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399ec2e-875e-49e7-839b-601851fb1aca None admin] RBAC: Authorizing `identity:get_user(user_id=7603f99a8e8b4c4188c637c95ee98884)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.533870 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399ec2e-875e-49e7-839b-601851fb1aca None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.535676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 101/200] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:12 2022] GET /identity/v3/users/7603f99a8e8b4c4188c637c95ee98884 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:12.536340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399ec2e-875e-49e7-839b-601851fb1aca None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:12.542777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76657f62-c3cb-4cda-b875-081f9d2a3042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.543763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76657f62-c3cb-4cda-b875-081f9d2a3042 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.544266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76657f62-c3cb-4cda-b875-081f9d2a3042 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.544771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76657f62-c3cb-4cda-b875-081f9d2a3042 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.546890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76657f62-c3cb-4cda-b875-081f9d2a3042 None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.548944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76657f62-c3cb-4cda-b875-081f9d2a3042 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.551177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 100/201] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:12 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:12.552169 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76657f62-c3cb-4cda-b875-081f9d2a3042 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:12.670228 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399ec2e-875e-49e7-839b-601851fb1aca None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:12.684232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76657f62-c3cb-4cda-b875-081f9d2a3042 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:12.686743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:12.716998 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3faf5-e62d-45ce-906b-aaec032b818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.717803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3faf5-e62d-45ce-906b-aaec032b818d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.718279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3faf5-e62d-45ce-906b-aaec032b818d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.718604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3faf5-e62d-45ce-906b-aaec032b818d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.727006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90458d2-cad8-4b4e-9e06-3e904846f79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.727767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90458d2-cad8-4b4e-9e06-3e904846f79f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.728150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90458d2-cad8-4b4e-9e06-3e904846f79f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.728530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90458d2-cad8-4b4e-9e06-3e904846f79f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.790625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:12.802476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90458d2-cad8-4b4e-9e06-3e904846f79f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.802974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3faf5-e62d-45ce-906b-aaec032b818d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.804280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90458d2-cad8-4b4e-9e06-3e904846f79f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.804396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3faf5-e62d-45ce-906b-aaec032b818d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.929711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 102/202] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:12.930589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3faf5-e62d-45ce-906b-aaec032b818d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:12.943785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 101/203] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:12.950162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90458d2-cad8-4b4e-9e06-3e904846f79f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:12.955484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:13.037799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:13.048866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3faf5-e62d-45ce-906b-aaec032b818d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:13.089180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d7437-002d-4d84-9c17-1de12548c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:13.089808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d7437-002d-4d84-9c17-1de12548c862 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:13.090099 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d7437-002d-4d84-9c17-1de12548c862 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:13.090405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d7437-002d-4d84-9c17-1de12548c862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:13.091202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d7437-002d-4d84-9c17-1de12548c862 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c, user.id=5ec51f93d5a442c0a65c719f2ae2ac18) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:13.091519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d7437-002d-4d84-9c17-1de12548c862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:13.093043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d7437-002d-4d84-9c17-1de12548c862 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:13.108713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 103/204] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:12 2022] GET /identity/v3/role_assignments?user.id=5ec51f93d5a442c0a65c719f2ae2ac18&scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:13.108713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d7437-002d-4d84-9c17-1de12548c862 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:13.109007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90458d2-cad8-4b4e-9e06-3e904846f79f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:13.200040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa01e6-9877-436d-a3af-18b2ac8607e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:13.200620 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa01e6-9877-436d-a3af-18b2ac8607e7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:13.200954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa01e6-9877-436d-a3af-18b2ac8607e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:13.201231 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa01e6-9877-436d-a3af-18b2ac8607e7 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:13.203039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa01e6-9877-436d-a3af-18b2ac8607e7 None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:13.204528 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa01e6-9877-436d-a3af-18b2ac8607e7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:13.213065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 102/205] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:12 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:13.220535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa01e6-9877-436d-a3af-18b2ac8607e7 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:13.414429 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d7437-002d-4d84-9c17-1de12548c862 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:13.509697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:13.520798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c765a3-42be-43aa-88de-6d733e0161e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:13.520798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c765a3-42be-43aa-88de-6d733e0161e1 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:13.520798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c765a3-42be-43aa-88de-6d733e0161e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:13.520798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c765a3-42be-43aa-88de-6d733e0161e1 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:13.529578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c765a3-42be-43aa-88de-6d733e0161e1 None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:13.532599 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c765a3-42be-43aa-88de-6d733e0161e1 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:13.534026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 104/206] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:13 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:13.546122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c765a3-42be-43aa-88de-6d733e0161e1 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:13.637247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:13.650544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa01e6-9877-436d-a3af-18b2ac8607e7 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:13.762902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c765a3-42be-43aa-88de-6d733e0161e1 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:13.800626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b2add-9369-4e80-8800-3a07372d44e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:13.801350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b2add-9369-4e80-8800-3a07372d44e8 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:13.801632 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b2add-9369-4e80-8800-3a07372d44e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:13.803499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b2add-9369-4e80-8800-3a07372d44e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:13.803499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b2add-9369-4e80-8800-3a07372d44e8 None admin] RBAC: Adding query filter params (role.id=1084d899c92849ce9ba431f0fecfe796, scope.project.id=093594e09a464d69aa54068e56284d4c, user.id=7603f99a8e8b4c4188c637c95ee98884) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:13.803499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b2add-9369-4e80-8800-3a07372d44e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:13.804396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b2add-9369-4e80-8800-3a07372d44e8 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:13.812208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 105/207] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:13 2022] GET /identity/v3/role_assignments?user.id=7603f99a8e8b4c4188c637c95ee98884&scope.project.id=093594e09a464d69aa54068e56284d4c&role.id=1084d899c92849ce9ba431f0fecfe796 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:13.847830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a585e2b-26ad-435a-b4f3-cf0cdd54c6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:13.848489 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a585e2b-26ad-435a-b4f3-cf0cdd54c6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:13.848761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a585e2b-26ad-435a-b4f3-cf0cdd54c6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:13.849038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a585e2b-26ad-435a-b4f3-cf0cdd54c6f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:13.849783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a585e2b-26ad-435a-b4f3-cf0cdd54c6f0 None admin] RBAC: Adding query filter params (role.id=62c69ea249044f258a2a6f2138ff4ceb, scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c, user.id=5ec51f93d5a442c0a65c719f2ae2ac18) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:13.850091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a585e2b-26ad-435a-b4f3-cf0cdd54c6f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:13.851544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a585e2b-26ad-435a-b4f3-cf0cdd54c6f0 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:13.879389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 103/208] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:13 2022] GET /identity/v3/role_assignments?user.id=5ec51f93d5a442c0a65c719f2ae2ac18&scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c&role.id=62c69ea249044f258a2a6f2138ff4ceb => generated 259 bytes in 659 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:14.330780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af805c2b-9539-4ceb-ab71-4dbe485e4e5c None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.331138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af805c2b-9539-4ceb-ab71-4dbe485e4e5c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.331557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af805c2b-9539-4ceb-ab71-4dbe485e4e5c None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.333703 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 106/209] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:14.341242 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d91f3d-8a0b-4a89-9066-2c48dbd137f4 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.341556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d91f3d-8a0b-4a89-9066-2c48dbd137f4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.341825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d91f3d-8a0b-4a89-9066-2c48dbd137f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.367103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-46d91f3d-8a0b-4a89-9066-2c48dbd137f4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:14.368320 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-46d91f3d-8a0b-4a89-9066-2c48dbd137f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:14.511537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 104/210] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:14.628078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9f01c-7802-4e55-88a3-e2221213c9a1 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.628583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9f01c-7802-4e55-88a3-e2221213c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.628583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9f01c-7802-4e55-88a3-e2221213c9a1 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.629961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 107/211] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:14.635761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a71fc-b713-4b7f-aee4-a2e974813aa6 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.636049 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a71fc-b713-4b7f-aee4-a2e974813aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.636320 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a71fc-b713-4b7f-aee4-a2e974813aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.656819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-045a71fc-b713-4b7f-aee4-a2e974813aa6 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:14.658037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-045a71fc-b713-4b7f-aee4-a2e974813aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:14.723617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:14.731554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 105/212] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:14.849022 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9f01c-7802-4e55-88a3-e2221213c9a1 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:14.946743 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:14.960707 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9f01c-7802-4e55-88a3-e2221213c9a1 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.998160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475f079-51ed-42d5-af9d-3938b703e0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.999547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475f079-51ed-42d5-af9d-3938b703e0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.000135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475f079-51ed-42d5-af9d-3938b703e0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.000440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475f079-51ed-42d5-af9d-3938b703e0a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.013374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475f079-51ed-42d5-af9d-3938b703e0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-1475f079-51ed-42d5-af9d-3938b703e0a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:15.018659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:15.019568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:15.020433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 108/213] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:15.025985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a71fc-b713-4b7f-aee4-a2e974813aa6 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:15.056892 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475f079-51ed-42d5-af9d-3938b703e0a5 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:15.142532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a71fc-b713-4b7f-aee4-a2e974813aa6 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:15.165210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475f079-51ed-42d5-af9d-3938b703e0a5 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:15.180482 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f58b00-13f7-4672-bbf6-97fb0d3ae730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:15.181236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f58b00-13f7-4672-bbf6-97fb0d3ae730 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.181684 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f58b00-13f7-4672-bbf6-97fb0d3ae730 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.182100 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f58b00-13f7-4672-bbf6-97fb0d3ae730 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.182945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f58b00-13f7-4672-bbf6-97fb0d3ae730 None admin] RBAC: Adding query filter params (name=member) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:15.183405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f58b00-13f7-4672-bbf6-97fb0d3ae730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:15.185171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f58b00-13f7-4672-bbf6-97fb0d3ae730 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:15.195086 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 106/214] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:15.202082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f58b00-13f7-4672-bbf6-97fb0d3ae730 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:15.208998 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfad132-0f6f-42d6-aa8f-cf9311016013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:15.209647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfad132-0f6f-42d6-aa8f-cf9311016013 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.209927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfad132-0f6f-42d6-aa8f-cf9311016013 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.210197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfad132-0f6f-42d6-aa8f-cf9311016013 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.211347 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfad132-0f6f-42d6-aa8f-cf9311016013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:15.212861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfad132-0f6f-42d6-aa8f-cf9311016013 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:15.214602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 109/215] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:56:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:15.221763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfad132-0f6f-42d6-aa8f-cf9311016013 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:15.243719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:15.278103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:15.344434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f58b00-13f7-4672-bbf6-97fb0d3ae730 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:15.349766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfad132-0f6f-42d6-aa8f-cf9311016013 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:15.382148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b032db-a010-4e05-9d65-baa48d32359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:15.383090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b032db-a010-4e05-9d65-baa48d32359f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.383578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b032db-a010-4e05-9d65-baa48d32359f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.384028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b032db-a010-4e05-9d65-baa48d32359f None admin] PATH_INFO: `/v3/users/de0a30861e4041c0839055a0caf0d81c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.392875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58487207-c280-440c-95a2-794515f84359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:15.393918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58487207-c280-440c-95a2-794515f84359 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.394531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58487207-c280-440c-95a2-794515f84359 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.394994 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58487207-c280-440c-95a2-794515f84359 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.395845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58487207-c280-440c-95a2-794515f84359 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:15.398973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58487207-c280-440c-95a2-794515f84359 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:15.401650 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b032db-a010-4e05-9d65-baa48d32359f None admin] RBAC: Authorizing `identity:get_user(user_id=de0a30861e4041c0839055a0caf0d81c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:15.403441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b032db-a010-4e05-9d65-baa48d32359f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:15.406535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 107/216] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:15 2022] GET /identity/v3/users/de0a30861e4041c0839055a0caf0d81c => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:15.412765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b032db-a010-4e05-9d65-baa48d32359f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:15.460498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 110/217] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:56:15 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:15.563724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b032db-a010-4e05-9d65-baa48d32359f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:15.585212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:15.607128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be9f4-2215-4881-ab6a-e1e95b6d97a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:15.607922 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be9f4-2215-4881-ab6a-e1e95b6d97a2 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.608357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be9f4-2215-4881-ab6a-e1e95b6d97a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.608956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be9f4-2215-4881-ab6a-e1e95b6d97a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.696226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48be9f4-2215-4881-ab6a-e1e95b6d97a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:15.697776 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48be9f4-2215-4881-ab6a-e1e95b6d97a2 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:15.805796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a525403-9279-41d9-af5e-5e8ff45f8c83 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.806785 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a525403-9279-41d9-af5e-5e8ff45f8c83 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.807472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a525403-9279-41d9-af5e-5e8ff45f8c83 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.813842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 111/218] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:15.820585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 108/219] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:15.820952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3b17d-3c05-49a8-894b-54875d97b8cc None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.821452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3b17d-3c05-49a8-894b-54875d97b8cc None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.821924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3b17d-3c05-49a8-894b-54875d97b8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.823932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be9f4-2215-4881-ab6a-e1e95b6d97a2 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:15.844949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-72d3b17d-3c05-49a8-894b-54875d97b8cc None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:15.846292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-72d3b17d-3c05-49a8-894b-54875d97b8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:15.848733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:15.958262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 112/220] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:15.969942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be9f4-2215-4881-ab6a-e1e95b6d97a2 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:16.019223 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd40346-b307-41ae-a661-8a481b69173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:16.020217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd40346-b307-41ae-a661-8a481b69173b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.020712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd40346-b307-41ae-a661-8a481b69173b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.021179 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd40346-b307-41ae-a661-8a481b69173b None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.022550 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd40346-b307-41ae-a661-8a481b69173b None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:16.024654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd40346-b307-41ae-a661-8a481b69173b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:16.026688 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 109/221] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:15 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:16.034958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3b17d-3c05-49a8-894b-54875d97b8cc None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:16.038864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:16.197962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3b17d-3c05-49a8-894b-54875d97b8cc None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:16.252603 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e5baa-6e32-4d09-9f33-5138403fcd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:16.253325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e5baa-6e32-4d09-9f33-5138403fcd63 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.253611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e5baa-6e32-4d09-9f33-5138403fcd63 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.253890 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e5baa-6e32-4d09-9f33-5138403fcd63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.254695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e5baa-6e32-4d09-9f33-5138403fcd63 None admin] RBAC: Adding query filter params (role.id=068a24594f0b4d01aab3485c009314d4, scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c, user.id=de0a30861e4041c0839055a0caf0d81c) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:16.255041 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e5baa-6e32-4d09-9f33-5138403fcd63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:16.256550 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e5baa-6e32-4d09-9f33-5138403fcd63 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:16.269639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 113/222] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:16 2022] GET /identity/v3/role_assignments?user.id=de0a30861e4041c0839055a0caf0d81c&scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c&role.id=068a24594f0b4d01aab3485c009314d4 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:16.316249 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd40346-b307-41ae-a661-8a481b69173b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:16.434462 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:16.459119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd40346-b307-41ae-a661-8a481b69173b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:16.501421 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d7b01-2821-4e3a-8d3c-d11a7a069c49 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.501764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d7b01-2821-4e3a-8d3c-d11a7a069c49 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.501972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d7b01-2821-4e3a-8d3c-d11a7a069c49 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.503374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 114/223] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:16.510400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93151e7f-3c3e-4e3f-8901-514cb57e7c1f None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.510698 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93151e7f-3c3e-4e3f-8901-514cb57e7c1f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.510973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93151e7f-3c3e-4e3f-8901-514cb57e7c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.519066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4886a4-8209-4380-aaa4-1fdb2883a24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:16.519730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4886a4-8209-4380-aaa4-1fdb2883a24a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.520013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4886a4-8209-4380-aaa4-1fdb2883a24a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.520288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4886a4-8209-4380-aaa4-1fdb2883a24a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.536711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4886a4-8209-4380-aaa4-1fdb2883a24a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-cd4886a4-8209-4380-aaa4-1fdb2883a24a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:16.537672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:16.539153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:16.540545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 110/224] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:56:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:16.552827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4886a4-8209-4380-aaa4-1fdb2883a24a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:16.554167 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-93151e7f-3c3e-4e3f-8901-514cb57e7c1f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:16.555931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-93151e7f-3c3e-4e3f-8901-514cb57e7c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:16.676368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:16.692557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 115/225] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:16.698055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4886a4-8209-4380-aaa4-1fdb2883a24a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:16.760278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35531f66-187f-407d-813d-7dcd463a25ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:16.761726 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35531f66-187f-407d-813d-7dcd463a25ff None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.762212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35531f66-187f-407d-813d-7dcd463a25ff None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.762699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35531f66-187f-407d-813d-7dcd463a25ff None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.763579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35531f66-187f-407d-813d-7dcd463a25ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:16.764631 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35531f66-187f-407d-813d-7dcd463a25ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:16.766427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35531f66-187f-407d-813d-7dcd463a25ff None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:16.788963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 111/226] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:16.797572 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93151e7f-3c3e-4e3f-8901-514cb57e7c1f None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:16.919511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93151e7f-3c3e-4e3f-8901-514cb57e7c1f None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:16.963329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c7c61-995c-4eaa-aa20-48bc8d393f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:16.963990 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7c61-995c-4eaa-aa20-48bc8d393f46 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.964279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7c61-995c-4eaa-aa20-48bc8d393f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.964555 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7c61-995c-4eaa-aa20-48bc8d393f46 None admin] PATH_INFO: `/v3/users/5ec51f93d5a442c0a65c719f2ae2ac18` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.965789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c7c61-995c-4eaa-aa20-48bc8d393f46 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec51f93d5a442c0a65c719f2ae2ac18)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:16.967924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c7c61-995c-4eaa-aa20-48bc8d393f46 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:16.970343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 116/227] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:16 2022] GET /identity/v3/users/5ec51f93d5a442c0a65c719f2ae2ac18 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:16.976090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35531f66-187f-407d-813d-7dcd463a25ff None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:16.987071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:17.101079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35531f66-187f-407d-813d-7dcd463a25ff None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:17.144017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781c6e-3628-47ad-876d-9f8c724bba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:17.145052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781c6e-3628-47ad-876d-9f8c724bba5b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:17.145560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781c6e-3628-47ad-876d-9f8c724bba5b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:17.146066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781c6e-3628-47ad-876d-9f8c724bba5b None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:17.153753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781c6e-3628-47ad-876d-9f8c724bba5b None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:17.156592 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d781c6e-3628-47ad-876d-9f8c724bba5b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:17.158680 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 112/228] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:16 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:17.165000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c7c61-995c-4eaa-aa20-48bc8d393f46 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:17.247466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:17.285438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781c6e-3628-47ad-876d-9f8c724bba5b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:17.313903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c7c61-995c-4eaa-aa20-48bc8d393f46 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:17.409068 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:17.442601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781c6e-3628-47ad-876d-9f8c724bba5b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:17.450160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b0417-3951-47a6-a63b-802d98e00f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:17.450892 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b0417-3951-47a6-a63b-802d98e00f9f None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:17.451149 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b0417-3951-47a6-a63b-802d98e00f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:17.451427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b0417-3951-47a6-a63b-802d98e00f9f None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c/users/5ec51f93d5a442c0a65c719f2ae2ac18/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:17.454394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b0417-3951-47a6-a63b-802d98e00f9f None admin] RBAC: Authorizing `identity:create_grant(project_id=6d12476fe55f430f8bd612ca6d4acc7c, user_id=5ec51f93d5a442c0a65c719f2ae2ac18, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:17.455892 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b0417-3951-47a6-a63b-802d98e00f9f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:17.479105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 117/229] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:56:17 2022] PUT /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c/users/5ec51f93d5a442c0a65c719f2ae2ac18/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:17.497061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2897c4-8579-49ca-a8d4-6ffb8c6f3ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:17.497942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2897c4-8579-49ca-a8d4-6ffb8c6f3ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:17.498296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2897c4-8579-49ca-a8d4-6ffb8c6f3ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:17.498653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2897c4-8579-49ca-a8d4-6ffb8c6f3ab9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:17.518845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2897c4-8579-49ca-a8d4-6ffb8c6f3ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-2d2897c4-8579-49ca-a8d4-6ffb8c6f3ab9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:17.524848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:17.525892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:17.526693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 113/230] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:56:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:17.533115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b0417-3951-47a6-a63b-802d98e00f9f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:17.691939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b0417-3951-47a6-a63b-802d98e00f9f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:17.724327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:17.748318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d24173-6898-4900-8050-91253bbd6014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:17.750408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d24173-6898-4900-8050-91253bbd6014 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:17.750691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d24173-6898-4900-8050-91253bbd6014 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:17.750967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d24173-6898-4900-8050-91253bbd6014 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:17.751660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d24173-6898-4900-8050-91253bbd6014 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:17.751966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d24173-6898-4900-8050-91253bbd6014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:17.753408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d24173-6898-4900-8050-91253bbd6014 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:17.762577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 118/231] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:56:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:17.770386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2897c4-8579-49ca-a8d4-6ffb8c6f3ab9 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:17.897224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2897c4-8579-49ca-a8d4-6ffb8c6f3ab9 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:17.965601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75932942-1a7d-4c1c-9cb7-82f3bb89181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:17.966483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75932942-1a7d-4c1c-9cb7-82f3bb89181e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:17.966902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75932942-1a7d-4c1c-9cb7-82f3bb89181e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:17.967853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75932942-1a7d-4c1c-9cb7-82f3bb89181e None admin] PATH_INFO: `/v3/users/5ec51f93d5a442c0a65c719f2ae2ac18` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:17.969571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75932942-1a7d-4c1c-9cb7-82f3bb89181e None admin] RBAC: Authorizing `identity:get_user(user_id=5ec51f93d5a442c0a65c719f2ae2ac18)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:17.971891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75932942-1a7d-4c1c-9cb7-82f3bb89181e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:17.974740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 114/232] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:17 2022] GET /identity/v3/users/5ec51f93d5a442c0a65c719f2ae2ac18 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:17.984383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d24173-6898-4900-8050-91253bbd6014 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:18.175034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d24173-6898-4900-8050-91253bbd6014 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:18.234175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b2801-f285-4505-b3e5-caec9244a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:18.234569 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2801-f285-4505-b3e5-caec9244a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:18.234822 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2801-f285-4505-b3e5-caec9244a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:18.235216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2801-f285-4505-b3e5-caec9244a5e8 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:18.241482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b2801-f285-4505-b3e5-caec9244a5e8 None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:18.242980 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b2801-f285-4505-b3e5-caec9244a5e8 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:18.245105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 119/233] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:17 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:18.252071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75932942-1a7d-4c1c-9cb7-82f3bb89181e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:18.256464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:18.401444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75932942-1a7d-4c1c-9cb7-82f3bb89181e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:18.446277 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bece3-6323-40ec-9216-e81ff2fe433c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:18.447007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bece3-6323-40ec-9216-e81ff2fe433c None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:18.447293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bece3-6323-40ec-9216-e81ff2fe433c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:18.447571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bece3-6323-40ec-9216-e81ff2fe433c None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c/users/5ec51f93d5a442c0a65c719f2ae2ac18/roles/62c69ea249044f258a2a6f2138ff4ceb` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:18.449837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bece3-6323-40ec-9216-e81ff2fe433c None admin] RBAC: Authorizing `identity:create_grant(project_id=6d12476fe55f430f8bd612ca6d4acc7c, user_id=5ec51f93d5a442c0a65c719f2ae2ac18, role_id=62c69ea249044f258a2a6f2138ff4ceb)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:18.451420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bece3-6323-40ec-9216-e81ff2fe433c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:18.480232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 115/234] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:56:18 2022] PUT /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c/users/5ec51f93d5a442c0a65c719f2ae2ac18/roles/62c69ea249044f258a2a6f2138ff4ceb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:18.674357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8c224-f4d5-4ceb-9ad9-d81755aa2fbf None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:18.674795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8c224-f4d5-4ceb-9ad9-d81755aa2fbf None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:18.674922 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8c224-f4d5-4ceb-9ad9-d81755aa2fbf None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:18.676580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 120/235] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:18.682795 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba220e-c5a5-4b8a-9cab-63a6430b8a0b None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:18.683175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba220e-c5a5-4b8a-9cab-63a6430b8a0b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:18.683460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba220e-c5a5-4b8a-9cab-63a6430b8a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:18.713886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-88ba220e-c5a5-4b8a-9cab-63a6430b8a0b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:18.715263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-88ba220e-c5a5-4b8a-9cab-63a6430b8a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:18.736717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5475c6-5a9f-45b8-9ae7-390f0ca256ed None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:18.736717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5475c6-5a9f-45b8-9ae7-390f0ca256ed None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:18.736717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5475c6-5a9f-45b8-9ae7-390f0ca256ed None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:18.737770 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 121/236] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:18.745884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59575292-fc0e-4d67-9c72-e35b1d559af2 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:18.746193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59575292-fc0e-4d67-9c72-e35b1d559af2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:18.746438 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59575292-fc0e-4d67-9c72-e35b1d559af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:18.781971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-59575292-fc0e-4d67-9c72-e35b1d559af2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:18.783233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-59575292-fc0e-4d67-9c72-e35b1d559af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:18.828833 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:18.850446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 116/237] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:18.888076 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:18.916074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 122/238] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:19.151062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba220e-c5a5-4b8a-9cab-63a6430b8a0b None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:19.338286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59575292-fc0e-4d67-9c72-e35b1d559af2 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:19.351495 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba220e-c5a5-4b8a-9cab-63a6430b8a0b None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:19.440769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e2f35-5e3e-461a-a0ac-4d3f452b4aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:19.441433 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e2f35-5e3e-461a-a0ac-4d3f452b4aca None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:19.441715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e2f35-5e3e-461a-a0ac-4d3f452b4aca None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:19.441984 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e2f35-5e3e-461a-a0ac-4d3f452b4aca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:19.470900 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e2f35-5e3e-461a-a0ac-4d3f452b4aca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-d19e2f35-5e3e-461a-a0ac-4d3f452b4aca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:19.477844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:19.478792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:19.479587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:19.479587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:19.479587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:19.479587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:19.479587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:19.479587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:19.479587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:19.479587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:19.479587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:19.479587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:19.479587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:19.479587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:19.485260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 117/239] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:19.491104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e2f35-5e3e-461a-a0ac-4d3f452b4aca None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:19.525712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59575292-fc0e-4d67-9c72-e35b1d559af2 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:19.556439 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:19.589182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac700fd-8899-41ef-bbd3-41dfea6f94b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:19.590130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac700fd-8899-41ef-bbd3-41dfea6f94b4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:19.590625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac700fd-8899-41ef-bbd3-41dfea6f94b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:19.591090 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac700fd-8899-41ef-bbd3-41dfea6f94b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:19.593202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac700fd-8899-41ef-bbd3-41dfea6f94b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:19.594857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac700fd-8899-41ef-bbd3-41dfea6f94b4 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:19.596725 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 123/240] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:56:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:19.598096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982f86d-26b2-479d-9a12-c68c11eeca23 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:19.598525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982f86d-26b2-479d-9a12-c68c11eeca23 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:19.598964 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982f86d-26b2-479d-9a12-c68c11eeca23 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:19.600349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 124/241] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:19.604214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982f86d-26b2-479d-9a12-c68c11eeca23 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:19.638589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e2f35-5e3e-461a-a0ac-4d3f452b4aca None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:19.688993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ff336-aaac-4fa4-bee6-51b7f57a5ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:19.690110 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ff336-aaac-4fa4-bee6-51b7f57a5ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:19.690559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ff336-aaac-4fa4-bee6-51b7f57a5ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:19.691213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ff336-aaac-4fa4-bee6-51b7f57a5ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:19.692445 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ff336-aaac-4fa4-bee6-51b7f57a5ff9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:19.693005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ff336-aaac-4fa4-bee6-51b7f57a5ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:19.694539 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ff336-aaac-4fa4-bee6-51b7f57a5ff9 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:19.696001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:19.708629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 118/242] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:19.714702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84c448-5e80-473f-8757-a4c05eedb227 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:19.714702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84c448-5e80-473f-8757-a4c05eedb227 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:19.714937 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84c448-5e80-473f-8757-a4c05eedb227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:19.734201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-ba84c448-5e80-473f-8757-a4c05eedb227 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:19.735675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ba84c448-5e80-473f-8757-a4c05eedb227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:19.775084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982f86d-26b2-479d-9a12-c68c11eeca23 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:19.819380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 119/243] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:19.821697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84c448-5e80-473f-8757-a4c05eedb227 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:19.835524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b6898-4fc7-400d-bd5a-e986418c3bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:19.836471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b6898-4fc7-400d-bd5a-e986418c3bb9 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:19.836978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b6898-4fc7-400d-bd5a-e986418c3bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:19.837457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b6898-4fc7-400d-bd5a-e986418c3bb9 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:19.838329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b6898-4fc7-400d-bd5a-e986418c3bb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:19.840816 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b6898-4fc7-400d-bd5a-e986418c3bb9 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:19.890590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 125/244] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:56:19 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:56:19.926249 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:20.022953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84c448-5e80-473f-8757-a4c05eedb227 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:20.094983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553325c4-7ff7-4879-aa1e-28838ad6d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:20.095539 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553325c4-7ff7-4879-aa1e-28838ad6d59b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.095815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553325c4-7ff7-4879-aa1e-28838ad6d59b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.096088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553325c4-7ff7-4879-aa1e-28838ad6d59b None admin] PATH_INFO: `/v3/users/4f547725bb4745ccb7a0b0de78f15eba` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.121558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553325c4-7ff7-4879-aa1e-28838ad6d59b None admin] RBAC: Authorizing `identity:get_user(user_id=4f547725bb4745ccb7a0b0de78f15eba)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:20.123057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553325c4-7ff7-4879-aa1e-28838ad6d59b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:20.125435 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 120/245] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:19 2022] GET /identity/v3/users/4f547725bb4745ccb7a0b0de78f15eba => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:20.131735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b6898-4fc7-400d-bd5a-e986418c3bb9 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:20.276970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b6898-4fc7-400d-bd5a-e986418c3bb9 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:20.293095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:20.329303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f938-20a7-4e0e-93ef-53db29dd0bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:20.329932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f938-20a7-4e0e-93ef-53db29dd0bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.330216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f938-20a7-4e0e-93ef-53db29dd0bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.330492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f938-20a7-4e0e-93ef-53db29dd0bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.375762 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553325c4-7ff7-4879-aa1e-28838ad6d59b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:20.408972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f938-20a7-4e0e-93ef-53db29dd0bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:20.410469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f938-20a7-4e0e-93ef-53db29dd0bf1 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:20.506361 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553325c4-7ff7-4879-aa1e-28838ad6d59b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:20.508456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:20.534726 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 126/246] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:20.541420 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f938-20a7-4e0e-93ef-53db29dd0bf1 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:20.555026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:20.564724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a3b83-3a3d-4e07-8fa7-bcc4adb48ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:20.566346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a3b83-3a3d-4e07-8fa7-bcc4adb48ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.567043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a3b83-3a3d-4e07-8fa7-bcc4adb48ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.567710 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a3b83-3a3d-4e07-8fa7-bcc4adb48ea6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.587720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a3b83-3a3d-4e07-8fa7-bcc4adb48ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-464a3b83-3a3d-4e07-8fa7-bcc4adb48ea6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:20.594021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:20.594934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:20.595728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:20.595728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:20.595728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:20.595728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:20.595728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:20.595728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:20.595728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:20.595728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:20.595728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:20.595728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:20.595728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:20.595728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:20.596321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 121/247] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:20.601280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cde8d-aae3-4971-aac3-0b6070075238 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.601280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cde8d-aae3-4971-aac3-0b6070075238 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.601280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cde8d-aae3-4971-aac3-0b6070075238 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.601280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 122/248] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:20.607199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cde8d-aae3-4971-aac3-0b6070075238 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:20.703987 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f938-20a7-4e0e-93ef-53db29dd0bf1 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:20.760928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb22d1d-07fd-4597-95f2-6a79cd0a2320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:20.761757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb22d1d-07fd-4597-95f2-6a79cd0a2320 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.762526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb22d1d-07fd-4597-95f2-6a79cd0a2320 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.763227 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb22d1d-07fd-4597-95f2-6a79cd0a2320 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.765305 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb22d1d-07fd-4597-95f2-6a79cd0a2320 None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:20.767018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb22d1d-07fd-4597-95f2-6a79cd0a2320 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:20.767429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cde8d-aae3-4971-aac3-0b6070075238 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:20.769557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 127/249] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:20 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:20.771898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b165c-92b5-40ca-920f-35e3d0d1dcf3 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.772401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b165c-92b5-40ca-920f-35e3d0d1dcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.772885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b165c-92b5-40ca-920f-35e3d0d1dcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.800002 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-7b2b165c-92b5-40ca-920f-35e3d0d1dcf3 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:20.801668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7b2b165c-92b5-40ca-920f-35e3d0d1dcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:20.817941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af1f87-b97d-4cc6-9247-2ea5a804e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:20.818659 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af1f87-b97d-4cc6-9247-2ea5a804e0ba None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.818936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af1f87-b97d-4cc6-9247-2ea5a804e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.819449 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af1f87-b97d-4cc6-9247-2ea5a804e0ba None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.820275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af1f87-b97d-4cc6-9247-2ea5a804e0ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:20.820996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af1f87-b97d-4cc6-9247-2ea5a804e0ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:20.822617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af1f87-b97d-4cc6-9247-2ea5a804e0ba None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:20.832911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 123/250] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:20.834032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af1f87-b97d-4cc6-9247-2ea5a804e0ba None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:20.895022 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 128/251] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:20.896045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b165c-92b5-40ca-920f-35e3d0d1dcf3 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:20.905933 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:20.911094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:20.967355 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af1f87-b97d-4cc6-9247-2ea5a804e0ba None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.018596 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ca12f-fd3e-4e43-90aa-fd1cb38c9f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.019575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ca12f-fd3e-4e43-90aa-fd1cb38c9f90 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.020036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ca12f-fd3e-4e43-90aa-fd1cb38c9f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.021130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ca12f-fd3e-4e43-90aa-fd1cb38c9f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.022084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ca12f-fd3e-4e43-90aa-fd1cb38c9f90 None admin] RBAC: Adding query filter params (role.id=1084d899c92849ce9ba431f0fecfe796, scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c, user.id=4f547725bb4745ccb7a0b0de78f15eba) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:21.022592 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ca12f-fd3e-4e43-90aa-fd1cb38c9f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.035412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ca12f-fd3e-4e43-90aa-fd1cb38c9f90 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.041847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 124/252] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:20 2022] GET /identity/v3/role_assignments?user.id=4f547725bb4745ccb7a0b0de78f15eba&scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c&role.id=1084d899c92849ce9ba431f0fecfe796 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:21.075969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b165c-92b5-40ca-920f-35e3d0d1dcf3 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.120593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22828870-6ee1-447e-a5d2-148ee47a6d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.121287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22828870-6ee1-447e-a5d2-148ee47a6d64 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.121570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22828870-6ee1-447e-a5d2-148ee47a6d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.121842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22828870-6ee1-447e-a5d2-148ee47a6d64 None admin] PATH_INFO: `/v3/users/de0a30861e4041c0839055a0caf0d81c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.123035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22828870-6ee1-447e-a5d2-148ee47a6d64 None admin] RBAC: Authorizing `identity:get_user(user_id=de0a30861e4041c0839055a0caf0d81c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.125240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22828870-6ee1-447e-a5d2-148ee47a6d64 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.127192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 129/253] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:20 2022] GET /identity/v3/users/de0a30861e4041c0839055a0caf0d81c => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:21.133051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ca12f-fd3e-4e43-90aa-fd1cb38c9f90 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.290385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:21.306380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ca12f-fd3e-4e43-90aa-fd1cb38c9f90 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.369046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea040de6-b2ed-4d6f-a230-f928107518d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.369928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea040de6-b2ed-4d6f-a230-f928107518d8 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.370324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea040de6-b2ed-4d6f-a230-f928107518d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.370702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea040de6-b2ed-4d6f-a230-f928107518d8 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.373163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea040de6-b2ed-4d6f-a230-f928107518d8 None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.379178 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea040de6-b2ed-4d6f-a230-f928107518d8 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.385913 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 125/254] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:21 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:21.392235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22828870-6ee1-447e-a5d2-148ee47a6d64 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.442412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea040de6-b2ed-4d6f-a230-f928107518d8 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.531687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:21.593309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22828870-6ee1-447e-a5d2-148ee47a6d64 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.609602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea040de6-b2ed-4d6f-a230-f928107518d8 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.650302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa547b-95e8-4f1f-b66d-b5e3383fe216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.651306 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa547b-95e8-4f1f-b66d-b5e3383fe216 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.651790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa547b-95e8-4f1f-b66d-b5e3383fe216 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.652269 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa547b-95e8-4f1f-b66d-b5e3383fe216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.663792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa547b-95e8-4f1f-b66d-b5e3383fe216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-28aa547b-95e8-4f1f-b66d-b5e3383fe216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:21.669576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:21.671032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:21.671843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:21.671843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:21.671843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:21.671843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:21.671843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:21.671843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:21.671843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:21.671843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:21.671843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:21.671843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:21.671843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:21.671843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:21.674178 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 126/255] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:56:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:21.681244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f3d40-a155-413d-9e40-13aa751c526c None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.682067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f3d40-a155-413d-9e40-13aa751c526c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.682612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f3d40-a155-413d-9e40-13aa751c526c None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.684635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 127/256] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:21.689115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f3d40-a155-413d-9e40-13aa751c526c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.705953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5138d-1023-4a91-97bf-a3159f4a7ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.705953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5138d-1023-4a91-97bf-a3159f4a7ac6 None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.705953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5138d-1023-4a91-97bf-a3159f4a7ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.705953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5138d-1023-4a91-97bf-a3159f4a7ac6 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c/users/de0a30861e4041c0839055a0caf0d81c/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.713720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5138d-1023-4a91-97bf-a3159f4a7ac6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d12476fe55f430f8bd612ca6d4acc7c, user_id=de0a30861e4041c0839055a0caf0d81c, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.715225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5138d-1023-4a91-97bf-a3159f4a7ac6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.725076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:21.755091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 130/257] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:56:21 2022] PUT /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c/users/de0a30861e4041c0839055a0caf0d81c/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:56:21.757069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd0af5-f2ac-42dd-bba7-3c54551b7857 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.757325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd0af5-f2ac-42dd-bba7-3c54551b7857 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.757795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd0af5-f2ac-42dd-bba7-3c54551b7857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.806094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-d2fd0af5-f2ac-42dd-bba7-3c54551b7857 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:21.807498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d2fd0af5-f2ac-42dd-bba7-3c54551b7857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:21.843842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f3d40-a155-413d-9e40-13aa751c526c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.900883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14c63-54f7-415a-b94e-e33544b145d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.902008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14c63-54f7-415a-b94e-e33544b145d5 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.902524 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14c63-54f7-415a-b94e-e33544b145d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.903000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14c63-54f7-415a-b94e-e33544b145d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.903942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb14c63-54f7-415a-b94e-e33544b145d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:21.904647 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb14c63-54f7-415a-b94e-e33544b145d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.907105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb14c63-54f7-415a-b94e-e33544b145d5 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.918082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 128/258] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:21.927022 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14c63-54f7-415a-b94e-e33544b145d5 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:22.014740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 131/259] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:22.073062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:22.080484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14c63-54f7-415a-b94e-e33544b145d5 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:22.136436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7451165-ecde-4b2f-a770-5f52635bd08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:22.137561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7451165-ecde-4b2f-a770-5f52635bd08a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:22.138020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7451165-ecde-4b2f-a770-5f52635bd08a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:22.138438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7451165-ecde-4b2f-a770-5f52635bd08a None admin] PATH_INFO: `/v3/users/5ec51f93d5a442c0a65c719f2ae2ac18` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:22.141153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7451165-ecde-4b2f-a770-5f52635bd08a None admin] RBAC: Authorizing `identity:get_user(user_id=5ec51f93d5a442c0a65c719f2ae2ac18)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:22.150654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7451165-ecde-4b2f-a770-5f52635bd08a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:22.152854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 129/260] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:21 2022] GET /identity/v3/users/5ec51f93d5a442c0a65c719f2ae2ac18 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:22.161016 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd0af5-f2ac-42dd-bba7-3c54551b7857 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:22.264952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:22.322622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd0af5-f2ac-42dd-bba7-3c54551b7857 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:22.386940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155d842-cc0f-4e72-8b9c-092762a58a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:22.387501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d842-cc0f-4e72-8b9c-092762a58a66 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:22.387788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d842-cc0f-4e72-8b9c-092762a58a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:22.388129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d842-cc0f-4e72-8b9c-092762a58a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:22.489018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155d842-cc0f-4e72-8b9c-092762a58a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:22.490553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155d842-cc0f-4e72-8b9c-092762a58a66 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:22.557882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7451165-ecde-4b2f-a770-5f52635bd08a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:22.589795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:22.651102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 132/261] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:22.669784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155d842-cc0f-4e72-8b9c-092762a58a66 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:22.756610 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7451165-ecde-4b2f-a770-5f52635bd08a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:22.821428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3219d-5289-4e42-8a59-ae9359669aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:22.822159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3219d-5289-4e42-8a59-ae9359669aae None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:22.822448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3219d-5289-4e42-8a59-ae9359669aae None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:22.822727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3219d-5289-4e42-8a59-ae9359669aae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:22.838369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3219d-5289-4e42-8a59-ae9359669aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-05c3219d-5289-4e42-8a59-ae9359669aae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:22.844120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:22.845059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:22.845850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:22.845850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:22.845850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:22.845850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:22.845850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:22.845850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:22.845850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:22.845850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:22.845850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:22.845850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:22.845850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:22.845850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:22.857405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 130/262] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:56:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:22.865119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3219d-5289-4e42-8a59-ae9359669aae None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:22.877030 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:22.895834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155d842-cc0f-4e72-8b9c-092762a58a66 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:22.969416 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffcd47-d3d8-4c67-93a2-84cf9ecaa5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:22.970074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffcd47-d3d8-4c67-93a2-84cf9ecaa5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:22.970359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffcd47-d3d8-4c67-93a2-84cf9ecaa5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:22.970633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffcd47-d3d8-4c67-93a2-84cf9ecaa5d6 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:22.971819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffcd47-d3d8-4c67-93a2-84cf9ecaa5d6 None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:22.973286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffcd47-d3d8-4c67-93a2-84cf9ecaa5d6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:22.975125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 133/263] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:22 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:22.987151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3219d-5289-4e42-8a59-ae9359669aae None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:22.991191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffcd47-d3d8-4c67-93a2-84cf9ecaa5d6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:23.041434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b1bff-1d6c-4ecf-a067-c74b509e3762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:23.042115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b1bff-1d6c-4ecf-a067-c74b509e3762 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.042405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b1bff-1d6c-4ecf-a067-c74b509e3762 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.042681 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b1bff-1d6c-4ecf-a067-c74b509e3762 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.043358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b1bff-1d6c-4ecf-a067-c74b509e3762 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:23.043663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b1bff-1d6c-4ecf-a067-c74b509e3762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:23.045468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b1bff-1d6c-4ecf-a067-c74b509e3762 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:23.057055 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:23.059316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 131/264] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:56:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:23.066478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b1bff-1d6c-4ecf-a067-c74b509e3762 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:23.189180 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:23.204034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffcd47-d3d8-4c67-93a2-84cf9ecaa5d6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:23.215914 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b1bff-1d6c-4ecf-a067-c74b509e3762 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:23.286251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25713f6b-2eae-4462-ae06-d41af2e51b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:23.286791 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25713f6b-2eae-4462-ae06-d41af2e51b0d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.287079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25713f6b-2eae-4462-ae06-d41af2e51b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.287345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25713f6b-2eae-4462-ae06-d41af2e51b0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.288079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25713f6b-2eae-4462-ae06-d41af2e51b0d None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c, user.id=5ec51f93d5a442c0a65c719f2ae2ac18) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:23.288388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25713f6b-2eae-4462-ae06-d41af2e51b0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:23.289869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25713f6b-2eae-4462-ae06-d41af2e51b0d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:23.294232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1841a5d-7fd2-4ec5-b05d-e003bdd6910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:23.295056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1841a5d-7fd2-4ec5-b05d-e003bdd6910f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.295560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1841a5d-7fd2-4ec5-b05d-e003bdd6910f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.296033 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1841a5d-7fd2-4ec5-b05d-e003bdd6910f None admin] PATH_INFO: `/v3/users/5ec51f93d5a442c0a65c719f2ae2ac18` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.297486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1841a5d-7fd2-4ec5-b05d-e003bdd6910f None admin] RBAC: Authorizing `identity:get_user(user_id=5ec51f93d5a442c0a65c719f2ae2ac18)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:23.299119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1841a5d-7fd2-4ec5-b05d-e003bdd6910f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:23.300966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 132/265] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:23 2022] GET /identity/v3/users/5ec51f93d5a442c0a65c719f2ae2ac18 => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:23.305099 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 134/266] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:22 2022] GET /identity/v3/role_assignments?user.id=5ec51f93d5a442c0a65c719f2ae2ac18&scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:23.308704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25713f6b-2eae-4462-ae06-d41af2e51b0d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:23.429251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:23.434865 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25713f6b-2eae-4462-ae06-d41af2e51b0d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:23.477563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1630c-2800-4540-b8de-32a038aa8545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:23.478205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1630c-2800-4540-b8de-32a038aa8545 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.478487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1630c-2800-4540-b8de-32a038aa8545 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.478759 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1630c-2800-4540-b8de-32a038aa8545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.558897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1630c-2800-4540-b8de-32a038aa8545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:23.560323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1630c-2800-4540-b8de-32a038aa8545 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:23.668209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 135/267] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:23.669348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:23.674458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1841a5d-7fd2-4ec5-b05d-e003bdd6910f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:23.813779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1841a5d-7fd2-4ec5-b05d-e003bdd6910f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:23.857405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99385003-17c8-478f-bfca-fb4f1b25061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:23.858404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99385003-17c8-478f-bfca-fb4f1b25061b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.858884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99385003-17c8-478f-bfca-fb4f1b25061b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.859337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99385003-17c8-478f-bfca-fb4f1b25061b None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.860752 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99385003-17c8-478f-bfca-fb4f1b25061b None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:23.862382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99385003-17c8-478f-bfca-fb4f1b25061b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:23.864360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 133/268] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:23 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:23.870646 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1630c-2800-4540-b8de-32a038aa8545 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:23.996242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1630c-2800-4540-b8de-32a038aa8545 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:24.005083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2fdef-0bd0-4031-a9d8-10231ff10e02 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.005607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2fdef-0bd0-4031-a9d8-10231ff10e02 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.006052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2fdef-0bd0-4031-a9d8-10231ff10e02 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.007563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 134/269] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:56:24.012928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87692fd6-1746-4a31-8121-49e2922a3323 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.013293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87692fd6-1746-4a31-8121-49e2922a3323 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.013925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87692fd6-1746-4a31-8121-49e2922a3323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.035659 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:24.042219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a6e8b-dd74-4e22-902f-066385aff122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:24.042836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a6e8b-dd74-4e22-902f-066385aff122 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.043112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a6e8b-dd74-4e22-902f-066385aff122 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.043383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a6e8b-dd74-4e22-902f-066385aff122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.044245 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a6e8b-dd74-4e22-902f-066385aff122 None admin] RBAC: Adding query filter params (role.id=62c69ea249044f258a2a6f2138ff4ceb, scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c, user.id=5ec51f93d5a442c0a65c719f2ae2ac18) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:24.044552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a6e8b-dd74-4e22-902f-066385aff122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:24.046600 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a6e8b-dd74-4e22-902f-066385aff122 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:24.053130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 136/270] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:23 2022] GET /identity/v3/role_assignments?user.id=5ec51f93d5a442c0a65c719f2ae2ac18&scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c&role.id=62c69ea249044f258a2a6f2138ff4ceb => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:24.061867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-87692fd6-1746-4a31-8121-49e2922a3323 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:24.063508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-87692fd6-1746-4a31-8121-49e2922a3323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:24.191419 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 135/271] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:24.388023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5851542-5e10-40cb-a86b-2fc6266a5b7b None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.388303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5851542-5e10-40cb-a86b-2fc6266a5b7b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.389455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5851542-5e10-40cb-a86b-2fc6266a5b7b None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.392489 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 137/272] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:24.399298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d306ee9-1435-4254-8afe-b6b026d81175 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.399931 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d306ee9-1435-4254-8afe-b6b026d81175 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.400492 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d306ee9-1435-4254-8afe-b6b026d81175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.421769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-0d306ee9-1435-4254-8afe-b6b026d81175 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:24.423372 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0d306ee9-1435-4254-8afe-b6b026d81175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:24.493256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5851542-5e10-40cb-a86b-2fc6266a5b7b None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:24.512903 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 136/273] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:24.568899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:24.614733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5851542-5e10-40cb-a86b-2fc6266a5b7b None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:24.653051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494298-8647-4aeb-a2c3-f544fa0de7a9 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.653460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494298-8647-4aeb-a2c3-f544fa0de7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.653638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494298-8647-4aeb-a2c3-f544fa0de7a9 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.655924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 137/274] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:24.658210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908d92-0e6d-4dfb-b22c-c59c7604501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:24.658871 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908d92-0e6d-4dfb-b22c-c59c7604501f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.659149 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908d92-0e6d-4dfb-b22c-c59c7604501f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.659418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908d92-0e6d-4dfb-b22c-c59c7604501f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.661830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90304-d9a4-4975-b203-0d7c1058369a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.662115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90304-d9a4-4975-b203-0d7c1058369a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.662400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90304-d9a4-4975-b203-0d7c1058369a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.674379 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33908d92-0e6d-4dfb-b22c-c59c7604501f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-33908d92-0e6d-4dfb-b22c-c59c7604501f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:24.679595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:24.680661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:24.681510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 138/275] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:24.689274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-49c90304-d9a4-4975-b203-0d7c1058369a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:24.689789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908d92-0e6d-4dfb-b22c-c59c7604501f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:24.690779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-49c90304-d9a4-4975-b203-0d7c1058369a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:24.766868 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:24.782240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 138/276] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:24.804735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86397a-ff9c-4a05-8bc2-30fb632f348d None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.805106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86397a-ff9c-4a05-8bc2-30fb632f348d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.805444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86397a-ff9c-4a05-8bc2-30fb632f348d None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.807863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 139/277] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:56:24.814459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cbbec-a48b-4886-8e46-d88a9c93fd7a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.814742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cbbec-a48b-4886-8e46-d88a9c93fd7a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.815023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cbbec-a48b-4886-8e46-d88a9c93fd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.835693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908d92-0e6d-4dfb-b22c-c59c7604501f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:24.837382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-789cbbec-a48b-4886-8e46-d88a9c93fd7a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:24.838599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-789cbbec-a48b-4886-8e46-d88a9c93fd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:24.869776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:24.891388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58662c9d-d558-4d0c-8f3a-dd316bb538c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:24.892342 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58662c9d-d558-4d0c-8f3a-dd316bb538c6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.892824 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58662c9d-d558-4d0c-8f3a-dd316bb538c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.893240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58662c9d-d558-4d0c-8f3a-dd316bb538c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.894498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58662c9d-d558-4d0c-8f3a-dd316bb538c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:24.894958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58662c9d-d558-4d0c-8f3a-dd316bb538c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:24.897340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58662c9d-d558-4d0c-8f3a-dd316bb538c6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:24.910831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 139/278] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:24.911921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58662c9d-d558-4d0c-8f3a-dd316bb538c6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:24.913061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 140/279] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:24.916101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cbbec-a48b-4886-8e46-d88a9c93fd7a None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.044224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58662c9d-d558-4d0c-8f3a-dd316bb538c6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.064041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cbbec-a48b-4886-8e46-d88a9c93fd7a None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.083748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791630eb-863c-4ca1-be71-c193329c3796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.084389 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791630eb-863c-4ca1-be71-c193329c3796 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.084671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791630eb-863c-4ca1-be71-c193329c3796 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.084974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791630eb-863c-4ca1-be71-c193329c3796 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.090663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:25.096707 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791630eb-863c-4ca1-be71-c193329c3796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-791630eb-863c-4ca1-be71-c193329c3796 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:25.101997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:25.102921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:25.103740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 140/280] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:25.104393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791630eb-863c-4ca1-be71-c193329c3796 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.105681 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73516e0-a027-4255-aa3e-0981977c8789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.106316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73516e0-a027-4255-aa3e-0981977c8789 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.106594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73516e0-a027-4255-aa3e-0981977c8789 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.106866 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73516e0-a027-4255-aa3e-0981977c8789 None admin] PATH_INFO: `/v3/users/d36440c7d5e04464815eb889d086fd4f` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.121948 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73516e0-a027-4255-aa3e-0981977c8789 None admin] RBAC: Authorizing `identity:get_user(user_id=d36440c7d5e04464815eb889d086fd4f)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.123994 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73516e0-a027-4255-aa3e-0981977c8789 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.125895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 141/281] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:24 2022] GET /identity/v3/users/d36440c7d5e04464815eb889d086fd4f => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:25.126466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73516e0-a027-4255-aa3e-0981977c8789 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.161395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:25.224987 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791630eb-863c-4ca1-be71-c193329c3796 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.235520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73516e0-a027-4255-aa3e-0981977c8789 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.265532 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d947f8c-aeff-44c7-80ae-cd7b21ff4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.266454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d947f8c-aeff-44c7-80ae-cd7b21ff4945 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.266867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d947f8c-aeff-44c7-80ae-cd7b21ff4945 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.267269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d947f8c-aeff-44c7-80ae-cd7b21ff4945 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.269178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d947f8c-aeff-44c7-80ae-cd7b21ff4945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.271487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d947f8c-aeff-44c7-80ae-cd7b21ff4945 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.273667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df9aa7-54ce-4111-b80d-b089bf9da1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.273930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 141/282] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:56:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:25.274273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9aa7-54ce-4111-b80d-b089bf9da1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.274549 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9aa7-54ce-4111-b80d-b089bf9da1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.274819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9aa7-54ce-4111-b80d-b089bf9da1d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.275475 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df9aa7-54ce-4111-b80d-b089bf9da1d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:25.275803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df9aa7-54ce-4111-b80d-b089bf9da1d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.277209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df9aa7-54ce-4111-b80d-b089bf9da1d3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.282011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d947f8c-aeff-44c7-80ae-cd7b21ff4945 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.285493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 142/283] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:25.286280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df9aa7-54ce-4111-b80d-b089bf9da1d3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.338045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:25.384398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d947f8c-aeff-44c7-80ae-cd7b21ff4945 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.396276 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:25.396635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df9aa7-54ce-4111-b80d-b089bf9da1d3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.420810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480c93a-3053-48d3-985f-be73de91b711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.421185 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c93a-3053-48d3-985f-be73de91b711 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.421464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c93a-3053-48d3-985f-be73de91b711 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.421745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480c93a-3053-48d3-985f-be73de91b711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.422802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480c93a-3053-48d3-985f-be73de91b711 None admin] RBAC: Adding query filter params (role.id=068a24594f0b4d01aab3485c009314d4, user.id=d36440c7d5e04464815eb889d086fd4f, scope.system=all) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:25.422802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480c93a-3053-48d3-985f-be73de91b711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.424243 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480c93a-3053-48d3-985f-be73de91b711 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.429623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 142/284] 10.222.0.43 () {56 vars in 1308 bytes} [Wed Sep 7 15:56:25 2022] GET /identity/v3/role_assignments?user.id=d36440c7d5e04464815eb889d086fd4f&scope.system=all&role.id=068a24594f0b4d01aab3485c009314d4 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:25.430482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480c93a-3053-48d3-985f-be73de91b711 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.435289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a31bbd-273a-451c-9b77-f7e85da4af0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.436566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a31bbd-273a-451c-9b77-f7e85da4af0e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.437654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a31bbd-273a-451c-9b77-f7e85da4af0e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.437936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a31bbd-273a-451c-9b77-f7e85da4af0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.453349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a31bbd-273a-451c-9b77-f7e85da4af0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-c5a31bbd-273a-451c-9b77-f7e85da4af0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:25.460337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:25.461473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:25.462295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 143/285] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:25.462941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a31bbd-273a-451c-9b77-f7e85da4af0e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.576176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480c93a-3053-48d3-985f-be73de91b711 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.612827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a31bbd-273a-451c-9b77-f7e85da4af0e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.613423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eef88-95bf-41c4-80a2-1cb6ac612d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.614046 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eef88-95bf-41c4-80a2-1cb6ac612d62 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.614332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eef88-95bf-41c4-80a2-1cb6ac612d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.614610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34eef88-95bf-41c4-80a2-1cb6ac612d62 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.615276 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34eef88-95bf-41c4-80a2-1cb6ac612d62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.616051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:25.616789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34eef88-95bf-41c4-80a2-1cb6ac612d62 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.647504 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 143/286] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:56:25 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:25.648299 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eef88-95bf-41c4-80a2-1cb6ac612d62 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.666405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164dbe6-f4f6-4c76-a8ec-7778cacb2066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.667099 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164dbe6-f4f6-4c76-a8ec-7778cacb2066 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.667414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164dbe6-f4f6-4c76-a8ec-7778cacb2066 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.667693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164dbe6-f4f6-4c76-a8ec-7778cacb2066 None admin] PATH_INFO: `/v3/users/4f547725bb4745ccb7a0b0de78f15eba` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.669025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164dbe6-f4f6-4c76-a8ec-7778cacb2066 None admin] RBAC: Authorizing `identity:get_user(user_id=4f547725bb4745ccb7a0b0de78f15eba)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.671118 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164dbe6-f4f6-4c76-a8ec-7778cacb2066 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.680750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 144/287] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:25 2022] GET /identity/v3/users/4f547725bb4745ccb7a0b0de78f15eba => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:25.680750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164dbe6-f4f6-4c76-a8ec-7778cacb2066 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.710236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:25.820927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34eef88-95bf-41c4-80a2-1cb6ac612d62 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.854441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164dbe6-f4f6-4c76-a8ec-7778cacb2066 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.884953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4aa7d-e6cf-44a5-b949-1fb89b0efa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.885571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4aa7d-e6cf-44a5-b949-1fb89b0efa09 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.886450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4aa7d-e6cf-44a5-b949-1fb89b0efa09 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.886450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4aa7d-e6cf-44a5-b949-1fb89b0efa09 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.886781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4aa7d-e6cf-44a5-b949-1fb89b0efa09 None admin] RBAC: Adding query filter params (name=member) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:25.887086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4aa7d-e6cf-44a5-b949-1fb89b0efa09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.888517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4aa7d-e6cf-44a5-b949-1fb89b0efa09 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.901640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 144/288] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:25.902546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313c591-2b42-427d-99fd-e69f279efab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.903287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313c591-2b42-427d-99fd-e69f279efab6 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.903643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313c591-2b42-427d-99fd-e69f279efab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313c591-2b42-427d-99fd-e69f279efab6 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.906926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313c591-2b42-427d-99fd-e69f279efab6 None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.908472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313c591-2b42-427d-99fd-e69f279efab6 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.908876 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4aa7d-e6cf-44a5-b949-1fb89b0efa09 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.912755 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 145/289] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:25 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:25.916314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313c591-2b42-427d-99fd-e69f279efab6 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.966298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:26.043753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313c591-2b42-427d-99fd-e69f279efab6 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:26.049601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:26.059662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4aa7d-e6cf-44a5-b949-1fb89b0efa09 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:26.099858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9d45a-f422-4129-81c5-405e8389c8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:26.100892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9d45a-f422-4129-81c5-405e8389c8f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.101356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9d45a-f422-4129-81c5-405e8389c8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.101935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9d45a-f422-4129-81c5-405e8389c8f6 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c/users/4f547725bb4745ccb7a0b0de78f15eba/roles/1084d899c92849ce9ba431f0fecfe796` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.105006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9d45a-f422-4129-81c5-405e8389c8f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d12476fe55f430f8bd612ca6d4acc7c, user_id=4f547725bb4745ccb7a0b0de78f15eba, role_id=1084d899c92849ce9ba431f0fecfe796)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:26.106705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9d45a-f422-4129-81c5-405e8389c8f6 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:26.111475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d4e8d-2a70-428f-bffb-d51d8037fe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:26.112558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d4e8d-2a70-428f-bffb-d51d8037fe22 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.113058 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d4e8d-2a70-428f-bffb-d51d8037fe22 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.113474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d4e8d-2a70-428f-bffb-d51d8037fe22 None admin] PATH_INFO: `/v3/users/de0a30861e4041c0839055a0caf0d81c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.116632 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d4e8d-2a70-428f-bffb-d51d8037fe22 None admin] RBAC: Authorizing `identity:get_user(user_id=de0a30861e4041c0839055a0caf0d81c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:26.118903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d4e8d-2a70-428f-bffb-d51d8037fe22 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:26.121571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 145/290] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:25 2022] GET /identity/v3/users/de0a30861e4041c0839055a0caf0d81c => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:26.126250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 146/291] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:56:25 2022] PUT /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c/users/4f547725bb4745ccb7a0b0de78f15eba/roles/1084d899c92849ce9ba431f0fecfe796 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:56:26.131061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d4e8d-2a70-428f-bffb-d51d8037fe22 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:26.288798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d4e8d-2a70-428f-bffb-d51d8037fe22 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:26.333797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19300dd-e908-460d-8b1f-dfe5363dc307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:26.334553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19300dd-e908-460d-8b1f-dfe5363dc307 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.334934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19300dd-e908-460d-8b1f-dfe5363dc307 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.335218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19300dd-e908-460d-8b1f-dfe5363dc307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.372250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:26.419577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19300dd-e908-460d-8b1f-dfe5363dc307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:26.421802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19300dd-e908-460d-8b1f-dfe5363dc307 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:26.542108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 146/292] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:26.551131 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9d45a-f422-4129-81c5-405e8389c8f6 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:26.690334 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:26.694254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9d45a-f422-4129-81c5-405e8389c8f6 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:26.738103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d94f45-51e2-4909-9aad-8e48c4c0044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:26.739474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d94f45-51e2-4909-9aad-8e48c4c0044d None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.740146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d94f45-51e2-4909-9aad-8e48c4c0044d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.740905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d94f45-51e2-4909-9aad-8e48c4c0044d None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.742888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d94f45-51e2-4909-9aad-8e48c4c0044d None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:26.745477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d94f45-51e2-4909-9aad-8e48c4c0044d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:26.749214 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 147/293] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:26 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:26.758226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19300dd-e908-460d-8b1f-dfe5363dc307 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:26.866857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:26.915678 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19300dd-e908-460d-8b1f-dfe5363dc307 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:26.957575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf33227-0e97-4dad-9da7-924f76d7f31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:26.958117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf33227-0e97-4dad-9da7-924f76d7f31d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.958402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf33227-0e97-4dad-9da7-924f76d7f31d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.958677 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf33227-0e97-4dad-9da7-924f76d7f31d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.959421 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf33227-0e97-4dad-9da7-924f76d7f31d None admin] RBAC: Adding query filter params (role.id=068a24594f0b4d01aab3485c009314d4, scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c, user.id=de0a30861e4041c0839055a0caf0d81c) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:26.959740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf33227-0e97-4dad-9da7-924f76d7f31d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:26.961247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf33227-0e97-4dad-9da7-924f76d7f31d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:26.968887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 147/294] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:26 2022] GET /identity/v3/role_assignments?user.id=de0a30861e4041c0839055a0caf0d81c&scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c&role.id=068a24594f0b4d01aab3485c009314d4 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:28.020624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66e665-07d9-40e7-bb24-deb58c8e3e48 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.021666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66e665-07d9-40e7-bb24-deb58c8e3e48 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.022156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66e665-07d9-40e7-bb24-deb58c8e3e48 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.023955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 148/295] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:28.030158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1913dfd-271d-4ece-b68d-ad12e4291449 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.030538 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1913dfd-271d-4ece-b68d-ad12e4291449 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.030720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1913dfd-271d-4ece-b68d-ad12e4291449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.050060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f1913dfd-271d-4ece-b68d-ad12e4291449 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:28.051260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f1913dfd-271d-4ece-b68d-ad12e4291449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:28.127109 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 148/296] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:28.402199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66e665-07d9-40e7-bb24-deb58c8e3e48 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:28.461765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41d56c-ee53-4886-a354-dd1bc3baba67 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.462090 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41d56c-ee53-4886-a354-dd1bc3baba67 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.462331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41d56c-ee53-4886-a354-dd1bc3baba67 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.463903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 149/297] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:28.470894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfe67e-0a0a-4cf9-956a-2abf5b4223d4 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.471179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfe67e-0a0a-4cf9-956a-2abf5b4223d4 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.471519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfe67e-0a0a-4cf9-956a-2abf5b4223d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.491058 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-17cfe67e-0a0a-4cf9-956a-2abf5b4223d4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:28.492411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-17cfe67e-0a0a-4cf9-956a-2abf5b4223d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:28.520027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66e665-07d9-40e7-bb24-deb58c8e3e48 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:28.558105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:28.558800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dc9f6-24ce-407d-afac-97fa496ead9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:28.559589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dc9f6-24ce-407d-afac-97fa496ead9f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.560260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dc9f6-24ce-407d-afac-97fa496ead9f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.560260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dc9f6-24ce-407d-afac-97fa496ead9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.574156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0dc9f6-24ce-407d-afac-97fa496ead9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-6f0dc9f6-24ce-407d-afac-97fa496ead9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:28.579692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:28.580839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:28.581834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:28.581834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:28.581834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:28.581834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:28.581834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:28.581834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:28.581834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:28.581834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:28.581834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:28.581834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:28.581834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:28.581834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:28.583108 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 149/298] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:28.584402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 150/299] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:28.593369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dc9f6-24ce-407d-afac-97fa496ead9f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:28.622783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:28.716803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dc9f6-24ce-407d-afac-97fa496ead9f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:28.755057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47aa3b-9535-484a-8aeb-a3baffdd5271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:28.756135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47aa3b-9535-484a-8aeb-a3baffdd5271 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.756901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47aa3b-9535-484a-8aeb-a3baffdd5271 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.757562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47aa3b-9535-484a-8aeb-a3baffdd5271 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.758841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47aa3b-9535-484a-8aeb-a3baffdd5271 None admin] RBAC: Adding query filter params (name=member) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:28.759560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47aa3b-9535-484a-8aeb-a3baffdd5271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:28.762099 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47aa3b-9535-484a-8aeb-a3baffdd5271 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:28.778700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 150/300] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:28.788741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfe67e-0a0a-4cf9-956a-2abf5b4223d4 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:28.803148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92920f77-94cc-4f29-b099-ca760a57a4c9 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.803436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92920f77-94cc-4f29-b099-ca760a57a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.803720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92920f77-94cc-4f29-b099-ca760a57a4c9 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.805103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 151/301] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:28.810137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bed01-b2f0-4e16-8d25-b5bbdba9743d None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.810425 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bed01-b2f0-4e16-8d25-b5bbdba9743d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.810786 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bed01-b2f0-4e16-8d25-b5bbdba9743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.832142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-a15bed01-b2f0-4e16-8d25-b5bbdba9743d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:28.832656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a15bed01-b2f0-4e16-8d25-b5bbdba9743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:28.916090 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfe67e-0a0a-4cf9-956a-2abf5b4223d4 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:28.916877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 152/302] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:28.918265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34694b9-13ba-47ea-86a3-4c8638e391f8 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.918550 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34694b9-13ba-47ea-86a3-4c8638e391f8 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.919664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34694b9-13ba-47ea-86a3-4c8638e391f8 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.925461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 153/303] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:28.926997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20617ea9-b866-4bc8-9db7-0c344de4e1cf None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.927280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20617ea9-b866-4bc8-9db7-0c344de4e1cf None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.927555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20617ea9-b866-4bc8-9db7-0c344de4e1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.946866 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-20617ea9-b866-4bc8-9db7-0c344de4e1cf None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:28.948185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-20617ea9-b866-4bc8-9db7-0c344de4e1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:28.956732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a493a5-8f5e-4ba5-9a4e-19d5f73349ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:28.957385 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a493a5-8f5e-4ba5-9a4e-19d5f73349ad None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.957662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a493a5-8f5e-4ba5-9a4e-19d5f73349ad None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.957933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a493a5-8f5e-4ba5-9a4e-19d5f73349ad None admin] PATH_INFO: `/v3/users/d36440c7d5e04464815eb889d086fd4f` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.959047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a493a5-8f5e-4ba5-9a4e-19d5f73349ad None admin] RBAC: Authorizing `identity:get_user(user_id=d36440c7d5e04464815eb889d086fd4f)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:28.960494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a493a5-8f5e-4ba5-9a4e-19d5f73349ad None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:28.962404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 151/304] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:28 2022] GET /identity/v3/users/d36440c7d5e04464815eb889d086fd4f => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:28.963243 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a493a5-8f5e-4ba5-9a4e-19d5f73349ad None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:28.969959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:29.031371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:29.045112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 154/305] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:29.047261 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20617ea9-b866-4bc8-9db7-0c344de4e1cf None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.083589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a493a5-8f5e-4ba5-9a4e-19d5f73349ad None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.121174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb7842-521f-4876-bd0f-57afebafa5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.122035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb7842-521f-4876-bd0f-57afebafa5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.122144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb7842-521f-4876-bd0f-57afebafa5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.122348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb7842-521f-4876-bd0f-57afebafa5c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.134490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb7842-521f-4876-bd0f-57afebafa5c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-b4fb7842-521f-4876-bd0f-57afebafa5c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:29.140095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:29.141050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:29.141853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 152/306] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:29.147438 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb7842-521f-4876-bd0f-57afebafa5c4 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.187747 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20617ea9-b866-4bc8-9db7-0c344de4e1cf None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.223585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba232d-0087-4993-8f9d-fa42bee7fa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.224176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba232d-0087-4993-8f9d-fa42bee7fa99 None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.224459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba232d-0087-4993-8f9d-fa42bee7fa99 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.224763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba232d-0087-4993-8f9d-fa42bee7fa99 None admin] PATH_INFO: `/v3/system/users/d36440c7d5e04464815eb889d086fd4f/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.226196 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba232d-0087-4993-8f9d-fa42bee7fa99 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d36440c7d5e04464815eb889d086fd4f, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:29.227579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba232d-0087-4993-8f9d-fa42bee7fa99 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:29.237554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 155/307] 10.222.0.43 () {58 vars in 1334 bytes} [Wed Sep 7 15:56:29 2022] PUT /identity/v3/system/users/d36440c7d5e04464815eb889d086fd4f/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:29.238497 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba232d-0087-4993-8f9d-fa42bee7fa99 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.260514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:29.284293 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb7842-521f-4876-bd0f-57afebafa5c4 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.304256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:29.335883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78499ea2-ee0f-4910-8d0a-80df89db9157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.336507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78499ea2-ee0f-4910-8d0a-80df89db9157 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.336833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78499ea2-ee0f-4910-8d0a-80df89db9157 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.337104 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78499ea2-ee0f-4910-8d0a-80df89db9157 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.337787 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78499ea2-ee0f-4910-8d0a-80df89db9157 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:29.338090 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78499ea2-ee0f-4910-8d0a-80df89db9157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:29.339581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78499ea2-ee0f-4910-8d0a-80df89db9157 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:29.351088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 153/308] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:29.351954 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78499ea2-ee0f-4910-8d0a-80df89db9157 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.378519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba232d-0087-4993-8f9d-fa42bee7fa99 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.431784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e70b6-0806-46d6-8569-dd6c328bd45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.432422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e70b6-0806-46d6-8569-dd6c328bd45e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.432731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e70b6-0806-46d6-8569-dd6c328bd45e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.433011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e70b6-0806-46d6-8569-dd6c328bd45e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.434532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e70b6-0806-46d6-8569-dd6c328bd45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:29.436009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e70b6-0806-46d6-8569-dd6c328bd45e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:29.437890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 156/309] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:56:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:29.441528 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e70b6-0806-46d6-8569-dd6c328bd45e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.495372 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78499ea2-ee0f-4910-8d0a-80df89db9157 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.534092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362cce-a6cc-455e-80b9-d8ee3a251f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.534747 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362cce-a6cc-455e-80b9-d8ee3a251f15 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.535029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362cce-a6cc-455e-80b9-d8ee3a251f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.535304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362cce-a6cc-455e-80b9-d8ee3a251f15 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.536336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:29.548488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b362cce-a6cc-455e-80b9-d8ee3a251f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-4b362cce-a6cc-455e-80b9-d8ee3a251f15 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:29.553523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:29.554476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:29.555264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 154/310] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:29.555909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362cce-a6cc-455e-80b9-d8ee3a251f15 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.564055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e70b6-0806-46d6-8569-dd6c328bd45e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.597186 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:29.601358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29760d90-fb79-4670-91b1-5e3529b389c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.602041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29760d90-fb79-4670-91b1-5e3529b389c8 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.602327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29760d90-fb79-4670-91b1-5e3529b389c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.602605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29760d90-fb79-4670-91b1-5e3529b389c8 None admin] PATH_INFO: `/v3/users/59d1f5c43a2c47d6b9535423645b63b6` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.619359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29760d90-fb79-4670-91b1-5e3529b389c8 None admin] RBAC: Authorizing `identity:get_user(user_id=59d1f5c43a2c47d6b9535423645b63b6)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:29.620923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29760d90-fb79-4670-91b1-5e3529b389c8 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:29.622655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 157/311] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:29 2022] GET /identity/v3/users/59d1f5c43a2c47d6b9535423645b63b6 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:29.624311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29760d90-fb79-4670-91b1-5e3529b389c8 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.679192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362cce-a6cc-455e-80b9-d8ee3a251f15 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.716741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a5213-05a0-494c-9cc6-c71f26fd8e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.718049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a5213-05a0-494c-9cc6-c71f26fd8e0c None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.718337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a5213-05a0-494c-9cc6-c71f26fd8e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.718613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a5213-05a0-494c-9cc6-c71f26fd8e0c None admin] PATH_INFO: `/v3/groups` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.719765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a5213-05a0-494c-9cc6-c71f26fd8e0c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:29.721270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a5213-05a0-494c-9cc6-c71f26fd8e0c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:29.739096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 155/312] 10.222.0.43 () {60 vars in 1134 bytes} [Wed Sep 7 15:56:29 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:29.739843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a5213-05a0-494c-9cc6-c71f26fd8e0c None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.769871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29760d90-fb79-4670-91b1-5e3529b389c8 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.813419 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b3c60-6bde-4831-be7e-c205fe75d6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.814062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b3c60-6bde-4831-be7e-c205fe75d6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.814450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b3c60-6bde-4831-be7e-c205fe75d6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.814734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b3c60-6bde-4831-be7e-c205fe75d6d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.815499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b3c60-6bde-4831-be7e-c205fe75d6d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:29.815815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b3c60-6bde-4831-be7e-c205fe75d6d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:29.817335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b3c60-6bde-4831-be7e-c205fe75d6d6 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:29.828950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 158/313] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:29.834406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b3c60-6bde-4831-be7e-c205fe75d6d6 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.838069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:29.905001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:29.917700 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a5213-05a0-494c-9cc6-c71f26fd8e0c None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.970572 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b74bc-fdab-4b9f-8fe0-92ab59b7d19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.971218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b74bc-fdab-4b9f-8fe0-92ab59b7d19e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.971504 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b74bc-fdab-4b9f-8fe0-92ab59b7d19e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.971787 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b74bc-fdab-4b9f-8fe0-92ab59b7d19e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.972543 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b74bc-fdab-4b9f-8fe0-92ab59b7d19e None admin] RBAC: Adding query filter params (role.id=1084d899c92849ce9ba431f0fecfe796, user.id=59d1f5c43a2c47d6b9535423645b63b6, scope.system=all) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:29.972957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b74bc-fdab-4b9f-8fe0-92ab59b7d19e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:29.974498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b74bc-fdab-4b9f-8fe0-92ab59b7d19e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:29.980049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 156/314] 10.222.0.43 () {56 vars in 1308 bytes} [Wed Sep 7 15:56:29 2022] GET /identity/v3/role_assignments?user.id=59d1f5c43a2c47d6b9535423645b63b6&scope.system=all&role.id=1084d899c92849ce9ba431f0fecfe796 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:29.981052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b3c60-6bde-4831-be7e-c205fe75d6d6 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:30.035958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114749cd-c7a9-4cf0-b0c3-278ecb173ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:30.036647 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114749cd-c7a9-4cf0-b0c3-278ecb173ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.036996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114749cd-c7a9-4cf0-b0c3-278ecb173ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.037284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114749cd-c7a9-4cf0-b0c3-278ecb173ef5 None admin] PATH_INFO: `/v3/users/4f547725bb4745ccb7a0b0de78f15eba` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.039632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114749cd-c7a9-4cf0-b0c3-278ecb173ef5 None admin] RBAC: Authorizing `identity:get_user(user_id=4f547725bb4745ccb7a0b0de78f15eba)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:30.041310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114749cd-c7a9-4cf0-b0c3-278ecb173ef5 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:30.043379 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 159/315] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:29 2022] GET /identity/v3/users/4f547725bb4745ccb7a0b0de78f15eba => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:30.049179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b74bc-fdab-4b9f-8fe0-92ab59b7d19e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:30.166524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b74bc-fdab-4b9f-8fe0-92ab59b7d19e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:30.210057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d1818-9d0d-44fd-9f7f-4892826396a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:30.210684 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d1818-9d0d-44fd-9f7f-4892826396a1 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.210956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d1818-9d0d-44fd-9f7f-4892826396a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.211226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d1818-9d0d-44fd-9f7f-4892826396a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.241851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:30.287360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d1818-9d0d-44fd-9f7f-4892826396a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:30.288802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d1818-9d0d-44fd-9f7f-4892826396a1 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:30.409415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 157/316] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:30.415415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114749cd-c7a9-4cf0-b0c3-278ecb173ef5 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:30.488366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:30.522550 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114749cd-c7a9-4cf0-b0c3-278ecb173ef5 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:30.559832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b6bee-de68-4ffa-bc2a-2a0d68a1533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:30.561429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b6bee-de68-4ffa-bc2a-2a0d68a1533b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.562216 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b6bee-de68-4ffa-bc2a-2a0d68a1533b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.562698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b6bee-de68-4ffa-bc2a-2a0d68a1533b None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.564053 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b6bee-de68-4ffa-bc2a-2a0d68a1533b None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:30.565832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b6bee-de68-4ffa-bc2a-2a0d68a1533b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:30.567687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 160/317] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:30 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:30.578107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d1818-9d0d-44fd-9f7f-4892826396a1 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:30.642552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:30.689955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d1818-9d0d-44fd-9f7f-4892826396a1 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:30.726332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccf70c-1176-4a1b-bd1b-ec69e1bd0d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:30.727211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccf70c-1176-4a1b-bd1b-ec69e1bd0d03 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.727647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccf70c-1176-4a1b-bd1b-ec69e1bd0d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.728066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccf70c-1176-4a1b-bd1b-ec69e1bd0d03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.728963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccf70c-1176-4a1b-bd1b-ec69e1bd0d03 None admin] RBAC: Adding query filter params (role.id=1084d899c92849ce9ba431f0fecfe796, scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c, user.id=4f547725bb4745ccb7a0b0de78f15eba) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:30.729431 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccf70c-1176-4a1b-bd1b-ec69e1bd0d03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:30.731214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccf70c-1176-4a1b-bd1b-ec69e1bd0d03 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:30.738256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 158/318] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:56:30 2022] GET /identity/v3/role_assignments?user.id=4f547725bb4745ccb7a0b0de78f15eba&scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c&role.id=1084d899c92849ce9ba431f0fecfe796 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:31.585707 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cb806-c5f4-4f18-8bb0-85deb718c394 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:31.586267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cb806-c5f4-4f18-8bb0-85deb718c394 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:31.586267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cb806-c5f4-4f18-8bb0-85deb718c394 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:31.587605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 161/319] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:31.593256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3004ac9-b9a6-4482-af0a-7f5aae556bfc None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:31.593697 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3004ac9-b9a6-4482-af0a-7f5aae556bfc None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:31.593873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3004ac9-b9a6-4482-af0a-7f5aae556bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:31.612616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-d3004ac9-b9a6-4482-af0a-7f5aae556bfc None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:31.613825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d3004ac9-b9a6-4482-af0a-7f5aae556bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:31.684735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 159/320] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:31.956552 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cb806-c5f4-4f18-8bb0-85deb718c394 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:32.082197 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cb806-c5f4-4f18-8bb0-85deb718c394 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:32.118794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e973d4-7eef-405e-b94c-53ad28eac0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:32.119439 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e973d4-7eef-405e-b94c-53ad28eac0ad None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.119720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e973d4-7eef-405e-b94c-53ad28eac0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.119995 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e973d4-7eef-405e-b94c-53ad28eac0ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.122014 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572eb1-d3f3-44aa-967b-5530674ece17 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.122300 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572eb1-d3f3-44aa-967b-5530674ece17 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.122577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572eb1-d3f3-44aa-967b-5530674ece17 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.124093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 160/321] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:56:32.129133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:32.129284 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d30bc-b3e6-4d26-9f9a-923e3a421cc2 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.130278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d30bc-b3e6-4d26-9f9a-923e3a421cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.130278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d30bc-b3e6-4d26-9f9a-923e3a421cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.136156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e973d4-7eef-405e-b94c-53ad28eac0ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-15e973d4-7eef-405e-b94c-53ad28eac0ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:32.142144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:32.143084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:32.144206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:32.144206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:32.144206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:32.144206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:32.144206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:32.144206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:32.144206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:32.144206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:32.144206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:32.144206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:32.144206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:32.144206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:32.144908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 162/322] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:32.149864 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e973d4-7eef-405e-b94c-53ad28eac0ad None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:32.150580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-981d30bc-b3e6-4d26-9f9a-923e3a421cc2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:32.151888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-981d30bc-b3e6-4d26-9f9a-923e3a421cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:32.205890 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:32.232319 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 161/323] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:32.270782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e973d4-7eef-405e-b94c-53ad28eac0ad None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:32.309586 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd00da-25ff-4a3a-932a-0ef9f8c1f567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:32.310194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd00da-25ff-4a3a-932a-0ef9f8c1f567 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.310472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd00da-25ff-4a3a-932a-0ef9f8c1f567 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.311285 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd00da-25ff-4a3a-932a-0ef9f8c1f567 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.312121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd00da-25ff-4a3a-932a-0ef9f8c1f567 None admin] RBAC: Adding query filter params (name=member) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:32.312534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd00da-25ff-4a3a-932a-0ef9f8c1f567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:32.313893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd00da-25ff-4a3a-932a-0ef9f8c1f567 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:32.323015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 163/324] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:32.329273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d30bc-b3e6-4d26-9f9a-923e3a421cc2 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:32.351369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee8314-9f95-4eef-8b6f-534275d9fccc None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.351645 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee8314-9f95-4eef-8b6f-534275d9fccc None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.351916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee8314-9f95-4eef-8b6f-534275d9fccc None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.353419 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 164/325] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:56:32.358830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e8027-9583-4c49-b36e-d4b54e346379 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.359122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e8027-9583-4c49-b36e-d4b54e346379 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.359386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e8027-9583-4c49-b36e-d4b54e346379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.378945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b64e8027-9583-4c49-b36e-d4b54e346379 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:32.380138 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b64e8027-9583-4c49-b36e-d4b54e346379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:32.442981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:32.456675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 165/326] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:32.466839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d30bc-b3e6-4d26-9f9a-923e3a421cc2 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:32.504384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100040a-701f-4ad3-811f-244ded429f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:32.504996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100040a-701f-4ad3-811f-244ded429f07 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.505277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100040a-701f-4ad3-811f-244ded429f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.505550 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100040a-701f-4ad3-811f-244ded429f07 None admin] PATH_INFO: `/v3/users/d36440c7d5e04464815eb889d086fd4f` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.506672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100040a-701f-4ad3-811f-244ded429f07 None admin] RBAC: Authorizing `identity:get_user(user_id=d36440c7d5e04464815eb889d086fd4f)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:32.508401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100040a-701f-4ad3-811f-244ded429f07 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:32.514952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 162/327] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:32 2022] GET /identity/v3/users/d36440c7d5e04464815eb889d086fd4f => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:32.515125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e8027-9583-4c49-b36e-d4b54e346379 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:32.515884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100040a-701f-4ad3-811f-244ded429f07 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:32.571014 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:32.627357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100040a-701f-4ad3-811f-244ded429f07 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:32.630290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e8027-9583-4c49-b36e-d4b54e346379 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:32.667030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d8e9-8624-41a1-84e6-f9d6f1daa22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:32.667619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d8e9-8624-41a1-84e6-f9d6f1daa22e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.667898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d8e9-8624-41a1-84e6-f9d6f1daa22e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.668171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d8e9-8624-41a1-84e6-f9d6f1daa22e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.668931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069d8e9-8624-41a1-84e6-f9d6f1daa22e None admin] RBAC: Adding query filter params (role.id=068a24594f0b4d01aab3485c009314d4, user.id=d36440c7d5e04464815eb889d086fd4f, scope.system=all) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:32.669248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069d8e9-8624-41a1-84e6-f9d6f1daa22e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:32.671743 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069d8e9-8624-41a1-84e6-f9d6f1daa22e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:32.674695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17295106-a550-46c4-9f63-c35d946d7e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:32.675731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17295106-a550-46c4-9f63-c35d946d7e14 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.676164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17295106-a550-46c4-9f63-c35d946d7e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.676868 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17295106-a550-46c4-9f63-c35d946d7e14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.678464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17295106-a550-46c4-9f63-c35d946d7e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:32.680940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17295106-a550-46c4-9f63-c35d946d7e14 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:32.683581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 166/328] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:56:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:32.692718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 163/329] 10.222.0.43 () {56 vars in 1308 bytes} [Wed Sep 7 15:56:32 2022] GET /identity/v3/role_assignments?user.id=d36440c7d5e04464815eb889d086fd4f&scope.system=all&role.id=068a24594f0b4d01aab3485c009314d4 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:32.692932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17295106-a550-46c4-9f63-c35d946d7e14 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:32.728812 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d8e9-8624-41a1-84e6-f9d6f1daa22e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:32.772083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:32.831952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17295106-a550-46c4-9f63-c35d946d7e14 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:32.855565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d8e9-8624-41a1-84e6-f9d6f1daa22e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:32.870770 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:32.878156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310f7c6-f90e-4456-af65-85614f5c1999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:32.878786 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310f7c6-f90e-4456-af65-85614f5c1999 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.879055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310f7c6-f90e-4456-af65-85614f5c1999 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.879508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310f7c6-f90e-4456-af65-85614f5c1999 None admin] PATH_INFO: `/v3/groups` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.880201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310f7c6-f90e-4456-af65-85614f5c1999 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:32.882106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310f7c6-f90e-4456-af65-85614f5c1999 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:32.902983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 167/330] 10.222.0.43 () {60 vars in 1134 bytes} [Wed Sep 7 15:56:32 2022] POST /identity/v3/groups => generated 226 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:32.910639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb34d6d-0a49-42f2-a55a-7e2b69870909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:32.911311 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb34d6d-0a49-42f2-a55a-7e2b69870909 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.911586 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb34d6d-0a49-42f2-a55a-7e2b69870909 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.911852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb34d6d-0a49-42f2-a55a-7e2b69870909 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.927335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb34d6d-0a49-42f2-a55a-7e2b69870909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-fbb34d6d-0a49-42f2-a55a-7e2b69870909 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:32.933083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:32.934120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:32.936464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 164/331] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:56:32.942782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310f7c6-f90e-4456-af65-85614f5c1999 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:33.079022 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310f7c6-f90e-4456-af65-85614f5c1999 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:33.098794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:33.120824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b14752-6c22-4303-b830-ebdf74d7c154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:33.121312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b14752-6c22-4303-b830-ebdf74d7c154 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:33.121590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b14752-6c22-4303-b830-ebdf74d7c154 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:33.121883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b14752-6c22-4303-b830-ebdf74d7c154 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:33.122540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b14752-6c22-4303-b830-ebdf74d7c154 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:33.122837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b14752-6c22-4303-b830-ebdf74d7c154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:33.124407 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b14752-6c22-4303-b830-ebdf74d7c154 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:33.134529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 168/332] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:33.140867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb34d6d-0a49-42f2-a55a-7e2b69870909 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:33.268871 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb34d6d-0a49-42f2-a55a-7e2b69870909 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:33.311388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b77df-dff7-4242-b84f-529d46f4c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:33.312031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b77df-dff7-4242-b84f-529d46f4c7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:33.312222 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b77df-dff7-4242-b84f-529d46f4c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:33.312485 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b77df-dff7-4242-b84f-529d46f4c7d2 None admin] PATH_INFO: `/v3/users/59d1f5c43a2c47d6b9535423645b63b6` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:33.313697 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b77df-dff7-4242-b84f-529d46f4c7d2 None admin] RBAC: Authorizing `identity:get_user(user_id=59d1f5c43a2c47d6b9535423645b63b6)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:33.315367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b77df-dff7-4242-b84f-529d46f4c7d2 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:33.317223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 165/333] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:33 2022] GET /identity/v3/users/59d1f5c43a2c47d6b9535423645b63b6 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:33.323148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b14752-6c22-4303-b830-ebdf74d7c154 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:33.450587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b14752-6c22-4303-b830-ebdf74d7c154 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:33.492148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934813d-1027-4660-ac30-f91a362d9de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:33.492864 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934813d-1027-4660-ac30-f91a362d9de9 None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:33.493146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934813d-1027-4660-ac30-f91a362d9de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:33.493424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934813d-1027-4660-ac30-f91a362d9de9 None admin] PATH_INFO: `/v3/system/users/59d1f5c43a2c47d6b9535423645b63b6/roles/1084d899c92849ce9ba431f0fecfe796` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:33.494982 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934813d-1027-4660-ac30-f91a362d9de9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=59d1f5c43a2c47d6b9535423645b63b6, role_id=1084d899c92849ce9ba431f0fecfe796)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:33.496389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934813d-1027-4660-ac30-f91a362d9de9 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:33.509847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 169/334] 10.222.0.43 () {58 vars in 1334 bytes} [Wed Sep 7 15:56:33 2022] PUT /identity/v3/system/users/59d1f5c43a2c47d6b9535423645b63b6/roles/1084d899c92849ce9ba431f0fecfe796 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:35.460054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b375be-41da-43fa-b28b-d439080fbe22 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:35.460575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b375be-41da-43fa-b28b-d439080fbe22 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:35.460575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b375be-41da-43fa-b28b-d439080fbe22 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:35.462316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 166/335] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:35.470028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f29a1b-7be1-436c-870b-ac8a3df253e1 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:35.470028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f29a1b-7be1-436c-870b-ac8a3df253e1 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:35.470028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f29a1b-7be1-436c-870b-ac8a3df253e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:35.489506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-92f29a1b-7be1-436c-870b-ac8a3df253e1 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:35.490764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-92f29a1b-7be1-436c-870b-ac8a3df253e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:35.548346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:35.592976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 170/336] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:35.825833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10745e-4335-415f-8e88-eb5f529933ff None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:35.826199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10745e-4335-415f-8e88-eb5f529933ff None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:35.826576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10745e-4335-415f-8e88-eb5f529933ff None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:35.828001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 167/337] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:35.834826 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1618d-7e10-40d1-bca3-dea8a8a7aa68 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:35.835116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1618d-7e10-40d1-bca3-dea8a8a7aa68 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:35.835394 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1618d-7e10-40d1-bca3-dea8a8a7aa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:35.860814 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-a3e1618d-7e10-40d1-bca3-dea8a8a7aa68 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:35.862466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a3e1618d-7e10-40d1-bca3-dea8a8a7aa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:35.964328 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 171/338] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:36.161191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10745e-4335-415f-8e88-eb5f529933ff None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:36.209835 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:36.312337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10745e-4335-415f-8e88-eb5f529933ff None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:36.362916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbc63e-fc86-42cd-878f-8a321b922aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:36.363687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbc63e-fc86-42cd-878f-8a321b922aee None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:36.363993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbc63e-fc86-42cd-878f-8a321b922aee None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:36.364270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbc63e-fc86-42cd-878f-8a321b922aee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:36.379411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1618d-7e10-40d1-bca3-dea8a8a7aa68 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:36.382131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbc63e-fc86-42cd-878f-8a321b922aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-47dbc63e-fc86-42cd-878f-8a321b922aee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:36.390156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:36.391967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:36.392802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 168/339] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:36.401633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbc63e-fc86-42cd-878f-8a321b922aee None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:36.605561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1618d-7e10-40d1-bca3-dea8a8a7aa68 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:36.610283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:36.613096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:36.635653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbc63e-fc86-42cd-878f-8a321b922aee None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:36.681797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5bbc3-a5b5-4302-87ca-4842fe5a7eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:36.682494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5bbc3-a5b5-4302-87ca-4842fe5a7eec None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:36.682777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5bbc3-a5b5-4302-87ca-4842fe5a7eec None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:36.683054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5bbc3-a5b5-4302-87ca-4842fe5a7eec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:36.703838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5bbc3-a5b5-4302-87ca-4842fe5a7eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-abe5bbc3-a5b5-4302-87ca-4842fe5a7eec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:36.709014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:36.710590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:36.712976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 172/340] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:56:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:36.719289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa0842-9f40-4f6a-bfe7-b303981e6ed9 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:36.719660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa0842-9f40-4f6a-bfe7-b303981e6ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:36.719906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa0842-9f40-4f6a-bfe7-b303981e6ed9 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:36.722255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21262c-6092-4fe5-a023-e4181fd06242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:36.723186 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21262c-6092-4fe5-a023-e4181fd06242 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:36.723694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21262c-6092-4fe5-a023-e4181fd06242 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:36.724189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21262c-6092-4fe5-a023-e4181fd06242 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:36.725476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21262c-6092-4fe5-a023-e4181fd06242 None admin] RBAC: Adding query filter params (name=member) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:36.726039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21262c-6092-4fe5-a023-e4181fd06242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:36.728270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21262c-6092-4fe5-a023-e4181fd06242 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:36.730128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 173/341] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:36 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:36.731040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa0842-9f40-4f6a-bfe7-b303981e6ed9 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:36.745571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 169/342] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:36.746872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e4427-81c9-401e-aa2e-82e1fb8a35a9 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:36.747161 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e4427-81c9-401e-aa2e-82e1fb8a35a9 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:36.747442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e4427-81c9-401e-aa2e-82e1fb8a35a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:36.771831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-626e4427-81c9-401e-aa2e-82e1fb8a35a9 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:36.773094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-626e4427-81c9-401e-aa2e-82e1fb8a35a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:36.894697 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 170/343] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:36.895304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e4427-81c9-401e-aa2e-82e1fb8a35a9 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:36.974662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa0842-9f40-4f6a-bfe7-b303981e6ed9 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.025228 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:37.039909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e4427-81c9-401e-aa2e-82e1fb8a35a9 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.078526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4ebc0-8dd8-4799-aee5-c78ef11cf509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.079127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4ebc0-8dd8-4799-aee5-c78ef11cf509 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.079406 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4ebc0-8dd8-4799-aee5-c78ef11cf509 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.079678 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4ebc0-8dd8-4799-aee5-c78ef11cf509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.122799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aa90b-ef62-46a8-a712-15e3c79d9d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.123856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aa90b-ef62-46a8-a712-15e3c79d9d62 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.124331 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aa90b-ef62-46a8-a712-15e3c79d9d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.124829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aa90b-ef62-46a8-a712-15e3c79d9d62 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.126051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aa90b-ef62-46a8-a712-15e3c79d9d62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:37.126624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aa90b-ef62-46a8-a712-15e3c79d9d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:37.129078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aa90b-ef62-46a8-a712-15e3c79d9d62 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:37.158643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4ebc0-8dd8-4799-aee5-c78ef11cf509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:37.160286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 174/344] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:56:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:37.160601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4ebc0-8dd8-4799-aee5-c78ef11cf509 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:37.164060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cec143-4976-48b0-99e4-9c5075673569 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.164060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cec143-4976-48b0-99e4-9c5075673569 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.164060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cec143-4976-48b0-99e4-9c5075673569 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.165768 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 175/345] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:37.172716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0a369-5218-4ba8-89c7-e14f95ed0503 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.173199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0a369-5218-4ba8-89c7-e14f95ed0503 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.173682 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0a369-5218-4ba8-89c7-e14f95ed0503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.220751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-ada0a369-5218-4ba8-89c7-e14f95ed0503 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:37.223817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ada0a369-5218-4ba8-89c7-e14f95ed0503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:37.262931 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:37.332400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 176/346] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:37.333679 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0a369-5218-4ba8-89c7-e14f95ed0503 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.399843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:37.450728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 171/347] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:37.456154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4ebc0-8dd8-4799-aee5-c78ef11cf509 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.459753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0a369-5218-4ba8-89c7-e14f95ed0503 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.507533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df36c71-c077-45d5-a553-e970ae30b344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.508602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df36c71-c077-45d5-a553-e970ae30b344 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.509130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df36c71-c077-45d5-a553-e970ae30b344 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.509608 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df36c71-c077-45d5-a553-e970ae30b344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.542616 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:37.631939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4ebc0-8dd8-4799-aee5-c78ef11cf509 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.633720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df36c71-c077-45d5-a553-e970ae30b344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:37.635207 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df36c71-c077-45d5-a553-e970ae30b344 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:37.686808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb89e76-7bc8-4bcb-8ebe-f284fedc9c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.687836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb89e76-7bc8-4bcb-8ebe-f284fedc9c2d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.688320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb89e76-7bc8-4bcb-8ebe-f284fedc9c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.688972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb89e76-7bc8-4bcb-8ebe-f284fedc9c2d None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.690405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb89e76-7bc8-4bcb-8ebe-f284fedc9c2d None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:37.692824 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb89e76-7bc8-4bcb-8ebe-f284fedc9c2d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:37.695642 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 172/348] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:37 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:37.697933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb89e76-7bc8-4bcb-8ebe-f284fedc9c2d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.774252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 177/349] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:37.775245 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df36c71-c077-45d5-a553-e970ae30b344 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.786922 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:37.850962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb89e76-7bc8-4bcb-8ebe-f284fedc9c2d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.864179 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:37.907560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa9a10-18d7-4646-a4df-7d5df0772c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.908590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa9a10-18d7-4646-a4df-7d5df0772c57 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.909089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa9a10-18d7-4646-a4df-7d5df0772c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.909592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa9a10-18d7-4646-a4df-7d5df0772c57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.923652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa9a10-18d7-4646-a4df-7d5df0772c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:37.928144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df36c71-c077-45d5-a553-e970ae30b344 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-44fa9a10-18d7-4646-a4df-7d5df0772c57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:37.932946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:37.933893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:37.934708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:37.934708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:37.934708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:37.934708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:37.934708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:37.934708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:37.934708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:37.934708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:37.934708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:37.934708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:37.934708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:56:37.934708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:37.938028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 173/350] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:37.939814 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa9a10-18d7-4646-a4df-7d5df0772c57 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.993153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a870343-7e90-427a-92c2-03c55f52c8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.994339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a870343-7e90-427a-92c2-03c55f52c8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.994817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a870343-7e90-427a-92c2-03c55f52c8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.995321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a870343-7e90-427a-92c2-03c55f52c8f4 None admin] PATH_INFO: `/v3/groups/3ffe77cebe634b508525f8086e80cd17` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.005827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a870343-7e90-427a-92c2-03c55f52c8f4 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffe77cebe634b508525f8086e80cd17)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:38.008199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a870343-7e90-427a-92c2-03c55f52c8f4 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:38.011105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 178/351] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:37 2022] GET /identity/v3/groups/3ffe77cebe634b508525f8086e80cd17 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:38.012413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a870343-7e90-427a-92c2-03c55f52c8f4 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:38.081563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa9a10-18d7-4646-a4df-7d5df0772c57 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:38.108361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:38.131011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e930c-4357-4955-b7e6-c33a08dd0238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:38.131665 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e930c-4357-4955-b7e6-c33a08dd0238 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:38.132028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e930c-4357-4955-b7e6-c33a08dd0238 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:38.132517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e930c-4357-4955-b7e6-c33a08dd0238 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.134062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e930c-4357-4955-b7e6-c33a08dd0238 None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:38.135559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e930c-4357-4955-b7e6-c33a08dd0238 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:38.137385 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 174/352] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:37 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:38.138183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e930c-4357-4955-b7e6-c33a08dd0238 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:38.157934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a870343-7e90-427a-92c2-03c55f52c8f4 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:38.187788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:38.213509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8cc63-c710-425f-ba0e-bb37d6c0ae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:38.214265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8cc63-c710-425f-ba0e-bb37d6c0ae54 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:38.214441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8cc63-c710-425f-ba0e-bb37d6c0ae54 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:38.214700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8cc63-c710-425f-ba0e-bb37d6c0ae54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.229653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8cc63-c710-425f-ba0e-bb37d6c0ae54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-a8d8cc63-c710-425f-ba0e-bb37d6c0ae54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:38.236474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:38.237470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:38.238260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:38.238260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:38.238260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:38.238260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:38.238260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:38.238260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:38.238260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:38.238260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:38.238260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:38.238260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:38.238260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:38.238260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:38.243706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 179/353] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:38.243706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8cc63-c710-425f-ba0e-bb37d6c0ae54 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:38.299012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e930c-4357-4955-b7e6-c33a08dd0238 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:38.347750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7796d8a-56b9-4849-bcc1-8a6f5e863119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:38.348357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7796d8a-56b9-4849-bcc1-8a6f5e863119 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:38.348655 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7796d8a-56b9-4849-bcc1-8a6f5e863119 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:38.348986 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7796d8a-56b9-4849-bcc1-8a6f5e863119 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.350044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7796d8a-56b9-4849-bcc1-8a6f5e863119 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:38.350044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7796d8a-56b9-4849-bcc1-8a6f5e863119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:38.351347 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7796d8a-56b9-4849-bcc1-8a6f5e863119 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:38.365606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 175/354] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:38.367227 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f784a4-304e-47a2-94ab-a9a0ce2b8147 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:38.367467 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f784a4-304e-47a2-94ab-a9a0ce2b8147 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:38.367747 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f784a4-304e-47a2-94ab-a9a0ce2b8147 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.369641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 176/355] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:38.374723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f784a4-304e-47a2-94ab-a9a0ce2b8147 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:38.391920 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8cc63-c710-425f-ba0e-bb37d6c0ae54 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:38.439794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:38.463247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a38de5-9777-4dc0-a5ed-e8e26344ec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:38.463982 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a38de5-9777-4dc0-a5ed-e8e26344ec89 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:38.464330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a38de5-9777-4dc0-a5ed-e8e26344ec89 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:38.464704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a38de5-9777-4dc0-a5ed-e8e26344ec89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.468594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a38de5-9777-4dc0-a5ed-e8e26344ec89 None admin] RBAC: Adding query filter params (group.id=3ffe77cebe634b508525f8086e80cd17, role.id=068a24594f0b4d01aab3485c009314d4, scope.project.id=093594e09a464d69aa54068e56284d4c) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:38.468594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a38de5-9777-4dc0-a5ed-e8e26344ec89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:38.468594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a38de5-9777-4dc0-a5ed-e8e26344ec89 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:38.477105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 180/356] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Sep 7 15:56:38 2022] GET /identity/v3/role_assignments?group.id=3ffe77cebe634b508525f8086e80cd17&scope.project.id=093594e09a464d69aa54068e56284d4c&role.id=068a24594f0b4d01aab3485c009314d4 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:38.479092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a38de5-9777-4dc0-a5ed-e8e26344ec89 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:38.526264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f784a4-304e-47a2-94ab-a9a0ce2b8147 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:38.553488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:38.575455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4d95b-1ca1-4261-8579-bd76b32364dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:38.577744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4d95b-1ca1-4261-8579-bd76b32364dd None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:38.578365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4d95b-1ca1-4261-8579-bd76b32364dd None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:38.579095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4d95b-1ca1-4261-8579-bd76b32364dd None admin] PATH_INFO: `/v3/groups/3ffe77cebe634b508525f8086e80cd17` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.580930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4d95b-1ca1-4261-8579-bd76b32364dd None admin] RBAC: Authorizing `identity:get_group(group_id=3ffe77cebe634b508525f8086e80cd17)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:38.583474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4d95b-1ca1-4261-8579-bd76b32364dd None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:38.585878 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 177/357] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:38 2022] GET /identity/v3/groups/3ffe77cebe634b508525f8086e80cd17 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:38.586922 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4d95b-1ca1-4261-8579-bd76b32364dd None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:38.635879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a38de5-9777-4dc0-a5ed-e8e26344ec89 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:38.688878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a32ed-b4dc-449c-9491-75068847f6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:38.689548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a32ed-b4dc-449c-9491-75068847f6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:38.690075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a32ed-b4dc-449c-9491-75068847f6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:38.690382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a32ed-b4dc-449c-9491-75068847f6b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.691072 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a32ed-b4dc-449c-9491-75068847f6b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:38.691383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a32ed-b4dc-449c-9491-75068847f6b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:38.693941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a32ed-b4dc-449c-9491-75068847f6b5 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:38.705121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 181/358] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:38.706403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7a52-1d2a-428f-97fe-37de3a025166 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:38.706692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7a52-1d2a-428f-97fe-37de3a025166 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:38.706967 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7a52-1d2a-428f-97fe-37de3a025166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.730792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f81c7a52-1d2a-428f-97fe-37de3a025166 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:38.732540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f81c7a52-1d2a-428f-97fe-37de3a025166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:38.732856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4d95b-1ca1-4261-8579-bd76b32364dd None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:38.753598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:38.785553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482973c-0488-4f9d-bec1-113da86737dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:38.786202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482973c-0488-4f9d-bec1-113da86737dd None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:38.786586 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482973c-0488-4f9d-bec1-113da86737dd None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:38.787009 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482973c-0488-4f9d-bec1-113da86737dd None admin] PATH_INFO: `/v3/users/59d1f5c43a2c47d6b9535423645b63b6` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.788197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482973c-0488-4f9d-bec1-113da86737dd None admin] RBAC: Authorizing `identity:get_user(user_id=59d1f5c43a2c47d6b9535423645b63b6)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:38.789850 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482973c-0488-4f9d-bec1-113da86737dd None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:38.793840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 178/359] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:56:38 2022] GET /identity/v3/users/59d1f5c43a2c47d6b9535423645b63b6 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:38.793840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482973c-0488-4f9d-bec1-113da86737dd None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:38.839034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 182/360] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:38.840518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ee4c-23a0-4198-8586-ee7e0d124db4 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:38.841076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ee4c-23a0-4198-8586-ee7e0d124db4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:38.841643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ee4c-23a0-4198-8586-ee7e0d124db4 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.843797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 183/361] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:38.844538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8ee4c-23a0-4198-8586-ee7e0d124db4 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:38.896325 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:38.964562 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482973c-0488-4f9d-bec1-113da86737dd None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:38.991853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8ee4c-23a0-4198-8586-ee7e0d124db4 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:39.024836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fee2d-ee39-4754-8da5-817634dd1121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.024836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fee2d-ee39-4754-8da5-817634dd1121 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.024836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fee2d-ee39-4754-8da5-817634dd1121 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.025201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fee2d-ee39-4754-8da5-817634dd1121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.028821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fee2d-ee39-4754-8da5-817634dd1121 None admin] RBAC: Adding query filter params (group.id=3ffe77cebe634b508525f8086e80cd17, role.id=62c69ea249044f258a2a6f2138ff4ceb, scope.project.id=093594e09a464d69aa54068e56284d4c) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:39.028821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fee2d-ee39-4754-8da5-817634dd1121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:39.028821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fee2d-ee39-4754-8da5-817634dd1121 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:39.039807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 179/362] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Sep 7 15:56:38 2022] GET /identity/v3/role_assignments?group.id=3ffe77cebe634b508525f8086e80cd17&scope.project.id=093594e09a464d69aa54068e56284d4c&role.id=62c69ea249044f258a2a6f2138ff4ceb => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:39.040590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fee2d-ee39-4754-8da5-817634dd1121 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:39.045653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807813ca-2672-4872-8cf1-78f19170a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.046293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807813ca-2672-4872-8cf1-78f19170a73f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.046584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807813ca-2672-4872-8cf1-78f19170a73f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.046883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807813ca-2672-4872-8cf1-78f19170a73f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.124820 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:39.177863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807813ca-2672-4872-8cf1-78f19170a73f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:39.181007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807813ca-2672-4872-8cf1-78f19170a73f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:39.210388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fee2d-ee39-4754-8da5-817634dd1121 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:39.240870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:39.261391 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19205781-d67b-454a-aaa9-1d7c48f57105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.262181 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19205781-d67b-454a-aaa9-1d7c48f57105 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.262439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19205781-d67b-454a-aaa9-1d7c48f57105 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.262697 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19205781-d67b-454a-aaa9-1d7c48f57105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.263466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19205781-d67b-454a-aaa9-1d7c48f57105 None admin] RBAC: Adding query filter params (role.id=1084d899c92849ce9ba431f0fecfe796, user.id=59d1f5c43a2c47d6b9535423645b63b6, scope.system=all) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:39.264294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19205781-d67b-454a-aaa9-1d7c48f57105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:39.265862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19205781-d67b-454a-aaa9-1d7c48f57105 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:39.282503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 180/363] 10.222.0.43 () {56 vars in 1308 bytes} [Wed Sep 7 15:56:39 2022] GET /identity/v3/role_assignments?user.id=59d1f5c43a2c47d6b9535423645b63b6&scope.system=all&role.id=1084d899c92849ce9ba431f0fecfe796 => generated 510 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:39.283628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7ccbc-7fc7-44a2-ac88-dba5b9af772d None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.283913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7ccbc-7fc7-44a2-ac88-dba5b9af772d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.284971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7ccbc-7fc7-44a2-ac88-dba5b9af772d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.307674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c0d7ccbc-7fc7-44a2-ac88-dba5b9af772d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:39.308948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c0d7ccbc-7fc7-44a2-ac88-dba5b9af772d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:39.354106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 184/364] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:39.356215 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807813ca-2672-4872-8cf1-78f19170a73f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:39.423942 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 181/365] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:39.424564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7ccbc-7fc7-44a2-ac88-dba5b9af772d None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:39.477772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807813ca-2672-4872-8cf1-78f19170a73f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:39.489086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:39.524652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad21f78-a8a0-4829-8b3e-91e9794e8ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.525319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad21f78-a8a0-4829-8b3e-91e9794e8ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.525596 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad21f78-a8a0-4829-8b3e-91e9794e8ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.525865 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad21f78-a8a0-4829-8b3e-91e9794e8ec4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.529620 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:39.540924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad21f78-a8a0-4829-8b3e-91e9794e8ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-fad21f78-a8a0-4829-8b3e-91e9794e8ec4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:39.547366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:39.548537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:39.549564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:39.549564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:39.549564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:39.549564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:39.549564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:39.549564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:39.549564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:39.549564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:39.549564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:39.549564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:39.549564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:39.549564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:39.551775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 185/366] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:56:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:39.558243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad21f78-a8a0-4829-8b3e-91e9794e8ec4 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:39.623730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7ccbc-7fc7-44a2-ac88-dba5b9af772d None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:39.680639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55921ea-b547-4da1-8b59-d20bf5aef337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.681455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55921ea-b547-4da1-8b59-d20bf5aef337 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.683030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55921ea-b547-4da1-8b59-d20bf5aef337 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.683316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55921ea-b547-4da1-8b59-d20bf5aef337 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.684807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55921ea-b547-4da1-8b59-d20bf5aef337 None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:39.687681 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55921ea-b547-4da1-8b59-d20bf5aef337 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:39.689738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 182/367] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:39 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:39.699161 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55921ea-b547-4da1-8b59-d20bf5aef337 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:39.744883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad21f78-a8a0-4829-8b3e-91e9794e8ec4 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:39.786076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41f917-f6aa-4080-a374-19285813241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.787281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41f917-f6aa-4080-a374-19285813241a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.787768 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41f917-f6aa-4080-a374-19285813241a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.788264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41f917-f6aa-4080-a374-19285813241a None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.789188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41f917-f6aa-4080-a374-19285813241a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:39.790165 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41f917-f6aa-4080-a374-19285813241a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:39.792085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41f917-f6aa-4080-a374-19285813241a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:39.804849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 186/368] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:56:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:39.811781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41f917-f6aa-4080-a374-19285813241a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:39.848625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55921ea-b547-4da1-8b59-d20bf5aef337 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:39.850688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:39.897029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516190e-a45a-4d27-a167-159955e727e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.897927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516190e-a45a-4d27-a167-159955e727e6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.898339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516190e-a45a-4d27-a167-159955e727e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.898747 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516190e-a45a-4d27-a167-159955e727e6 None admin] PATH_INFO: `/v3/groups/3ffe77cebe634b508525f8086e80cd17` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.900359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516190e-a45a-4d27-a167-159955e727e6 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffe77cebe634b508525f8086e80cd17)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:39.902693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516190e-a45a-4d27-a167-159955e727e6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:39.903443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:39.907646 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 183/369] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:39 2022] GET /identity/v3/groups/3ffe77cebe634b508525f8086e80cd17 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:39.915094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516190e-a45a-4d27-a167-159955e727e6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:39.963743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41f917-f6aa-4080-a374-19285813241a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:40.017270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d27671-7096-4654-a79d-326b83a7db15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:40.018187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d27671-7096-4654-a79d-326b83a7db15 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.018770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d27671-7096-4654-a79d-326b83a7db15 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.019050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d27671-7096-4654-a79d-326b83a7db15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.062370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516190e-a45a-4d27-a167-159955e727e6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:40.114163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75519ebf-88ad-408a-8d67-d34d370b3bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:40.115280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75519ebf-88ad-408a-8d67-d34d370b3bdf None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.115783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75519ebf-88ad-408a-8d67-d34d370b3bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.116234 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75519ebf-88ad-408a-8d67-d34d370b3bdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.117516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75519ebf-88ad-408a-8d67-d34d370b3bdf None admin] RBAC: Adding query filter params (group.id=3ffe77cebe634b508525f8086e80cd17, role.id=068a24594f0b4d01aab3485c009314d4, scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:40.118029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75519ebf-88ad-408a-8d67-d34d370b3bdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:40.120573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75519ebf-88ad-408a-8d67-d34d370b3bdf None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:40.121132 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d27671-7096-4654-a79d-326b83a7db15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:40.122747 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d27671-7096-4654-a79d-326b83a7db15 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:40.134966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 184/370] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Sep 7 15:56:39 2022] GET /identity/v3/role_assignments?group.id=3ffe77cebe634b508525f8086e80cd17&scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c&role.id=068a24594f0b4d01aab3485c009314d4 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:40.136078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75519ebf-88ad-408a-8d67-d34d370b3bdf None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:40.181659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:40.209467 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:40.272470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 187/371] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:40.274755 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75519ebf-88ad-408a-8d67-d34d370b3bdf None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:40.279490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d27671-7096-4654-a79d-326b83a7db15 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:40.322827 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762a43a-23de-4277-8fa4-0084f1de52ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:40.324153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762a43a-23de-4277-8fa4-0084f1de52ed None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.324778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762a43a-23de-4277-8fa4-0084f1de52ed None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.325200 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762a43a-23de-4277-8fa4-0084f1de52ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.340456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762a43a-23de-4277-8fa4-0084f1de52ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-2762a43a-23de-4277-8fa4-0084f1de52ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:40.348122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:40.350363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:40.351354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:40.351354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:40.351354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:40.351354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:40.351354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:40.351354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:40.351354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:40.351354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:40.351354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:40.351354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:40.351354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:40.351354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:40.353988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 185/372] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:56:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:40.360513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762a43a-23de-4277-8fa4-0084f1de52ed None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:40.442904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d27671-7096-4654-a79d-326b83a7db15 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:40.504107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:40.512807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762a43a-23de-4277-8fa4-0084f1de52ed None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:40.542907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a89a-3241-4893-91c7-09d8d5630a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:40.543507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a89a-3241-4893-91c7-09d8d5630a60 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.543787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a89a-3241-4893-91c7-09d8d5630a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.544058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a89a-3241-4893-91c7-09d8d5630a60 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.549968 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7a89a-3241-4893-91c7-09d8d5630a60 None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:40.551171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7a89a-3241-4893-91c7-09d8d5630a60 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:40.553254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 188/373] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:40 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:40.559209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50109121-132e-4497-ab11-7c02d9112418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:40.559515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a89a-3241-4893-91c7-09d8d5630a60 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:40.560526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50109121-132e-4497-ab11-7c02d9112418 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.561745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50109121-132e-4497-ab11-7c02d9112418 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.562239 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50109121-132e-4497-ab11-7c02d9112418 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.563121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50109121-132e-4497-ab11-7c02d9112418 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:40.563644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50109121-132e-4497-ab11-7c02d9112418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:40.565284 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50109121-132e-4497-ab11-7c02d9112418 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:40.577280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 186/374] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:40.584318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50109121-132e-4497-ab11-7c02d9112418 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:40.626436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:40.759322 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50109121-132e-4497-ab11-7c02d9112418 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:40.804774 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a89a-3241-4893-91c7-09d8d5630a60 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:40.806215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799fac6-1db5-44a1-8348-c9d803a98ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:40.807058 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799fac6-1db5-44a1-8348-c9d803a98ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.807553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799fac6-1db5-44a1-8348-c9d803a98ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.808020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799fac6-1db5-44a1-8348-c9d803a98ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.841437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:40.902018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799fac6-1db5-44a1-8348-c9d803a98ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:40.906347 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799fac6-1db5-44a1-8348-c9d803a98ee9 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:40.909479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cb5d8-5de9-44eb-b297-8fb51a0333d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:40.910295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cb5d8-5de9-44eb-b297-8fb51a0333d3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.910461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cb5d8-5de9-44eb-b297-8fb51a0333d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.910696 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cb5d8-5de9-44eb-b297-8fb51a0333d3 None admin] PATH_INFO: `/v3/groups/3ffe77cebe634b508525f8086e80cd17` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.913399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cb5d8-5de9-44eb-b297-8fb51a0333d3 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffe77cebe634b508525f8086e80cd17)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:40.914616 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cb5d8-5de9-44eb-b297-8fb51a0333d3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:40.916515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 189/375] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:40 2022] GET /identity/v3/groups/3ffe77cebe634b508525f8086e80cd17 => generated 226 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:40.924194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cb5d8-5de9-44eb-b297-8fb51a0333d3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:41.057004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 187/376] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:41.065891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799fac6-1db5-44a1-8348-c9d803a98ee9 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:41.142754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:41.160608 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:41.174959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cb5d8-5de9-44eb-b297-8fb51a0333d3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:41.220659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799fac6-1db5-44a1-8348-c9d803a98ee9 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:41.256122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ff76b-b0d9-41c8-aa1f-0f013df11896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:41.257147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ff76b-b0d9-41c8-aa1f-0f013df11896 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.257647 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ff76b-b0d9-41c8-aa1f-0f013df11896 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.258124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ff76b-b0d9-41c8-aa1f-0f013df11896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.259290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ff76b-b0d9-41c8-aa1f-0f013df11896 None admin] RBAC: Adding query filter params (group.id=3ffe77cebe634b508525f8086e80cd17, role.id=62c69ea249044f258a2a6f2138ff4ceb, scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:41.259819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ff76b-b0d9-41c8-aa1f-0f013df11896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:41.264388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ff76b-b0d9-41c8-aa1f-0f013df11896 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:41.278027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 190/377] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Sep 7 15:56:40 2022] GET /identity/v3/role_assignments?group.id=3ffe77cebe634b508525f8086e80cd17&scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c&role.id=62c69ea249044f258a2a6f2138ff4ceb => generated 260 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:41.296957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab575ff-d18c-4d6e-b65b-76863105afa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:41.298380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab575ff-d18c-4d6e-b65b-76863105afa6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.299078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab575ff-d18c-4d6e-b65b-76863105afa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.299774 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab575ff-d18c-4d6e-b65b-76863105afa6 None admin] PATH_INFO: `/v3/projects/fca4039aaacb4eb6975387ddf331698c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.301865 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab575ff-d18c-4d6e-b65b-76863105afa6 None admin] RBAC: Authorizing `identity:get_project(project_id=fca4039aaacb4eb6975387ddf331698c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:41.304360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab575ff-d18c-4d6e-b65b-76863105afa6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:41.307930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 188/378] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:41 2022] GET /identity/v3/projects/fca4039aaacb4eb6975387ddf331698c => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:41.313934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ff76b-b0d9-41c8-aa1f-0f013df11896 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:41.454277 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ff76b-b0d9-41c8-aa1f-0f013df11896 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:41.500361 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968d9d1-80e9-4f85-8d41-84d20c2dc752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:41.501434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968d9d1-80e9-4f85-8d41-84d20c2dc752 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.501986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968d9d1-80e9-4f85-8d41-84d20c2dc752 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.502451 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968d9d1-80e9-4f85-8d41-84d20c2dc752 None admin] PATH_INFO: `/v3/groups/0cccd63778944d54932ac84453229755` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.508393 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968d9d1-80e9-4f85-8d41-84d20c2dc752 None admin] RBAC: Authorizing `identity:get_group(group_id=0cccd63778944d54932ac84453229755)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:41.510161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968d9d1-80e9-4f85-8d41-84d20c2dc752 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:41.512379 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 191/379] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:41 2022] GET /identity/v3/groups/0cccd63778944d54932ac84453229755 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:41.519146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab575ff-d18c-4d6e-b65b-76863105afa6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:41.645752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab575ff-d18c-4d6e-b65b-76863105afa6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:41.689105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:41.702845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c05ded-cddb-427e-bbe5-8d49da740516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:41.703476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c05ded-cddb-427e-bbe5-8d49da740516 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.703879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c05ded-cddb-427e-bbe5-8d49da740516 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.704250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c05ded-cddb-427e-bbe5-8d49da740516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.705100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c05ded-cddb-427e-bbe5-8d49da740516 None admin] RBAC: Adding query filter params (group.id=0cccd63778944d54932ac84453229755, role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=fca4039aaacb4eb6975387ddf331698c) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:41.705413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c05ded-cddb-427e-bbe5-8d49da740516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:41.707198 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c05ded-cddb-427e-bbe5-8d49da740516 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:41.714410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 189/380] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Sep 7 15:56:41 2022] GET /identity/v3/role_assignments?group.id=0cccd63778944d54932ac84453229755&scope.project.id=fca4039aaacb4eb6975387ddf331698c&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:41.774105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4e418-8514-45f6-bb8d-ecfcba1135ee None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.774483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4e418-8514-45f6-bb8d-ecfcba1135ee None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.774692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4e418-8514-45f6-bb8d-ecfcba1135ee None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.776297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 192/381] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:41.783174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d47be-4320-4898-a961-3dbe4405e4e3 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.783586 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d47be-4320-4898-a961-3dbe4405e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.783946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d47be-4320-4898-a961-3dbe4405e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.807170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8e7d47be-4320-4898-a961-3dbe4405e4e3 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:41.809002 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8e7d47be-4320-4898-a961-3dbe4405e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:41.919779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 190/382] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:42.377856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4e418-8514-45f6-bb8d-ecfcba1135ee None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:42.419220 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:42.555160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4e418-8514-45f6-bb8d-ecfcba1135ee None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:42.562264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc195f-4792-4ec7-b8b4-56ce498989a2 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:42.562586 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc195f-4792-4ec7-b8b4-56ce498989a2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:42.562848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc195f-4792-4ec7-b8b4-56ce498989a2 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:42.564226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 191/383] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:56:42.570410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4194d-94d8-4704-a260-d724659adcd2 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:42.571027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4194d-94d8-4704-a260-d724659adcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:42.571508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4194d-94d8-4704-a260-d724659adcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:42.602991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-77d4194d-94d8-4704-a260-d724659adcd2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:42.606133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-77d4194d-94d8-4704-a260-d724659adcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:42.639886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961598b-d823-4c8c-ab35-daeebb41bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:42.641571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961598b-d823-4c8c-ab35-daeebb41bef6 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:42.644131 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961598b-d823-4c8c-ab35-daeebb41bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:42.644639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961598b-d823-4c8c-ab35-daeebb41bef6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:42.669320 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961598b-d823-4c8c-ab35-daeebb41bef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-6961598b-d823-4c8c-ab35-daeebb41bef6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:42.676357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:42.677641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:42.678691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:42.678691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:42.678691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:42.678691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:42.678691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:42.678691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:42.678691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:42.678691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:42.678691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:42.678691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:42.678691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:42.678691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:42.682466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 193/384] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:42.694326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961598b-d823-4c8c-ab35-daeebb41bef6 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:42.787176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 192/385] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:42.848718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:42.858512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961598b-d823-4c8c-ab35-daeebb41bef6 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:42.906880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f8703-6e62-4c98-a640-ae3b707b42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:42.907894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f8703-6e62-4c98-a640-ae3b707b42bc None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:42.908379 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f8703-6e62-4c98-a640-ae3b707b42bc None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:42.908888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f8703-6e62-4c98-a640-ae3b707b42bc None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:42.909851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f8703-6e62-4c98-a640-ae3b707b42bc None admin] RBAC: Adding query filter params (name=member) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:42.910368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f8703-6e62-4c98-a640-ae3b707b42bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:42.912127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f8703-6e62-4c98-a640-ae3b707b42bc None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:42.924014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 194/386] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:42.931446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4194d-94d8-4704-a260-d724659adcd2 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:43.017209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:43.104134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4194d-94d8-4704-a260-d724659adcd2 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:43.145680 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1875796-35d0-41e8-8aca-4761024ed50b None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.146295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1875796-35d0-41e8-8aca-4761024ed50b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.146779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1875796-35d0-41e8-8aca-4761024ed50b None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.148309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 195/387] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:43.156534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea10911-a209-4af2-8313-c5e5dcb1dcc1 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.157241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea10911-a209-4af2-8313-c5e5dcb1dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.157461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea10911-a209-4af2-8313-c5e5dcb1dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.158793 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fa2d8-4040-4672-a8ed-892ad8e5a443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:43.159481 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fa2d8-4040-4672-a8ed-892ad8e5a443 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.159762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fa2d8-4040-4672-a8ed-892ad8e5a443 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.160098 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fa2d8-4040-4672-a8ed-892ad8e5a443 None admin] PATH_INFO: `/v3/groups/3ffe77cebe634b508525f8086e80cd17` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.165764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fa2d8-4040-4672-a8ed-892ad8e5a443 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffe77cebe634b508525f8086e80cd17)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:43.167325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fa2d8-4040-4672-a8ed-892ad8e5a443 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:43.169428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 193/388] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:42 2022] GET /identity/v3/groups/3ffe77cebe634b508525f8086e80cd17 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:43.176086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fa2d8-4040-4672-a8ed-892ad8e5a443 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:43.206024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-fea10911-a209-4af2-8313-c5e5dcb1dcc1 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:43.209077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-fea10911-a209-4af2-8313-c5e5dcb1dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:43.347430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 196/389] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:43.348787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea10911-a209-4af2-8313-c5e5dcb1dcc1 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:43.374391 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fa2d8-4040-4672-a8ed-892ad8e5a443 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:43.406050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:43.434430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c164-a1b9-46ca-b5cc-72804e877d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:43.435090 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c164-a1b9-46ca-b5cc-72804e877d88 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.435919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c164-a1b9-46ca-b5cc-72804e877d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.436194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c164-a1b9-46ca-b5cc-72804e877d88 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.438598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6c164-a1b9-46ca-b5cc-72804e877d88 None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:43.440236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6c164-a1b9-46ca-b5cc-72804e877d88 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:43.442114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 194/390] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:43 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:43.448864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c164-a1b9-46ca-b5cc-72804e877d88 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:43.491751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:43.572512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea10911-a209-4af2-8313-c5e5dcb1dcc1 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:43.598440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c164-a1b9-46ca-b5cc-72804e877d88 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:43.637183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3a069-0562-4487-93ca-8d208fcee156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:43.637916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3a069-0562-4487-93ca-8d208fcee156 None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.638202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3a069-0562-4487-93ca-8d208fcee156 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.639003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3a069-0562-4487-93ca-8d208fcee156 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c/groups/3ffe77cebe634b508525f8086e80cd17/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.648756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3a069-0562-4487-93ca-8d208fcee156 None admin] RBAC: Authorizing `identity:create_grant(project_id=093594e09a464d69aa54068e56284d4c, group_id=3ffe77cebe634b508525f8086e80cd17, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:43.648756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3a069-0562-4487-93ca-8d208fcee156 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:43.662217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 195/391] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Sep 7 15:56:43 2022] PUT /identity/v3/projects/093594e09a464d69aa54068e56284d4c/groups/3ffe77cebe634b508525f8086e80cd17/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:43.675904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5317501-0b47-43b0-9ddc-73a609934a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:43.677251 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5317501-0b47-43b0-9ddc-73a609934a75 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.677941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5317501-0b47-43b0-9ddc-73a609934a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.678773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5317501-0b47-43b0-9ddc-73a609934a75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.701973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5317501-0b47-43b0-9ddc-73a609934a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-b5317501-0b47-43b0-9ddc-73a609934a75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:43.709211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:43.710346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:43.711270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:43.711270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:43.711270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:43.711270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:43.711270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:43.711270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:43.711270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:43.711270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:43.711270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:43.711270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:43.711270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:43.711270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:43.713508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 197/392] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:56:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:43.723901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3a069-0562-4487-93ca-8d208fcee156 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:43.798560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:43.875866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3a069-0562-4487-93ca-8d208fcee156 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:43.927167 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7e077-ef02-4343-8d30-22432e490eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:43.927800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e077-ef02-4343-8d30-22432e490eee None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.928081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e077-ef02-4343-8d30-22432e490eee None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.928361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e077-ef02-4343-8d30-22432e490eee None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.929070 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7e077-ef02-4343-8d30-22432e490eee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:43.929377 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7e077-ef02-4343-8d30-22432e490eee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:43.930781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7e077-ef02-4343-8d30-22432e490eee None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:43.940906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 196/393] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:56:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:43.949781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5317501-0b47-43b0-9ddc-73a609934a75 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:43.976214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7e077-ef02-4343-8d30-22432e490eee None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.096105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5317501-0b47-43b0-9ddc-73a609934a75 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:44.160612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92549d9-a42c-41ac-ae92-777493195a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:44.161721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92549d9-a42c-41ac-ae92-777493195a72 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.162201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92549d9-a42c-41ac-ae92-777493195a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.162663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92549d9-a42c-41ac-ae92-777493195a72 None admin] PATH_INFO: `/v3/groups/3ffe77cebe634b508525f8086e80cd17` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.163994 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92549d9-a42c-41ac-ae92-777493195a72 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffe77cebe634b508525f8086e80cd17)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:44.164524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7e077-ef02-4343-8d30-22432e490eee None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:44.166055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92549d9-a42c-41ac-ae92-777493195a72 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:44.168228 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 198/394] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:43 2022] GET /identity/v3/groups/3ffe77cebe634b508525f8086e80cd17 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:44.172127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:44.175513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92549d9-a42c-41ac-ae92-777493195a72 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.178730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:44.205811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83396d-3baa-4270-ad62-715587f0d923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:44.206472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83396d-3baa-4270-ad62-715587f0d923 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.206755 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83396d-3baa-4270-ad62-715587f0d923 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.207037 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83396d-3baa-4270-ad62-715587f0d923 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.218777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83396d-3baa-4270-ad62-715587f0d923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-dc83396d-3baa-4270-ad62-715587f0d923 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:44.223817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:44.224713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:44.225519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 197/395] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:56:44.247233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83396d-3baa-4270-ad62-715587f0d923 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.297268 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92549d9-a42c-41ac-ae92-777493195a72 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:44.332523 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf9e70-db69-4458-a76a-f6ace0c1e994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:44.333479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf9e70-db69-4458-a76a-f6ace0c1e994 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.333931 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf9e70-db69-4458-a76a-f6ace0c1e994 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.334370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf9e70-db69-4458-a76a-f6ace0c1e994 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.335660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf9e70-db69-4458-a76a-f6ace0c1e994 None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:44.337362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf9e70-db69-4458-a76a-f6ace0c1e994 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:44.339491 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 199/396] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:44 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:44.345898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf9e70-db69-4458-a76a-f6ace0c1e994 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.419639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:44.450626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf9e70-db69-4458-a76a-f6ace0c1e994 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:44.487508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd13334-0e15-4b03-88c3-4ce1cc63b956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:44.488496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd13334-0e15-4b03-88c3-4ce1cc63b956 None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.488973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd13334-0e15-4b03-88c3-4ce1cc63b956 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.489422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd13334-0e15-4b03-88c3-4ce1cc63b956 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c/groups/3ffe77cebe634b508525f8086e80cd17/roles/62c69ea249044f258a2a6f2138ff4ceb` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.491824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd13334-0e15-4b03-88c3-4ce1cc63b956 None admin] RBAC: Authorizing `identity:create_grant(project_id=093594e09a464d69aa54068e56284d4c, group_id=3ffe77cebe634b508525f8086e80cd17, role_id=62c69ea249044f258a2a6f2138ff4ceb)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:44.493985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd13334-0e15-4b03-88c3-4ce1cc63b956 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:44.495894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83396d-3baa-4270-ad62-715587f0d923 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:44.519722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 200/397] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Sep 7 15:56:44 2022] PUT /identity/v3/projects/093594e09a464d69aa54068e56284d4c/groups/3ffe77cebe634b508525f8086e80cd17/roles/62c69ea249044f258a2a6f2138ff4ceb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:44.553087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958f1a4-9a02-414c-8db5-bd13d2c34ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:44.553997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958f1a4-9a02-414c-8db5-bd13d2c34ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.554479 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958f1a4-9a02-414c-8db5-bd13d2c34ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.554922 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958f1a4-9a02-414c-8db5-bd13d2c34ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.555768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958f1a4-9a02-414c-8db5-bd13d2c34ed4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:44.556240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958f1a4-9a02-414c-8db5-bd13d2c34ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:44.562508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958f1a4-9a02-414c-8db5-bd13d2c34ed4 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:44.572015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 198/398] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:44.578157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd13334-0e15-4b03-88c3-4ce1cc63b956 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.707559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd13334-0e15-4b03-88c3-4ce1cc63b956 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:44.741517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:44.758602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061dc2e-5850-45aa-8fcf-85a271434f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:44.759313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061dc2e-5850-45aa-8fcf-85a271434f08 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.759603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061dc2e-5850-45aa-8fcf-85a271434f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.759877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061dc2e-5850-45aa-8fcf-85a271434f08 None admin] PATH_INFO: `/v3/groups/3ffe77cebe634b508525f8086e80cd17` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.761073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061dc2e-5850-45aa-8fcf-85a271434f08 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffe77cebe634b508525f8086e80cd17)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:44.762512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061dc2e-5850-45aa-8fcf-85a271434f08 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:44.764473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 201/399] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:44 2022] GET /identity/v3/groups/3ffe77cebe634b508525f8086e80cd17 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:44.770525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958f1a4-9a02-414c-8db5-bd13d2c34ed4 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.805781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:44.889213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958f1a4-9a02-414c-8db5-bd13d2c34ed4 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:44.926705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecfcd9-e286-478e-bc1e-1453fe5ecaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:44.927364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecfcd9-e286-478e-bc1e-1453fe5ecaed None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.927918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecfcd9-e286-478e-bc1e-1453fe5ecaed None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.928198 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecfcd9-e286-478e-bc1e-1453fe5ecaed None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.929427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecfcd9-e286-478e-bc1e-1453fe5ecaed None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:44.930863 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecfcd9-e286-478e-bc1e-1453fe5ecaed None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:44.932794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 199/400] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:44 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:44.939287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061dc2e-5850-45aa-8fcf-85a271434f08 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.999319 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250ddae-283a-4676-b2a2-535c61d4ddcf None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.000146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250ddae-283a-4676-b2a2-535c61d4ddcf None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.000146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250ddae-283a-4676-b2a2-535c61d4ddcf None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.001229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 200/401] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:45.009456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129c89-3300-46dc-9d41-32e693cfa636 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.010213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129c89-3300-46dc-9d41-32e693cfa636 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.010685 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129c89-3300-46dc-9d41-32e693cfa636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.048271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-73129c89-3300-46dc-9d41-32e693cfa636 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:45.051441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-73129c89-3300-46dc-9d41-32e693cfa636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:45.119904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061dc2e-5850-45aa-8fcf-85a271434f08 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:45.161478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 201/402] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:45.185657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19320b-ff67-41cd-a1c4-fc12c48e48ed None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.186162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19320b-ff67-41cd-a1c4-fc12c48e48ed None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.186733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19320b-ff67-41cd-a1c4-fc12c48e48ed None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.188494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 202/403] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:45.194843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945747f-89ae-4cda-b34d-74f149110355 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.195401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945747f-89ae-4cda-b34d-74f149110355 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.195921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945747f-89ae-4cda-b34d-74f149110355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.205433 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372223a9-ba73-44f2-8308-4d9593ed9b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:45.206090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372223a9-ba73-44f2-8308-4d9593ed9b2d None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.206375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372223a9-ba73-44f2-8308-4d9593ed9b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.206676 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372223a9-ba73-44f2-8308-4d9593ed9b2d None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c/groups/3ffe77cebe634b508525f8086e80cd17/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.214143 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372223a9-ba73-44f2-8308-4d9593ed9b2d None admin] RBAC: Authorizing `identity:create_grant(project_id=6d12476fe55f430f8bd612ca6d4acc7c, group_id=3ffe77cebe634b508525f8086e80cd17, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:45.216513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372223a9-ba73-44f2-8308-4d9593ed9b2d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:45.220486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-d945747f-89ae-4cda-b34d-74f149110355 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:45.222147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d945747f-89ae-4cda-b34d-74f149110355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:45.246521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:45.276843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 202/404] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Sep 7 15:56:44 2022] PUT /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c/groups/3ffe77cebe634b508525f8086e80cd17/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:45.326828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 203/405] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:45.491655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372223a9-ba73-44f2-8308-4d9593ed9b2d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:45.575059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:45.637328 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372223a9-ba73-44f2-8308-4d9593ed9b2d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:45.678172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f44a93-d854-417a-8eee-4c7a2801d5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:45.679152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f44a93-d854-417a-8eee-4c7a2801d5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.679650 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f44a93-d854-417a-8eee-4c7a2801d5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.680112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f44a93-d854-417a-8eee-4c7a2801d5a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.691897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945747f-89ae-4cda-b34d-74f149110355 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:45.693699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f44a93-d854-417a-8eee-4c7a2801d5a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-f8f44a93-d854-417a-8eee-4c7a2801d5a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:45.699078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:45.699962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:45.700788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:45.700788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:45.700788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:45.700788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:45.700788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:45.700788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:45.700788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:45.700788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:45.700788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:45.700788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:45.700788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:45.700788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:45.703422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 203/406] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:56:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:45.709978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f44a93-d854-417a-8eee-4c7a2801d5a0 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:45.807797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945747f-89ae-4cda-b34d-74f149110355 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:45.825906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f44a93-d854-417a-8eee-4c7a2801d5a0 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:45.846471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b1eb6-c541-4bd4-8a22-77561c9308e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:45.847154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b1eb6-c541-4bd4-8a22-77561c9308e2 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.847435 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b1eb6-c541-4bd4-8a22-77561c9308e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.847704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b1eb6-c541-4bd4-8a22-77561c9308e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.852666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:45.869095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668f61e-0379-454c-a098-111d659454d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:45.870080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668f61e-0379-454c-a098-111d659454d2 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.870526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668f61e-0379-454c-a098-111d659454d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.871049 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668f61e-0379-454c-a098-111d659454d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.872165 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668f61e-0379-454c-a098-111d659454d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:45.872661 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668f61e-0379-454c-a098-111d659454d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:45.873110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b1eb6-c541-4bd4-8a22-77561c9308e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:45.874714 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668f61e-0379-454c-a098-111d659454d2 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-233b1eb6-c541-4bd4-8a22-77561c9308e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:45.878375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:45.879275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:45.880071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:45.880071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:45.880071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:45.880071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:45.880071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:45.880071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:45.880071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:45.880071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:45.880071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:45.880071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:45.880071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:45.880071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:45.882564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 204/407] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:56:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:45.889244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b1eb6-c541-4bd4-8a22-77561c9308e2 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:45.906982 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 204/408] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:56:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:45.913335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:45.913714 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668f61e-0379-454c-a098-111d659454d2 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.022345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b1eb6-c541-4bd4-8a22-77561c9308e2 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.074413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668f61e-0379-454c-a098-111d659454d2 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.118499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272393e-8a54-48b7-9bc1-f9ce62d7c6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.119267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272393e-8a54-48b7-9bc1-f9ce62d7c6ab None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.119559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272393e-8a54-48b7-9bc1-f9ce62d7c6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.119836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272393e-8a54-48b7-9bc1-f9ce62d7c6ab None admin] PATH_INFO: `/v3/groups/3ffe77cebe634b508525f8086e80cd17` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.121320 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272393e-8a54-48b7-9bc1-f9ce62d7c6ab None admin] RBAC: Authorizing `identity:get_group(group_id=3ffe77cebe634b508525f8086e80cd17)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.122823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272393e-8a54-48b7-9bc1-f9ce62d7c6ab None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.125554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 205/409] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:45 2022] GET /identity/v3/groups/3ffe77cebe634b508525f8086e80cd17 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:46.131538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272393e-8a54-48b7-9bc1-f9ce62d7c6ab None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.161830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c10e75-f63a-4e8e-90a8-8188245d003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.168716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c10e75-f63a-4e8e-90a8-8188245d003b None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.168716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c10e75-f63a-4e8e-90a8-8188245d003b None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.168716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c10e75-f63a-4e8e-90a8-8188245d003b None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.168716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c10e75-f63a-4e8e-90a8-8188245d003b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:46.168716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c10e75-f63a-4e8e-90a8-8188245d003b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.168716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c10e75-f63a-4e8e-90a8-8188245d003b None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.180944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 205/410] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:46.188804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c10e75-f63a-4e8e-90a8-8188245d003b None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.286380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:46.329115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:46.347552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c10e75-f63a-4e8e-90a8-8188245d003b None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.407113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272393e-8a54-48b7-9bc1-f9ce62d7c6ab None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.413126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d330bb-c439-4eb0-ab85-cd4d921201ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.413723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d330bb-c439-4eb0-ab85-cd4d921201ca None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.414004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d330bb-c439-4eb0-ab85-cd4d921201ca None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.414288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d330bb-c439-4eb0-ab85-cd4d921201ca None admin] PATH_INFO: `/v3/groups/0cccd63778944d54932ac84453229755` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.420705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d330bb-c439-4eb0-ab85-cd4d921201ca None admin] RBAC: Authorizing `identity:get_group(group_id=0cccd63778944d54932ac84453229755)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.420705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d330bb-c439-4eb0-ab85-cd4d921201ca None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.421397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 206/411] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:46 2022] GET /identity/v3/groups/0cccd63778944d54932ac84453229755 => generated 229 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:46.430831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d330bb-c439-4eb0-ab85-cd4d921201ca None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.491169 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374ce21-a288-4403-86c4-27937a46f504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.491810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374ce21-a288-4403-86c4-27937a46f504 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.492088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374ce21-a288-4403-86c4-27937a46f504 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.492359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374ce21-a288-4403-86c4-27937a46f504 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.493662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374ce21-a288-4403-86c4-27937a46f504 None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.495093 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374ce21-a288-4403-86c4-27937a46f504 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 206/412] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:46 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:46.504256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374ce21-a288-4403-86c4-27937a46f504 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.642434 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d330bb-c439-4eb0-ab85-cd4d921201ca None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.692741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374ce21-a288-4403-86c4-27937a46f504 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.696444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb4a1-7fa0-4d22-a3bb-37abec220a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.697117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb4a1-7fa0-4d22-a3bb-37abec220a06 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.697402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb4a1-7fa0-4d22-a3bb-37abec220a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.697677 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb4a1-7fa0-4d22-a3bb-37abec220a06 None admin] PATH_INFO: `/v3/projects/fca4039aaacb4eb6975387ddf331698c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.698827 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acb4a1-7fa0-4d22-a3bb-37abec220a06 None admin] RBAC: Authorizing `identity:get_project(project_id=fca4039aaacb4eb6975387ddf331698c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.700737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acb4a1-7fa0-4d22-a3bb-37abec220a06 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.703825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 207/413] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:46 2022] GET /identity/v3/projects/fca4039aaacb4eb6975387ddf331698c => generated 344 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:46.705145 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45348-3f3d-4007-a753-6ec352ab58be None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.705435 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45348-3f3d-4007-a753-6ec352ab58be None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.705713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45348-3f3d-4007-a753-6ec352ab58be None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.706937 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 208/414] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:46.712418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b45348-3f3d-4007-a753-6ec352ab58be None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.718861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:46.733098 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:46.740961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6010a0-fdbe-411c-82d9-8e04599a82c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.741988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6010a0-fdbe-411c-82d9-8e04599a82c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.742411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6010a0-fdbe-411c-82d9-8e04599a82c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.742857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6010a0-fdbe-411c-82d9-8e04599a82c1 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c/groups/3ffe77cebe634b508525f8086e80cd17/roles/62c69ea249044f258a2a6f2138ff4ceb` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.745387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6010a0-fdbe-411c-82d9-8e04599a82c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d12476fe55f430f8bd612ca6d4acc7c, group_id=3ffe77cebe634b508525f8086e80cd17, role_id=62c69ea249044f258a2a6f2138ff4ceb)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.746978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6010a0-fdbe-411c-82d9-8e04599a82c1 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.767397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 207/415] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Sep 7 15:56:46 2022] PUT /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c/groups/3ffe77cebe634b508525f8086e80cd17/roles/62c69ea249044f258a2a6f2138ff4ceb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:46.769589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57390e-f1ff-4ea1-b144-24bcd6b66068 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.770291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57390e-f1ff-4ea1-b144-24bcd6b66068 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.770802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57390e-f1ff-4ea1-b144-24bcd6b66068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.800279 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-3a57390e-f1ff-4ea1-b144-24bcd6b66068 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:46.801835 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3a57390e-f1ff-4ea1-b144-24bcd6b66068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:46.844650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b45348-3f3d-4007-a753-6ec352ab58be None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.892865 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 208/416] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:46.896781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f4b9b-6bdd-4064-ba2e-0a30d6b94a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.897688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f4b9b-6bdd-4064-ba2e-0a30d6b94a9c None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.898195 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f4b9b-6bdd-4064-ba2e-0a30d6b94a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.898680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f4b9b-6bdd-4064-ba2e-0a30d6b94a9c None admin] PATH_INFO: `/v3/projects/fca4039aaacb4eb6975387ddf331698c/groups/0cccd63778944d54932ac84453229755/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.900974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f4b9b-6bdd-4064-ba2e-0a30d6b94a9c None admin] RBAC: Authorizing `identity:create_grant(project_id=fca4039aaacb4eb6975387ddf331698c, group_id=0cccd63778944d54932ac84453229755, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.902625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f4b9b-6bdd-4064-ba2e-0a30d6b94a9c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.923904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 209/417] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Sep 7 15:56:46 2022] PUT /identity/v3/projects/fca4039aaacb4eb6975387ddf331698c/groups/0cccd63778944d54932ac84453229755/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:47.218304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57390e-f1ff-4ea1-b144-24bcd6b66068 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.364270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57390e-f1ff-4ea1-b144-24bcd6b66068 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.372406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:47.403798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eebbc3-0b98-4e49-9fbd-d6a6bb8ccf15 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.404383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eebbc3-0b98-4e49-9fbd-d6a6bb8ccf15 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.408694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eebbc3-0b98-4e49-9fbd-d6a6bb8ccf15 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.414464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 210/418] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:47.416260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec7b58-8bf5-41eb-9da7-58bbe7e6f65f None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.416732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec7b58-8bf5-41eb-9da7-58bbe7e6f65f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.417025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec7b58-8bf5-41eb-9da7-58bbe7e6f65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.419000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226616d-d7be-46bc-ae28-ec6414990bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.420152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226616d-d7be-46bc-ae28-ec6414990bce None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.420409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226616d-d7be-46bc-ae28-ec6414990bce None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.421096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226616d-d7be-46bc-ae28-ec6414990bce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.436985 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-00ec7b58-8bf5-41eb-9da7-58bbe7e6f65f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:47.438319 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-00ec7b58-8bf5-41eb-9da7-58bbe7e6f65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:47.442980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226616d-d7be-46bc-ae28-ec6414990bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-6226616d-d7be-46bc-ae28-ec6414990bce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:47.447955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:47.448936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:47.449770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 209/419] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:47.455536 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226616d-d7be-46bc-ae28-ec6414990bce None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.580583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 211/420] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:47.594523 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226616d-d7be-46bc-ae28-ec6414990bce None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.630574 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3afa0-fea3-4c95-a2df-ccbcf7ec68ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.631096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3afa0-fea3-4c95-a2df-ccbcf7ec68ec None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.631373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3afa0-fea3-4c95-a2df-ccbcf7ec68ec None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.631641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3afa0-fea3-4c95-a2df-ccbcf7ec68ec None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.632304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3afa0-fea3-4c95-a2df-ccbcf7ec68ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:47.632603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3afa0-fea3-4c95-a2df-ccbcf7ec68ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.633991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3afa0-fea3-4c95-a2df-ccbcf7ec68ec None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.644119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 210/421] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:47.649785 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec7b58-8bf5-41eb-9da7-58bbe7e6f65f None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.655228 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:47.761783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec7b58-8bf5-41eb-9da7-58bbe7e6f65f None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.799130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14839b85-d98d-4c3b-a811-622b99ef223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.799754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14839b85-d98d-4c3b-a811-622b99ef223b None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.800078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14839b85-d98d-4c3b-a811-622b99ef223b None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.800354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14839b85-d98d-4c3b-a811-622b99ef223b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.873422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14839b85-d98d-4c3b-a811-622b99ef223b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.874891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14839b85-d98d-4c3b-a811-622b99ef223b None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.877585 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:47.975651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3afa0-fea3-4c95-a2df-ccbcf7ec68ec None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.021089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:48.051209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 212/422] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:48.058783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14839b85-d98d-4c3b-a811-622b99ef223b None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.145278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3afa0-fea3-4c95-a2df-ccbcf7ec68ec None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.222328 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad23c8f-ffef-4f70-aa53-8b168dddb632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.222985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad23c8f-ffef-4f70-aa53-8b168dddb632 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.223262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad23c8f-ffef-4f70-aa53-8b168dddb632 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.223530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad23c8f-ffef-4f70-aa53-8b168dddb632 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.236411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14839b85-d98d-4c3b-a811-622b99ef223b None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.238723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:48.246089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad23c8f-ffef-4f70-aa53-8b168dddb632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-6ad23c8f-ffef-4f70-aa53-8b168dddb632 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:48.251513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:48.252404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:48.253234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:48.253234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:48.253234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:48.253234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:48.253234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:48.253234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:48.253234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:48.253234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:48.253234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:48.253234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:48.253234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:48.253234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:48.260299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 211/423] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:56:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:56:48.262767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad23c8f-ffef-4f70-aa53-8b168dddb632 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.274395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d77f5-4b41-4252-8750-d8d016b7ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.275371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d77f5-4b41-4252-8750-d8d016b7ef40 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.275835 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d77f5-4b41-4252-8750-d8d016b7ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.276246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d77f5-4b41-4252-8750-d8d016b7ef40 None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.277782 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d77f5-4b41-4252-8750-d8d016b7ef40 None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.279570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d77f5-4b41-4252-8750-d8d016b7ef40 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.281840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 213/424] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:48 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:48.289051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d77f5-4b41-4252-8750-d8d016b7ef40 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.456188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:48.477272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad23c8f-ffef-4f70-aa53-8b168dddb632 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.487988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d77f5-4b41-4252-8750-d8d016b7ef40 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.525055 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed282f06-7724-4330-ab00-d73895f0dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.525847 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed282f06-7724-4330-ab00-d73895f0dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.526224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed282f06-7724-4330-ab00-d73895f0dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.526597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed282f06-7724-4330-ab00-d73895f0dcb4 None admin] PATH_INFO: `/v3/groups/3ffe77cebe634b508525f8086e80cd17` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.527831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed282f06-7724-4330-ab00-d73895f0dcb4 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffe77cebe634b508525f8086e80cd17)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.528025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165c053-0016-47de-a563-b164bf5370cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.528878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165c053-0016-47de-a563-b164bf5370cf None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.529889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165c053-0016-47de-a563-b164bf5370cf None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.530211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed282f06-7724-4330-ab00-d73895f0dcb4 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.530465 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165c053-0016-47de-a563-b164bf5370cf None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.531267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165c053-0016-47de-a563-b164bf5370cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:48.531705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165c053-0016-47de-a563-b164bf5370cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.532556 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 214/425] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:48 2022] GET /identity/v3/groups/3ffe77cebe634b508525f8086e80cd17 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:48.533436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165c053-0016-47de-a563-b164bf5370cf None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.533974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaf1df-871d-4ca1-97d1-b30eeff80313 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.534352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaf1df-871d-4ca1-97d1-b30eeff80313 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.534721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaf1df-871d-4ca1-97d1-b30eeff80313 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.536015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 215/426] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:48.540961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaf1df-871d-4ca1-97d1-b30eeff80313 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.544074 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 212/427] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:56:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:48.547104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407546ed-5993-4abf-916f-71a5b2e99773 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.547640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407546ed-5993-4abf-916f-71a5b2e99773 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.548084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407546ed-5993-4abf-916f-71a5b2e99773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.572619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-407546ed-5993-4abf-916f-71a5b2e99773 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:48.574603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-407546ed-5993-4abf-916f-71a5b2e99773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:48.588224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:48.648742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 213/428] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:48.657678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407546ed-5993-4abf-916f-71a5b2e99773 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.659386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaf1df-871d-4ca1-97d1-b30eeff80313 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.697868 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553059a-d885-4417-bb5e-06433cc1aa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.698874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553059a-d885-4417-bb5e-06433cc1aa4c None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.699292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553059a-d885-4417-bb5e-06433cc1aa4c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.699713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553059a-d885-4417-bb5e-06433cc1aa4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.700600 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553059a-d885-4417-bb5e-06433cc1aa4c None admin] RBAC: Adding query filter params (group.id=3ffe77cebe634b508525f8086e80cd17, role.id=068a24594f0b4d01aab3485c009314d4, scope.project.id=093594e09a464d69aa54068e56284d4c) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:48.701796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553059a-d885-4417-bb5e-06433cc1aa4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.703530 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553059a-d885-4417-bb5e-06433cc1aa4c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.710492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 216/429] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Sep 7 15:56:48 2022] GET /identity/v3/role_assignments?group.id=3ffe77cebe634b508525f8086e80cd17&scope.project.id=093594e09a464d69aa54068e56284d4c&role.id=068a24594f0b4d01aab3485c009314d4 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:48.790939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:48.814481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407546ed-5993-4abf-916f-71a5b2e99773 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.867943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267cd05-85f3-4343-88e1-189387f77c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.868922 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267cd05-85f3-4343-88e1-189387f77c30 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.869342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267cd05-85f3-4343-88e1-189387f77c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.869753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267cd05-85f3-4343-88e1-189387f77c30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.953193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267cd05-85f3-4343-88e1-189387f77c30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.954658 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267cd05-85f3-4343-88e1-189387f77c30 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:49.043000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:49.067006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 214/430] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:49.068558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553059a-d885-4417-bb5e-06433cc1aa4c None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:49.073540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267cd05-85f3-4343-88e1-189387f77c30 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:49.180436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267cd05-85f3-4343-88e1-189387f77c30 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:49.183731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553059a-d885-4417-bb5e-06433cc1aa4c None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:49.186752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:49.220305 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0e165-b3ab-440c-adc0-31332700041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:49.220967 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0e165-b3ab-440c-adc0-31332700041a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:49.221248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0e165-b3ab-440c-adc0-31332700041a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:49.221521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0e165-b3ab-440c-adc0-31332700041a None admin] PATH_INFO: `/v3/projects/093594e09a464d69aa54068e56284d4c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:49.222776 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0e165-b3ab-440c-adc0-31332700041a None admin] RBAC: Authorizing `identity:get_project(project_id=093594e09a464d69aa54068e56284d4c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:49.224426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0e165-b3ab-440c-adc0-31332700041a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:49.225557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf52e46-906d-48fc-8af5-46a25a5f591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:49.226402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52e46-906d-48fc-8af5-46a25a5f591f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:49.226731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 215/431] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:49 2022] GET /identity/v3/projects/093594e09a464d69aa54068e56284d4c => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:49.227089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52e46-906d-48fc-8af5-46a25a5f591f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:49.227548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf52e46-906d-48fc-8af5-46a25a5f591f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:49.232984 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0e165-b3ab-440c-adc0-31332700041a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:49.239941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf52e46-906d-48fc-8af5-46a25a5f591f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-1bf52e46-906d-48fc-8af5-46a25a5f591f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:49.245395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:49.246289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:49.247103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:49.247103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:49.247103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:49.247103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:49.247103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:49.247103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:49.247103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:49.247103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:49.247103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:49.247103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:49.247103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:56:49.247103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:49.250515 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 217/432] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:49.256261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf52e46-906d-48fc-8af5-46a25a5f591f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:49.288374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:49.345911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0e165-b3ab-440c-adc0-31332700041a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:49.371390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf52e46-906d-48fc-8af5-46a25a5f591f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:49.383340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84860f0b-2631-4530-bb51-152947ebd484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:49.383987 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84860f0b-2631-4530-bb51-152947ebd484 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:49.384358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84860f0b-2631-4530-bb51-152947ebd484 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:49.384662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84860f0b-2631-4530-bb51-152947ebd484 None admin] PATH_INFO: `/v3/groups/3ffe77cebe634b508525f8086e80cd17` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:49.385961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84860f0b-2631-4530-bb51-152947ebd484 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffe77cebe634b508525f8086e80cd17)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:49.387453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84860f0b-2631-4530-bb51-152947ebd484 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:49.389570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 216/433] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:49 2022] GET /identity/v3/groups/3ffe77cebe634b508525f8086e80cd17 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:49.398020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84860f0b-2631-4530-bb51-152947ebd484 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:49.421860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1c29e-09fb-44e3-aca2-2af9d7caffc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:49.422975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c29e-09fb-44e3-aca2-2af9d7caffc5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:49.423460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c29e-09fb-44e3-aca2-2af9d7caffc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:49.423940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c29e-09fb-44e3-aca2-2af9d7caffc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:49.424938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1c29e-09fb-44e3-aca2-2af9d7caffc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:49.425618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1c29e-09fb-44e3-aca2-2af9d7caffc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:49.428265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1c29e-09fb-44e3-aca2-2af9d7caffc5 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:49.440660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 218/434] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:56:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:49.446364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1c29e-09fb-44e3-aca2-2af9d7caffc5 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:49.479326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:49.550163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84860f0b-2631-4530-bb51-152947ebd484 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:49.573672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:49.585547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1c29e-09fb-44e3-aca2-2af9d7caffc5 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:49.599268 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c6519-51e4-455e-bf46-77fc7adf3967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:49.599805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c6519-51e4-455e-bf46-77fc7adf3967 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:49.600089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c6519-51e4-455e-bf46-77fc7adf3967 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:49.600349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c6519-51e4-455e-bf46-77fc7adf3967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:49.601123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c6519-51e4-455e-bf46-77fc7adf3967 None admin] RBAC: Adding query filter params (group.id=3ffe77cebe634b508525f8086e80cd17, role.id=62c69ea249044f258a2a6f2138ff4ceb, scope.project.id=093594e09a464d69aa54068e56284d4c) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:49.601430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c6519-51e4-455e-bf46-77fc7adf3967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:49.602886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c6519-51e4-455e-bf46-77fc7adf3967 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:49.613357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 217/435] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Sep 7 15:56:49 2022] GET /identity/v3/role_assignments?group.id=3ffe77cebe634b508525f8086e80cd17&scope.project.id=093594e09a464d69aa54068e56284d4c&role.id=62c69ea249044f258a2a6f2138ff4ceb => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:49.613357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead472-0f8a-4ce1-8ce2-de855eed645b None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:49.613357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead472-0f8a-4ce1-8ce2-de855eed645b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:49.613357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead472-0f8a-4ce1-8ce2-de855eed645b None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:49.613357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 218/436] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:49.618928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eb5bc-63f9-4a2d-9154-e41dbbc0da03 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:49.619218 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eb5bc-63f9-4a2d-9154-e41dbbc0da03 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:49.619488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eb5bc-63f9-4a2d-9154-e41dbbc0da03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:49.643203 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-2b9eb5bc-63f9-4a2d-9154-e41dbbc0da03 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:49.645090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2b9eb5bc-63f9-4a2d-9154-e41dbbc0da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:49.647244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcd075-9e64-4f34-bfba-fd1cc554cfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:49.648711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcd075-9e64-4f34-bfba-fd1cc554cfd8 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:49.648711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcd075-9e64-4f34-bfba-fd1cc554cfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:49.648711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcd075-9e64-4f34-bfba-fd1cc554cfd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:49.760867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcd075-9e64-4f34-bfba-fd1cc554cfd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:49.763189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcd075-9e64-4f34-bfba-fd1cc554cfd8 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:49.770235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 219/437] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:49.807913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:49.808841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c53b4-7058-4620-8455-6380d0d6dd58 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:49.809056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c53b4-7058-4620-8455-6380d0d6dd58 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:49.809325 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c53b4-7058-4620-8455-6380d0d6dd58 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:49.811558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 220/438] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:56:49.817433 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1916a9-d1c2-4967-890b-7511a696dce9 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:49.817694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1916a9-d1c2-4967-890b-7511a696dce9 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:49.817977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1916a9-d1c2-4967-890b-7511a696dce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:49.839697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-df1916a9-d1c2-4967-890b-7511a696dce9 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:49.840962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-df1916a9-d1c2-4967-890b-7511a696dce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:49.898627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 219/439] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:49.904245 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcd075-9e64-4f34-bfba-fd1cc554cfd8 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:49.927137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 221/440] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:50.029026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcd075-9e64-4f34-bfba-fd1cc554cfd8 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:50.056954 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:50.063353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1916a9-d1c2-4967-890b-7511a696dce9 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.067869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bee1e4-ecf0-4f66-8ffd-7640eab76943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:50.069392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bee1e4-ecf0-4f66-8ffd-7640eab76943 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.069816 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bee1e4-ecf0-4f66-8ffd-7640eab76943 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.070249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bee1e4-ecf0-4f66-8ffd-7640eab76943 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.071535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bee1e4-ecf0-4f66-8ffd-7640eab76943 None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:50.073219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bee1e4-ecf0-4f66-8ffd-7640eab76943 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:50.075029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 220/441] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:49 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:50.084754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bee1e4-ecf0-4f66-8ffd-7640eab76943 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.121189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:50.200648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1916a9-d1c2-4967-890b-7511a696dce9 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:50.222326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bee1e4-ecf0-4f66-8ffd-7640eab76943 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:50.234185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8709d2-486b-4798-abed-9847ec4e5fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:50.234807 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8709d2-486b-4798-abed-9847ec4e5fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.235083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8709d2-486b-4798-abed-9847ec4e5fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.235353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8709d2-486b-4798-abed-9847ec4e5fe7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.245473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8709d2-486b-4798-abed-9847ec4e5fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-ad8709d2-486b-4798-abed-9847ec4e5fe7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:50.250881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:50.251822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 222/442] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:56:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:50.257525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8709d2-486b-4798-abed-9847ec4e5fe7 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.258407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ea337-033b-4295-bc31-c50288804504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:50.258407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ea337-033b-4295-bc31-c50288804504 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.258407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ea337-033b-4295-bc31-c50288804504 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.258407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ea337-033b-4295-bc31-c50288804504 None admin] PATH_INFO: `/v3/groups/3ffe77cebe634b508525f8086e80cd17` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.258702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ea337-033b-4295-bc31-c50288804504 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffe77cebe634b508525f8086e80cd17)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:50.259369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ea337-033b-4295-bc31-c50288804504 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:50.261115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 221/443] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:50 2022] GET /identity/v3/groups/3ffe77cebe634b508525f8086e80cd17 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:50.261811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ea337-033b-4295-bc31-c50288804504 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.322519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:50.357820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:50.361231 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8709d2-486b-4798-abed-9847ec4e5fe7 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:50.362679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ea337-033b-4295-bc31-c50288804504 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:50.395044 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69546-96fa-4a42-8581-e6182ebc9e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:50.395264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3da7f-ef4e-4c07-8029-eceda4e64352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:50.395834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69546-96fa-4a42-8581-e6182ebc9e97 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.395946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3da7f-ef4e-4c07-8029-eceda4e64352 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.396124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69546-96fa-4a42-8581-e6182ebc9e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.396214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3da7f-ef4e-4c07-8029-eceda4e64352 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.396394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3da7f-ef4e-4c07-8029-eceda4e64352 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.396490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69546-96fa-4a42-8581-e6182ebc9e97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.397089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3da7f-ef4e-4c07-8029-eceda4e64352 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:50.397390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3da7f-ef4e-4c07-8029-eceda4e64352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:50.398762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3da7f-ef4e-4c07-8029-eceda4e64352 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:50.407255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 222/444] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:56:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:50.408023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e69546-96fa-4a42-8581-e6182ebc9e97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:50.408126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3da7f-ef4e-4c07-8029-eceda4e64352 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-a3e69546-96fa-4a42-8581-e6182ebc9e97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:50.412917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:50.413981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 223/445] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:56:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:50.419390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69546-96fa-4a42-8581-e6182ebc9e97 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.511699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3da7f-ef4e-4c07-8029-eceda4e64352 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:50.515405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69546-96fa-4a42-8581-e6182ebc9e97 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:50.535021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:50.546476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382a788-7d1b-4558-af28-86448fda6f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:50.547081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382a788-7d1b-4558-af28-86448fda6f9e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.547366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382a788-7d1b-4558-af28-86448fda6f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.547644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382a788-7d1b-4558-af28-86448fda6f9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.548368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382a788-7d1b-4558-af28-86448fda6f9e None admin] RBAC: Adding query filter params (group.id=3ffe77cebe634b508525f8086e80cd17, role.id=068a24594f0b4d01aab3485c009314d4, scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:50.548706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382a788-7d1b-4558-af28-86448fda6f9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:50.549889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d036f-3f90-4d57-8fe8-62437be188b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:50.550147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382a788-7d1b-4558-af28-86448fda6f9e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:50.550482 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d036f-3f90-4d57-8fe8-62437be188b3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.550760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d036f-3f90-4d57-8fe8-62437be188b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.551027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d036f-3f90-4d57-8fe8-62437be188b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.555752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 223/446] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Sep 7 15:56:50 2022] GET /identity/v3/role_assignments?group.id=3ffe77cebe634b508525f8086e80cd17&scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c&role.id=068a24594f0b4d01aab3485c009314d4 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:50.556615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382a788-7d1b-4558-af28-86448fda6f9e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.586883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:50.637548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d036f-3f90-4d57-8fe8-62437be188b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:50.639377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d036f-3f90-4d57-8fe8-62437be188b3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:50.672291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382a788-7d1b-4558-af28-86448fda6f9e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:50.715578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582d9a0-4923-43e2-b175-3f92b41716bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:50.716235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582d9a0-4923-43e2-b175-3f92b41716bb None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.716601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582d9a0-4923-43e2-b175-3f92b41716bb None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.716925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582d9a0-4923-43e2-b175-3f92b41716bb None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.717643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582d9a0-4923-43e2-b175-3f92b41716bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:50.718001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582d9a0-4923-43e2-b175-3f92b41716bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:50.719428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582d9a0-4923-43e2-b175-3f92b41716bb None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:50.729372 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 224/447] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:56:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:50.735290 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582d9a0-4923-43e2-b175-3f92b41716bb None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.765210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 224/448] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:50.771491 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d036f-3f90-4d57-8fe8-62437be188b3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.791602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:50.848031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:50.866744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582d9a0-4923-43e2-b175-3f92b41716bb None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:50.897752 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d036f-3f90-4d57-8fe8-62437be188b3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:50.907719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fede8df-f723-49e8-8045-1cdc52653e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:50.908446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fede8df-f723-49e8-8045-1cdc52653e94 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.908822 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fede8df-f723-49e8-8045-1cdc52653e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.909106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fede8df-f723-49e8-8045-1cdc52653e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.944489 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995e78f-d517-4365-979b-1b83dd1ba840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:50.945163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995e78f-d517-4365-979b-1b83dd1ba840 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.945440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995e78f-d517-4365-979b-1b83dd1ba840 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.945709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995e78f-d517-4365-979b-1b83dd1ba840 None admin] PATH_INFO: `/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.946836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995e78f-d517-4365-979b-1b83dd1ba840 None admin] RBAC: Authorizing `identity:get_project(project_id=6d12476fe55f430f8bd612ca6d4acc7c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:50.948272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995e78f-d517-4365-979b-1b83dd1ba840 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:50.950102 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 225/449] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:50 2022] GET /identity/v3/projects/6d12476fe55f430f8bd612ca6d4acc7c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:50.955797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995e78f-d517-4365-979b-1b83dd1ba840 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.985338 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fede8df-f723-49e8-8045-1cdc52653e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:50.986825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fede8df-f723-49e8-8045-1cdc52653e94 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:51.038418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:51.059354 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995e78f-d517-4365-979b-1b83dd1ba840 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:51.086496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:51.090508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 225/450] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:56:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:51.096054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fede8df-f723-49e8-8045-1cdc52653e94 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:51.097020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1be669-b9f4-4eb2-ac6e-958d1a0abb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:51.097653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1be669-b9f4-4eb2-ac6e-958d1a0abb48 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:51.097935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1be669-b9f4-4eb2-ac6e-958d1a0abb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:51.098212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1be669-b9f4-4eb2-ac6e-958d1a0abb48 None admin] PATH_INFO: `/v3/groups/3ffe77cebe634b508525f8086e80cd17` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:51.099333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1be669-b9f4-4eb2-ac6e-958d1a0abb48 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffe77cebe634b508525f8086e80cd17)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:51.100792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1be669-b9f4-4eb2-ac6e-958d1a0abb48 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:51.102353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 226/451] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:50 2022] GET /identity/v3/groups/3ffe77cebe634b508525f8086e80cd17 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:51.110250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1be669-b9f4-4eb2-ac6e-958d1a0abb48 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:51.195406 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fede8df-f723-49e8-8045-1cdc52653e94 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:51.225824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1be669-b9f4-4eb2-ac6e-958d1a0abb48 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:51.227679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdeab5-979c-4fc7-8960-439234fed8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:51.228313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdeab5-979c-4fc7-8960-439234fed8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:51.228595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdeab5-979c-4fc7-8960-439234fed8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:51.228903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdeab5-979c-4fc7-8960-439234fed8a4 None admin] PATH_INFO: `/v3/projects/fca4039aaacb4eb6975387ddf331698c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:51.230033 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdeab5-979c-4fc7-8960-439234fed8a4 None admin] RBAC: Authorizing `identity:get_project(project_id=fca4039aaacb4eb6975387ddf331698c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:51.231473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdeab5-979c-4fc7-8960-439234fed8a4 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:51.233839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 226/452] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:56:51 2022] GET /identity/v3/projects/fca4039aaacb4eb6975387ddf331698c => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:51.239340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdeab5-979c-4fc7-8960-439234fed8a4 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:51.258236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:51.260458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38c6cc-57f6-4d9d-860c-b848b7831fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:51.261117 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38c6cc-57f6-4d9d-860c-b848b7831fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:51.261398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38c6cc-57f6-4d9d-860c-b848b7831fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:51.261674 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38c6cc-57f6-4d9d-860c-b848b7831fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:51.262392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38c6cc-57f6-4d9d-860c-b848b7831fb7 None admin] RBAC: Adding query filter params (group.id=3ffe77cebe634b508525f8086e80cd17, role.id=62c69ea249044f258a2a6f2138ff4ceb, scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:51.262701 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38c6cc-57f6-4d9d-860c-b848b7831fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:51.264533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38c6cc-57f6-4d9d-860c-b848b7831fb7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:51.270514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 227/453] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Sep 7 15:56:51 2022] GET /identity/v3/role_assignments?group.id=3ffe77cebe634b508525f8086e80cd17&scope.project.id=6d12476fe55f430f8bd612ca6d4acc7c&role.id=62c69ea249044f258a2a6f2138ff4ceb => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:51.349188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdeab5-979c-4fc7-8960-439234fed8a4 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:51.384721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286229d4-7272-4606-995a-f2720b0ecdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:51.385368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286229d4-7272-4606-995a-f2720b0ecdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:51.385651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286229d4-7272-4606-995a-f2720b0ecdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:51.385926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286229d4-7272-4606-995a-f2720b0ecdc5 None admin] PATH_INFO: `/v3/groups/0cccd63778944d54932ac84453229755` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:51.387075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286229d4-7272-4606-995a-f2720b0ecdc5 None admin] RBAC: Authorizing `identity:get_group(group_id=0cccd63778944d54932ac84453229755)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:51.389177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286229d4-7272-4606-995a-f2720b0ecdc5 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:51.390781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 227/454] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Sep 7 15:56:51 2022] GET /identity/v3/groups/0cccd63778944d54932ac84453229755 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:51.397164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38c6cc-57f6-4d9d-860c-b848b7831fb7 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:51.462506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:51.519935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38c6cc-57f6-4d9d-860c-b848b7831fb7 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:51.558916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc23c9-9e57-41e0-9837-1d0dcd9c15f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:51.559535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc23c9-9e57-41e0-9837-1d0dcd9c15f5 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:51.559814 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc23c9-9e57-41e0-9837-1d0dcd9c15f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:51.560083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc23c9-9e57-41e0-9837-1d0dcd9c15f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:51.561669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc23c9-9e57-41e0-9837-1d0dcd9c15f5 None admin] RBAC: Adding query filter params (group.id=0cccd63778944d54932ac84453229755, role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=fca4039aaacb4eb6975387ddf331698c) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:51.561977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc23c9-9e57-41e0-9837-1d0dcd9c15f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:51.563399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc23c9-9e57-41e0-9837-1d0dcd9c15f5 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:51.569502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 228/455] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Sep 7 15:56:51 2022] GET /identity/v3/role_assignments?group.id=0cccd63778944d54932ac84453229755&scope.project.id=fca4039aaacb4eb6975387ddf331698c&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:54.966960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103ee32-3a47-46c1-b282-aa05c3fd3ab8 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.967522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103ee32-3a47-46c1-b282-aa05c3fd3ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.967522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103ee32-3a47-46c1-b282-aa05c3fd3ab8 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:54.969017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 228/456] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:54.995810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a10f5b-81f9-4a29-b01a-46a3be9a24dc None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.996324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a10f5b-81f9-4a29-b01a-46a3be9a24dc None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.996397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a10f5b-81f9-4a29-b01a-46a3be9a24dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.017963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-68a10f5b-81f9-4a29-b01a-46a3be9a24dc None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:55.019403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-68a10f5b-81f9-4a29-b01a-46a3be9a24dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:55.115128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 229/457] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:55.164772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459203f-3376-4da2-9004-55541eba1341 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.165096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459203f-3376-4da2-9004-55541eba1341 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.165339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459203f-3376-4da2-9004-55541eba1341 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.166744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 229/458] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:55.173277 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879b61-a461-496c-a466-5d1bb67591ba None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.173582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879b61-a461-496c-a466-5d1bb67591ba None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.173930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879b61-a461-496c-a466-5d1bb67591ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.205752 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-c7879b61-a461-496c-a466-5d1bb67591ba None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:55.206960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c7879b61-a461-496c-a466-5d1bb67591ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:55.276512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:55.290015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad003a4a-3dfb-4ef4-ab51-bccb3c4b15ab None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.290320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad003a4a-3dfb-4ef4-ab51-bccb3c4b15ab None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.290589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad003a4a-3dfb-4ef4-ab51-bccb3c4b15ab None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.292016 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 230/459] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:55.297147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d90da-72aa-40f1-be39-34a0c0d84b01 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.297681 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d90da-72aa-40f1-be39-34a0c0d84b01 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.298159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d90da-72aa-40f1-be39-34a0c0d84b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.300402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 230/460] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:55.333665 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-402d90da-72aa-40f1-be39-34a0c0d84b01 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:55.335099 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-402d90da-72aa-40f1-be39-34a0c0d84b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:55.419238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 231/461] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:55.526866 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7879b61-a461-496c-a466-5d1bb67591ba None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:55.670487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7879b61-a461-496c-a466-5d1bb67591ba None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:55.690619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d90da-72aa-40f1-be39-34a0c0d84b01 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:55.713026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:55.714215 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68471630-32b6-430c-b5b2-9c6666266fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:55.714985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68471630-32b6-430c-b5b2-9c6666266fca None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.715260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68471630-32b6-430c-b5b2-9c6666266fca None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.715529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68471630-32b6-430c-b5b2-9c6666266fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.729924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68471630-32b6-430c-b5b2-9c6666266fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:55.731383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68471630-32b6-430c-b5b2-9c6666266fca None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-68471630-32b6-430c-b5b2-9c6666266fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:56:55.752151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:55.753168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:56:55.754005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:56:55.754005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:56:55.754005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:55.754005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 231/462] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:55.754870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a0d14-37b2-42d6-89f8-fde3f83ddc32 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.755153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a0d14-37b2-42d6-89f8-fde3f83ddc32 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.755870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a0d14-37b2-42d6-89f8-fde3f83ddc32 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.757695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 232/463] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:55.759621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a0d14-37b2-42d6-89f8-fde3f83ddc32 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:55.801337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:55.807314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d90da-72aa-40f1-be39-34a0c0d84b01 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:55.842081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a0775-bff7-4157-8ca0-a943b1330c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:55.842711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a0775-bff7-4157-8ca0-a943b1330c85 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.842994 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a0775-bff7-4157-8ca0-a943b1330c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.843261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a0775-bff7-4157-8ca0-a943b1330c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.853092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a0775-bff7-4157-8ca0-a943b1330c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:55.854546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a0775-bff7-4157-8ca0-a943b1330c85 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-118a0775-bff7-4157-8ca0-a943b1330c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:56:55.870073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:55.870995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:56:55.871854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:56:55.871854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:56:55.871854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:55.871854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 232/464] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:55.872444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46393037-b575-4457-a43e-a3414302214c None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.873334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46393037-b575-4457-a43e-a3414302214c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.873334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46393037-b575-4457-a43e-a3414302214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.881698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a0d14-37b2-42d6-89f8-fde3f83ddc32 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:55.895932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-46393037-b575-4457-a43e-a3414302214c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:55.897155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-46393037-b575-4457-a43e-a3414302214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:55.920005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958a063-03c2-49dd-90c0-e481ce59c09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:55.920909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958a063-03c2-49dd-90c0-e481ce59c09d None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.921329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958a063-03c2-49dd-90c0-e481ce59c09d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.921744 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958a063-03c2-49dd-90c0-e481ce59c09d None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.922575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958a063-03c2-49dd-90c0-e481ce59c09d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:55.923075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958a063-03c2-49dd-90c0-e481ce59c09d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:55.924449 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958a063-03c2-49dd-90c0-e481ce59c09d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:55.937827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 233/465] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:55.938661 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958a063-03c2-49dd-90c0-e481ce59c09d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:55.965748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:55.984709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 233/466] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:55.984709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46393037-b575-4457-a43e-a3414302214c None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.059650 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:56.068322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958a063-03c2-49dd-90c0-e481ce59c09d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.111957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46393037-b575-4457-a43e-a3414302214c None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.113961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b494f5-0495-42c7-bf1a-093bc9de19a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.115657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b494f5-0495-42c7-bf1a-093bc9de19a4 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.116088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b494f5-0495-42c7-bf1a-093bc9de19a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.116503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b494f5-0495-42c7-bf1a-093bc9de19a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.129718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b494f5-0495-42c7-bf1a-093bc9de19a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.132056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b494f5-0495-42c7-bf1a-093bc9de19a4 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-98b494f5-0495-42c7-bf1a-093bc9de19a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:56:56.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:56.153677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:56:56.155262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:56:56.155262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:56:56.155262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:56.156470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63370a4-ffbd-4121-a11e-81e7be6d58b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.157230 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63370a4-ffbd-4121-a11e-81e7be6d58b4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.157351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 234/467] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:56.157691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63370a4-ffbd-4121-a11e-81e7be6d58b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.158057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63370a4-ffbd-4121-a11e-81e7be6d58b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.158592 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b494f5-0495-42c7-bf1a-093bc9de19a4 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.158893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63370a4-ffbd-4121-a11e-81e7be6d58b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:56.159301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63370a4-ffbd-4121-a11e-81e7be6d58b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.160830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63370a4-ffbd-4121-a11e-81e7be6d58b4 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.192735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 234/468] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:56.193850 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63370a4-ffbd-4121-a11e-81e7be6d58b4 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.261290 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:56.292714 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b494f5-0495-42c7-bf1a-093bc9de19a4 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.309879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63370a4-ffbd-4121-a11e-81e7be6d58b4 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.330452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0d590-2585-4072-ab37-5de87b189f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.331063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0d590-2585-4072-ab37-5de87b189f82 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.331345 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0d590-2585-4072-ab37-5de87b189f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.331898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0d590-2585-4072-ab37-5de87b189f82 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.332269 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0d590-2585-4072-ab37-5de87b189f82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.333746 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0d590-2585-4072-ab37-5de87b189f82 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.346981 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83c16b-71a8-4670-bd1f-0bb6d70fa601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.347790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c16b-71a8-4670-bd1f-0bb6d70fa601 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.348199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c16b-71a8-4670-bd1f-0bb6d70fa601 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.348540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c16b-71a8-4670-bd1f-0bb6d70fa601 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.349312 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83c16b-71a8-4670-bd1f-0bb6d70fa601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:56.349773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83c16b-71a8-4670-bd1f-0bb6d70fa601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.351314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83c16b-71a8-4670-bd1f-0bb6d70fa601 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.368722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 235/469] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:56:56 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:56.368722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0d590-2585-4072-ab37-5de87b189f82 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.370946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:56.377666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 235/470] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:56.378670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83c16b-71a8-4670-bd1f-0bb6d70fa601 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.509778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0d590-2585-4072-ab37-5de87b189f82 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.548629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83c16b-71a8-4670-bd1f-0bb6d70fa601 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.564603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174a5e-b72e-46b8-bab3-d709efd022d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.565525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174a5e-b72e-46b8-bab3-d709efd022d9 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.565806 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174a5e-b72e-46b8-bab3-d709efd022d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.566076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174a5e-b72e-46b8-bab3-d709efd022d9 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.566724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88174a5e-b72e-46b8-bab3-d709efd022d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.568161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88174a5e-b72e-46b8-bab3-d709efd022d9 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.568762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:56.590343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbfef4-b0ff-4f72-9dec-e56d8fbcd00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.590982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbfef4-b0ff-4f72-9dec-e56d8fbcd00f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.591262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbfef4-b0ff-4f72-9dec-e56d8fbcd00f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.592110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbfef4-b0ff-4f72-9dec-e56d8fbcd00f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.594952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 236/471] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:56:56 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:56.595572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174a5e-b72e-46b8-bab3-d709efd022d9 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.608724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbfef4-b0ff-4f72-9dec-e56d8fbcd00f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.609148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbfef4-b0ff-4f72-9dec-e56d8fbcd00f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-79dbfef4-b0ff-4f72-9dec-e56d8fbcd00f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:56:56.629831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:56.630928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:56:56.631924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:56:56.631924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:56:56.631924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:56.631924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 236/472] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:56.632782 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894bdbb-9c54-469e-abb7-c1965aa7ddb8 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.632782 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894bdbb-9c54-469e-abb7-c1965aa7ddb8 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.632782 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894bdbb-9c54-469e-abb7-c1965aa7ddb8 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.637498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 237/473] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:56.640400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad90b96-a2fc-4d38-b526-82ccbf53138b None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.640989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad90b96-a2fc-4d38-b526-82ccbf53138b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.641414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad90b96-a2fc-4d38-b526-82ccbf53138b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.662528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9ad90b96-a2fc-4d38-b526-82ccbf53138b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:56.664066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9ad90b96-a2fc-4d38-b526-82ccbf53138b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:56.684876 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:56.738956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174a5e-b72e-46b8-bab3-d709efd022d9 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.777188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 238/474] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:56:56.778182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad90b96-a2fc-4d38-b526-82ccbf53138b None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.789700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63aad96-0314-4602-844f-9c919ef2bdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.790376 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63aad96-0314-4602-844f-9c919ef2bdd9 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.790668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63aad96-0314-4602-844f-9c919ef2bdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.790947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63aad96-0314-4602-844f-9c919ef2bdd9 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.791616 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63aad96-0314-4602-844f-9c919ef2bdd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.793337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63aad96-0314-4602-844f-9c919ef2bdd9 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.831581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 237/475] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:56:56 2022] POST /identity/v3/users => generated 249 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:56.931708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:56.936371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad90b96-a2fc-4d38-b526-82ccbf53138b None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.981363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e48562-6ab1-4f21-8320-b5f14663dacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.982958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e48562-6ab1-4f21-8320-b5f14663dacd None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.983394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e48562-6ab1-4f21-8320-b5f14663dacd None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.983908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e48562-6ab1-4f21-8320-b5f14663dacd None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.985282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e48562-6ab1-4f21-8320-b5f14663dacd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:56.985998 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e48562-6ab1-4f21-8320-b5f14663dacd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.988618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e48562-6ab1-4f21-8320-b5f14663dacd None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.004978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 239/476] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:57.010500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63aad96-0314-4602-844f-9c919ef2bdd9 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.068232 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e48562-6ab1-4f21-8320-b5f14663dacd None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.142725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63aad96-0314-4602-844f-9c919ef2bdd9 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.162870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:57.185494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9cb2f-2309-4959-8254-fc0a3728ad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.186409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9cb2f-2309-4959-8254-fc0a3728ad90 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.186688 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9cb2f-2309-4959-8254-fc0a3728ad90 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.186958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9cb2f-2309-4959-8254-fc0a3728ad90 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.187733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9cb2f-2309-4959-8254-fc0a3728ad90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.189221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9cb2f-2309-4959-8254-fc0a3728ad90 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.215803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e48562-6ab1-4f21-8320-b5f14663dacd None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.217718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 238/477] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:56:57 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:57.266382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62931fe-de43-492d-af25-7e002298887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.267069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62931fe-de43-492d-af25-7e002298887f None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.267353 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62931fe-de43-492d-af25-7e002298887f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.267626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62931fe-de43-492d-af25-7e002298887f None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.268371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62931fe-de43-492d-af25-7e002298887f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.270141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62931fe-de43-492d-af25-7e002298887f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.279712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.sql.core [None req-e62931fe-de43-492d-af25-7e002298887f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 15:56:57.279712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 15:56:57.279712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [parameters: {'id': 'c2782d731723497aa8195a1c3ae027af', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 15:56:57.279712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81620) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-e62931fe-de43-492d-af25-7e002298887f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application conn.query(q) Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result.read() Sep 07 15:56:57.299336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return ref.to_dict() Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 15:56:57.300449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application next(self.gen) Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application yield resource Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application next(self.gen) Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise self.value Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application session.commit() Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 15:56:57.301651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.session.flush() Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application compat.raise_( Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 15:56:57.302805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 15:56:57.303913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application conn.query(q) Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result.read() Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 15:56:57.305437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [parameters: {'id': 'c2782d731723497aa8195a1c3ae027af', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:57.307337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 15:56:57.309412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:56:57.317859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 240/478] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Sep 7 15:56:57 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:56:57.318000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9cb2f-2309-4959-8254-fc0a3728ad90 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.434414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9cb2f-2309-4959-8254-fc0a3728ad90 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.473947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb372845-d0c7-41a5-8927-e58dda1dea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.474650 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb372845-d0c7-41a5-8927-e58dda1dea07 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.474932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb372845-d0c7-41a5-8927-e58dda1dea07 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.475272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb372845-d0c7-41a5-8927-e58dda1dea07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.487275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb372845-d0c7-41a5-8927-e58dda1dea07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-eb372845-d0c7-41a5-8927-e58dda1dea07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:57.492918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:57.495083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:57.497051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 239/479] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:56:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:57.506076 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62931fe-de43-492d-af25-7e002298887f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.538689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:57.628442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62931fe-de43-492d-af25-7e002298887f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.667296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6908506-cb4d-4f88-b9d4-fde8cb74976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.667917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6908506-cb4d-4f88-b9d4-fde8cb74976d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.668196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6908506-cb4d-4f88-b9d4-fde8cb74976d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.668466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6908506-cb4d-4f88-b9d4-fde8cb74976d None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.669226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6908506-cb4d-4f88-b9d4-fde8cb74976d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:57.670172 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6908506-cb4d-4f88-b9d4-fde8cb74976d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.672004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6908506-cb4d-4f88-b9d4-fde8cb74976d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.681564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 241/480] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:56:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:59.121229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6b3f9-1366-4fa2-939e-11ab77c91f82 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.121729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6b3f9-1366-4fa2-939e-11ab77c91f82 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.121833 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6b3f9-1366-4fa2-939e-11ab77c91f82 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.124246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 240/481] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:59.129982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc256f-e9ca-47b6-af61-9db03577da4d None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.130850 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc256f-e9ca-47b6-af61-9db03577da4d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.131401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc256f-e9ca-47b6-af61-9db03577da4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.158730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-36cc256f-e9ca-47b6-af61-9db03577da4d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:59.160260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-36cc256f-e9ca-47b6-af61-9db03577da4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:59.249127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 242/482] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:59.594402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d142f-16e5-44ff-bba0-20339392b5d6 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.595315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d142f-16e5-44ff-bba0-20339392b5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.596035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d142f-16e5-44ff-bba0-20339392b5d6 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.598834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 241/483] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:56:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:59.604068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9be998-1d2b-44d6-a84f-9cb2bd187175 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.604615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9be998-1d2b-44d6-a84f-9cb2bd187175 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.605183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9be998-1d2b-44d6-a84f-9cb2bd187175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.634444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-ab9be998-1d2b-44d6-a84f-9cb2bd187175 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:59.635997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ab9be998-1d2b-44d6-a84f-9cb2bd187175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:59.651386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:59.677745 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d142f-16e5-44ff-bba0-20339392b5d6 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.721719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 243/484] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:56:59.740504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:59.832605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d142f-16e5-44ff-bba0-20339392b5d6 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.889584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3435ef-30cf-46e9-9663-eb7d5537a74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.890159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3435ef-30cf-46e9-9663-eb7d5537a74f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.890446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3435ef-30cf-46e9-9663-eb7d5537a74f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.890724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3435ef-30cf-46e9-9663-eb7d5537a74f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.905343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3435ef-30cf-46e9-9663-eb7d5537a74f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-1b3435ef-30cf-46e9-9663-eb7d5537a74f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:56:59.910153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:56:59.911047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:56:59.912301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 242/485] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:56:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:56:59.921215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9be998-1d2b-44d6-a84f-9cb2bd187175 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.051377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1b2a3-f824-4bb8-8892-b1b4d6c8cf1d None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.051780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1b2a3-f824-4bb8-8892-b1b4d6c8cf1d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.051926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1b2a3-f824-4bb8-8892-b1b4d6c8cf1d None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.053917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 243/486] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:00.064119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d7c1f-9e39-49aa-aae6-2f378ea5b934 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.064910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d7c1f-9e39-49aa-aae6-2f378ea5b934 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.065602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d7c1f-9e39-49aa-aae6-2f378ea5b934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.109926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-777d7c1f-9e39-49aa-aae6-2f378ea5b934 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:00.111515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-777d7c1f-9e39-49aa-aae6-2f378ea5b934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:00.125954 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9be998-1d2b-44d6-a84f-9cb2bd187175 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.175766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b84d57-fecd-470e-9cef-e75f1e5a3cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.176476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b84d57-fecd-470e-9cef-e75f1e5a3cef None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.176942 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b84d57-fecd-470e-9cef-e75f1e5a3cef None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.177614 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b84d57-fecd-470e-9cef-e75f1e5a3cef None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.179202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b84d57-fecd-470e-9cef-e75f1e5a3cef None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:00.180125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b84d57-fecd-470e-9cef-e75f1e5a3cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.182854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b84d57-fecd-470e-9cef-e75f1e5a3cef None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.193948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 244/487] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:56:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:00.194995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b84d57-fecd-470e-9cef-e75f1e5a3cef None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.207317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:00.209627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 244/488] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:57:00.211194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d7c1f-9e39-49aa-aae6-2f378ea5b934 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.241939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:00.317080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b84d57-fecd-470e-9cef-e75f1e5a3cef None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.358597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97a056-56ab-4e96-810a-0f413257dabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.360528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97a056-56ab-4e96-810a-0f413257dabd None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.361165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97a056-56ab-4e96-810a-0f413257dabd None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.362946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97a056-56ab-4e96-810a-0f413257dabd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.379745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97a056-56ab-4e96-810a-0f413257dabd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-ab97a056-56ab-4e96-810a-0f413257dabd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:00.385817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:00.386935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:00.387888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 245/489] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:00.389217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09634ca8-af5f-446a-8ec7-efcb6bb2e88a None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.389341 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09634ca8-af5f-446a-8ec7-efcb6bb2e88a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.389617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09634ca8-af5f-446a-8ec7-efcb6bb2e88a None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.394956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d7c1f-9e39-49aa-aae6-2f378ea5b934 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.395507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 246/490] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:00.396520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09634ca8-af5f-446a-8ec7-efcb6bb2e88a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.448350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22754a-03fa-4be3-a94d-6dc70246d56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.448942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22754a-03fa-4be3-a94d-6dc70246d56c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.449218 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22754a-03fa-4be3-a94d-6dc70246d56c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.449536 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22754a-03fa-4be3-a94d-6dc70246d56c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.464733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22754a-03fa-4be3-a94d-6dc70246d56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.466698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22754a-03fa-4be3-a94d-6dc70246d56c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.485457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-ce22754a-03fa-4be3-a94d-6dc70246d56c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:00.487772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:00.489000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:00.489858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:00.489858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:00.489858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:00.489858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 245/491] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:00.495474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b713639-3c09-41a0-9ebd-50d0548906d0 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.495474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b713639-3c09-41a0-9ebd-50d0548906d0 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.495474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b713639-3c09-41a0-9ebd-50d0548906d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.517694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-0b713639-3c09-41a0-9ebd-50d0548906d0 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:00.520214 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0b713639-3c09-41a0-9ebd-50d0548906d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:00.538459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09634ca8-af5f-446a-8ec7-efcb6bb2e88a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.581993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69803af3-92c7-4be7-8e9e-877618dd9554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.583008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69803af3-92c7-4be7-8e9e-877618dd9554 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.583460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69803af3-92c7-4be7-8e9e-877618dd9554 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.583959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69803af3-92c7-4be7-8e9e-877618dd9554 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.584997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69803af3-92c7-4be7-8e9e-877618dd9554 None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:00.585518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69803af3-92c7-4be7-8e9e-877618dd9554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.587253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69803af3-92c7-4be7-8e9e-877618dd9554 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.599029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 247/492] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:00.600093 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 246/493] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:00.600231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69803af3-92c7-4be7-8e9e-877618dd9554 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.600820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25832262-e387-4d7a-a211-52861ba6fa71 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.601133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25832262-e387-4d7a-a211-52861ba6fa71 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.601439 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25832262-e387-4d7a-a211-52861ba6fa71 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.604738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 247/494] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:00.604738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25832262-e387-4d7a-a211-52861ba6fa71 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.608255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:00.717425 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25832262-e387-4d7a-a211-52861ba6fa71 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.725097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69803af3-92c7-4be7-8e9e-877618dd9554 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.756655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578a500-6e89-4df2-b61e-31ea3207d3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.757434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578a500-6e89-4df2-b61e-31ea3207d3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.757965 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:00.758088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578a500-6e89-4df2-b61e-31ea3207d3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.758420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578a500-6e89-4df2-b61e-31ea3207d3f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.766485 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff96b08-8108-497e-8bad-c3e26650cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.767130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff96b08-8108-497e-8bad-c3e26650cf38 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.767413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff96b08-8108-497e-8bad-c3e26650cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.767687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff96b08-8108-497e-8bad-c3e26650cf38 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.768332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff96b08-8108-497e-8bad-c3e26650cf38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:00.768904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff96b08-8108-497e-8bad-c3e26650cf38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.770308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff96b08-8108-497e-8bad-c3e26650cf38 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.773008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578a500-6e89-4df2-b61e-31ea3207d3f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-5578a500-6e89-4df2-b61e-31ea3207d3f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:00.777779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:00.779185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 248/495] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:00.780027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578a500-6e89-4df2-b61e-31ea3207d3f8 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.790035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 248/496] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:00.791243 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03439ea-7cf0-4ac1-995d-29626d495f37 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.791532 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03439ea-7cf0-4ac1-995d-29626d495f37 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.791809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03439ea-7cf0-4ac1-995d-29626d495f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.813796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b03439ea-7cf0-4ac1-995d-29626d495f37 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:00.815017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b03439ea-7cf0-4ac1-995d-29626d495f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:00.851354 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:00.892137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 249/497] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:00.894514 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03439ea-7cf0-4ac1-995d-29626d495f37 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.895378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578a500-6e89-4df2-b61e-31ea3207d3f8 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.933143 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f05e6-2d9d-4640-ab06-00773c42814d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.933780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f05e6-2d9d-4640-ab06-00773c42814d None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.934067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f05e6-2d9d-4640-ab06-00773c42814d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.934339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f05e6-2d9d-4640-ab06-00773c42814d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.946031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f05e6-2d9d-4640-ab06-00773c42814d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.947500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f05e6-2d9d-4640-ab06-00773c42814d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-f92f05e6-2d9d-4640-ab06-00773c42814d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:00.963050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:00.964144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:00.965122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:00.965122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:00.965122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:00.965122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 249/498] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:00.965371 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f05e6-2d9d-4640-ab06-00773c42814d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.013262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03439ea-7cf0-4ac1-995d-29626d495f37 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.040468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:01.059204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c731c-2c7c-454c-baae-132c3b04cbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.059819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c731c-2c7c-454c-baae-132c3b04cbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.060172 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c731c-2c7c-454c-baae-132c3b04cbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.060503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c731c-2c7c-454c-baae-132c3b04cbd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.061214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c731c-2c7c-454c-baae-132c3b04cbd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:01.061519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c731c-2c7c-454c-baae-132c3b04cbd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.063349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c731c-2c7c-454c-baae-132c3b04cbd0 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.072108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 250/499] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:01.073057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c731c-2c7c-454c-baae-132c3b04cbd0 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.079860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f05e6-2d9d-4640-ab06-00773c42814d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.101958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:01.124955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6d8da-e908-4cc2-9ba2-e1ebf31b6795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.125585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6d8da-e908-4cc2-9ba2-e1ebf31b6795 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.125863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6d8da-e908-4cc2-9ba2-e1ebf31b6795 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.126132 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6d8da-e908-4cc2-9ba2-e1ebf31b6795 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.134085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6d8da-e908-4cc2-9ba2-e1ebf31b6795 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.135530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6d8da-e908-4cc2-9ba2-e1ebf31b6795 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-ddd6d8da-e908-4cc2-9ba2-e1ebf31b6795 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:01.152335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:01.153406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:01.159963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:01.159963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:01.159963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:01.159963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:01.159963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:01.159963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:01.159963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:01.159963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:01.159963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:57:01.159963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:01.159963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 250/500] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Sep 7 15:57:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:01.159963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6d8da-e908-4cc2-9ba2-e1ebf31b6795 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.188901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c731c-2c7c-454c-baae-132c3b04cbd0 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.228010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c128faa-e9e0-4951-8246-187c56bf1b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.228643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c128faa-e9e0-4951-8246-187c56bf1b35 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.228952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c128faa-e9e0-4951-8246-187c56bf1b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.229223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c128faa-e9e0-4951-8246-187c56bf1b35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.240172 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c128faa-e9e0-4951-8246-187c56bf1b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-7c128faa-e9e0-4951-8246-187c56bf1b35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:01.245449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:01.246971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 251/501] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:01.249339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c128faa-e9e0-4951-8246-187c56bf1b35 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.267993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6d8da-e908-4cc2-9ba2-e1ebf31b6795 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.295478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:01.304138 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20393516-a6ba-49a1-a550-3097785adab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.304777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20393516-a6ba-49a1-a550-3097785adab3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.305057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20393516-a6ba-49a1-a550-3097785adab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.305329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20393516-a6ba-49a1-a550-3097785adab3 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.305969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20393516-a6ba-49a1-a550-3097785adab3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:01.306272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20393516-a6ba-49a1-a550-3097785adab3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.307645 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20393516-a6ba-49a1-a550-3097785adab3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.320582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 251/502] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:01.321459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20393516-a6ba-49a1-a550-3097785adab3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.355162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:01.358862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c128faa-e9e0-4951-8246-187c56bf1b35 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.396941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055855a4-2b10-450d-a693-d2aa5ae694b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.397573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055855a4-2b10-450d-a693-d2aa5ae694b4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.397851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055855a4-2b10-450d-a693-d2aa5ae694b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.398121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055855a4-2b10-450d-a693-d2aa5ae694b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.408915 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055855a4-2b10-450d-a693-d2aa5ae694b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.410371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055855a4-2b10-450d-a693-d2aa5ae694b4 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.422757 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20393516-a6ba-49a1-a550-3097785adab3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-055855a4-2b10-450d-a693-d2aa5ae694b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:01.424180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:01.425265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:01.426376 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:01.426376 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:01.426376 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:01.426376 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 252/503] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:01.426376 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055855a4-2b10-450d-a693-d2aa5ae694b4 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.464129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4367b2-ccbe-400e-b203-93dbc19ed5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.464756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4367b2-ccbe-400e-b203-93dbc19ed5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.465040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4367b2-ccbe-400e-b203-93dbc19ed5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.465321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4367b2-ccbe-400e-b203-93dbc19ed5c7 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.466039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4367b2-ccbe-400e-b203-93dbc19ed5c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:01.466941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4367b2-ccbe-400e-b203-93dbc19ed5c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.468385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4367b2-ccbe-400e-b203-93dbc19ed5c7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.506389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 252/504] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Sep 7 15:57:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:01.507247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4367b2-ccbe-400e-b203-93dbc19ed5c7 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.520048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:01.527332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055855a4-2b10-450d-a693-d2aa5ae694b4 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.562392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c828c84-e7f7-4d1a-81f5-b87c626c28b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.563118 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828c84-e7f7-4d1a-81f5-b87c626c28b3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.563407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828c84-e7f7-4d1a-81f5-b87c626c28b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.563689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c828c84-e7f7-4d1a-81f5-b87c626c28b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.575257 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c828c84-e7f7-4d1a-81f5-b87c626c28b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.577538 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c828c84-e7f7-4d1a-81f5-b87c626c28b3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-3c828c84-e7f7-4d1a-81f5-b87c626c28b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:01.591916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:01.593114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:01.594135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:01.594135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:01.594135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:01.594561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 253/505] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:01.595856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c828c84-e7f7-4d1a-81f5-b87c626c28b3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.615360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:01.622472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4367b2-ccbe-400e-b203-93dbc19ed5c7 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.658848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cba554-da8a-4ce8-a50b-17d43009a614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.659455 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cba554-da8a-4ce8-a50b-17d43009a614 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.659731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cba554-da8a-4ce8-a50b-17d43009a614 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.659998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cba554-da8a-4ce8-a50b-17d43009a614 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.660654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cba554-da8a-4ce8-a50b-17d43009a614 None admin] RBAC: Adding query filter params (name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:01.660978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cba554-da8a-4ce8-a50b-17d43009a614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.662347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cba554-da8a-4ce8-a50b-17d43009a614 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.671481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 253/506] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:01.672308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cba554-da8a-4ce8-a50b-17d43009a614 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.706730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c828c84-e7f7-4d1a-81f5-b87c626c28b3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.740930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db24cc0-2158-47a6-aeb3-bae8c4b0a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.741680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db24cc0-2158-47a6-aeb3-bae8c4b0a586 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.741962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db24cc0-2158-47a6-aeb3-bae8c4b0a586 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.742265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db24cc0-2158-47a6-aeb3-bae8c4b0a586 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.750589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db24cc0-2158-47a6-aeb3-bae8c4b0a586 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.752029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db24cc0-2158-47a6-aeb3-bae8c4b0a586 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-2db24cc0-2158-47a6-aeb3-bae8c4b0a586 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:01.764651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:01.765772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:01.766679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:01.766679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:01.766679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:01.766679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:01.766679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:01.766679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:01.766679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:01.766679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:01.766679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 15:57:01.766679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:01.766679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 254/507] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:57:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:01.766679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db24cc0-2158-47a6-aeb3-bae8c4b0a586 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.775899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:01.784204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cba554-da8a-4ce8-a50b-17d43009a614 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.820177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6269e-0649-4782-a5b0-1ad5f4194411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.820825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6269e-0649-4782-a5b0-1ad5f4194411 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.821112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6269e-0649-4782-a5b0-1ad5f4194411 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.821389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6269e-0649-4782-a5b0-1ad5f4194411 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.822024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6269e-0649-4782-a5b0-1ad5f4194411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:01.822329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6269e-0649-4782-a5b0-1ad5f4194411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.823694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6269e-0649-4782-a5b0-1ad5f4194411 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.838582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 254/508] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:01.839408 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6269e-0649-4782-a5b0-1ad5f4194411 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.860384 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:01.870738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db24cc0-2158-47a6-aeb3-bae8c4b0a586 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.907610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e701b-4502-47cc-b6bf-003ec543ee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.908217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e701b-4502-47cc-b6bf-003ec543ee07 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.908508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e701b-4502-47cc-b6bf-003ec543ee07 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.908813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e701b-4502-47cc-b6bf-003ec543ee07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.947736 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6269e-0649-4782-a5b0-1ad5f4194411 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.977948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e701b-4502-47cc-b6bf-003ec543ee07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.979427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e701b-4502-47cc-b6bf-003ec543ee07 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.985779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a8c01-34bd-48b6-b212-7f27a2f20a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.986385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8c01-34bd-48b6-b212-7f27a2f20a8b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.986667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8c01-34bd-48b6-b212-7f27a2f20a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.986943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8c01-34bd-48b6-b212-7f27a2f20a8b None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.987597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a8c01-34bd-48b6-b212-7f27a2f20a8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:01.987805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:01.987933 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a8c01-34bd-48b6-b212-7f27a2f20a8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.989299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a8c01-34bd-48b6-b212-7f27a2f20a8b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.004515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 255/509] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:02.005466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a8c01-34bd-48b6-b212-7f27a2f20a8b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.083604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 255/510] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:02.084448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e701b-4502-47cc-b6bf-003ec543ee07 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.084802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:02.111417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a8c01-34bd-48b6-b212-7f27a2f20a8b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.151232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decff44e-9b6e-480c-8402-0a8ee6812fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.151860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decff44e-9b6e-480c-8402-0a8ee6812fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.152138 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decff44e-9b6e-480c-8402-0a8ee6812fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.152415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decff44e-9b6e-480c-8402-0a8ee6812fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.164310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decff44e-9b6e-480c-8402-0a8ee6812fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.165801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decff44e-9b6e-480c-8402-0a8ee6812fa3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-decff44e-9b6e-480c-8402-0a8ee6812fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:02.180760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:02.181926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:02.182790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:02.182790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:02.182790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:02.182790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 256/511] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:02.182790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decff44e-9b6e-480c-8402-0a8ee6812fa3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.195957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e701b-4502-47cc-b6bf-003ec543ee07 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.204040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:02.238764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d694766-1cc0-42da-85b9-7c642ad5986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.239487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d694766-1cc0-42da-85b9-7c642ad5986e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.239832 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d694766-1cc0-42da-85b9-7c642ad5986e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.240171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d694766-1cc0-42da-85b9-7c642ad5986e None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.241009 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d694766-1cc0-42da-85b9-7c642ad5986e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:02.241385 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d694766-1cc0-42da-85b9-7c642ad5986e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.242882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d694766-1cc0-42da-85b9-7c642ad5986e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.282015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 256/512] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:02.282765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d694766-1cc0-42da-85b9-7c642ad5986e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.291405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decff44e-9b6e-480c-8402-0a8ee6812fa3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.318011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:02.326709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade04ab-dd97-490c-a555-c9529aab9863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.327337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade04ab-dd97-490c-a555-c9529aab9863 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.327622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade04ab-dd97-490c-a555-c9529aab9863 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.328008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade04ab-dd97-490c-a555-c9529aab9863 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.336169 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade04ab-dd97-490c-a555-c9529aab9863 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.337676 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade04ab-dd97-490c-a555-c9529aab9863 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-4ade04ab-dd97-490c-a555-c9529aab9863 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:02.349697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:02.350788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:02.351818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:02.351818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:02.351818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:02.351818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:02.351818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:02.351818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:02.351818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:02.351818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:02.351818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 15:57:02.351818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:02.351818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 257/513] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:02.351818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade04ab-dd97-490c-a555-c9529aab9863 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.384064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d694766-1cc0-42da-85b9-7c642ad5986e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.420015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07162e2-90a5-47a3-aadc-80bad6432305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.420842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07162e2-90a5-47a3-aadc-80bad6432305 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.421124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07162e2-90a5-47a3-aadc-80bad6432305 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.421396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07162e2-90a5-47a3-aadc-80bad6432305 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.422066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07162e2-90a5-47a3-aadc-80bad6432305 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.423491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07162e2-90a5-47a3-aadc-80bad6432305 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.446801 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 257/514] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:57:02 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:02.447641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07162e2-90a5-47a3-aadc-80bad6432305 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.465130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade04ab-dd97-490c-a555-c9529aab9863 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.473960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:02.513106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de5ce1-6e05-4a36-9ecc-9e193b64c9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.514599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5ce1-6e05-4a36-9ecc-9e193b64c9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.514982 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5ce1-6e05-4a36-9ecc-9e193b64c9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.515413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5ce1-6e05-4a36-9ecc-9e193b64c9c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.528362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de5ce1-6e05-4a36-9ecc-9e193b64c9c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.530755 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de5ce1-6e05-4a36-9ecc-9e193b64c9c5 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-21de5ce1-6e05-4a36-9ecc-9e193b64c9c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:02.549144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:02.550267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:02.551327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:02.551327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:02.551327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:02.551327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 258/515] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:02.551327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de5ce1-6e05-4a36-9ecc-9e193b64c9c5 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.573979 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07162e2-90a5-47a3-aadc-80bad6432305 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.601300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:02.615219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d67105-f527-4420-93c3-513f800b6fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.615932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d67105-f527-4420-93c3-513f800b6fcd None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.616278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d67105-f527-4420-93c3-513f800b6fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.616621 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d67105-f527-4420-93c3-513f800b6fcd None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.617378 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d67105-f527-4420-93c3-513f800b6fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:02.617744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d67105-f527-4420-93c3-513f800b6fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.619868 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d67105-f527-4420-93c3-513f800b6fcd None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.637527 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 258/516] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:02.642216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d67105-f527-4420-93c3-513f800b6fcd None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.675745 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de5ce1-6e05-4a36-9ecc-9e193b64c9c5 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.712007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4010f-69f4-442b-a127-cd310b086106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.712646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4010f-69f4-442b-a127-cd310b086106 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.712918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4010f-69f4-442b-a127-cd310b086106 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.713188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4010f-69f4-442b-a127-cd310b086106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.745034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:02.767046 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d67105-f527-4420-93c3-513f800b6fcd None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.792649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4010f-69f4-442b-a127-cd310b086106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.795098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4010f-69f4-442b-a127-cd310b086106 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.806421 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4452f-f808-4625-9592-47ce119c815a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.807050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4452f-f808-4625-9592-47ce119c815a None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.807683 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4452f-f808-4625-9592-47ce119c815a None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.808028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4452f-f808-4625-9592-47ce119c815a None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.808862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4452f-f808-4625-9592-47ce119c815a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:02.809234 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4452f-f808-4625-9592-47ce119c815a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.811094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4452f-f808-4625-9592-47ce119c815a None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.829304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 259/517] 10.222.0.43 () {56 vars in 1139 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:02.830238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4452f-f808-4625-9592-47ce119c815a None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.845854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:02.911361 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 259/518] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:02.912594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4010f-69f4-442b-a127-cd310b086106 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.945902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4452f-f808-4625-9592-47ce119c815a None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.983917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66139bf0-6f4f-44ae-95ce-3f6e07ca93a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.984602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66139bf0-6f4f-44ae-95ce-3f6e07ca93a1 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.984912 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66139bf0-6f4f-44ae-95ce-3f6e07ca93a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.985185 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66139bf0-6f4f-44ae-95ce-3f6e07ca93a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.985973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66139bf0-6f4f-44ae-95ce-3f6e07ca93a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:02.986278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66139bf0-6f4f-44ae-95ce-3f6e07ca93a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.988346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66139bf0-6f4f-44ae-95ce-3f6e07ca93a1 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.001192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:03.011887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 260/519] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:03.011887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66139bf0-6f4f-44ae-95ce-3f6e07ca93a1 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.028662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4010f-69f4-442b-a127-cd310b086106 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.068533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8fe15-e3e9-4755-9b19-54c5672f8247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.068841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8fe15-e3e9-4755-9b19-54c5672f8247 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.068932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8fe15-e3e9-4755-9b19-54c5672f8247 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.069195 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8fe15-e3e9-4755-9b19-54c5672f8247 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.077964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8fe15-e3e9-4755-9b19-54c5672f8247 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.079403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8fe15-e3e9-4755-9b19-54c5672f8247 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.083064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-d6b8fe15-e3e9-4755-9b19-54c5672f8247 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:03.095171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:03.096292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:03.097212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:03.097212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:03.097212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:03.097212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:03.097212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:03.097212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:03.097212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:03.097212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:03.097212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:57:03.097212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:03.097212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 260/520] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:03.097212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8fe15-e3e9-4755-9b19-54c5672f8247 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.138197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66139bf0-6f4f-44ae-95ce-3f6e07ca93a1 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.174519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5c869-c588-42cc-bb56-912a299e2234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.175129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5c869-c588-42cc-bb56-912a299e2234 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.175408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5c869-c588-42cc-bb56-912a299e2234 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.175678 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5c869-c588-42cc-bb56-912a299e2234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.215620 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8fe15-e3e9-4755-9b19-54c5672f8247 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.242891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:03.247940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5c869-c588-42cc-bb56-912a299e2234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.249446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5c869-c588-42cc-bb56-912a299e2234 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.253020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd154c70-8ab8-437e-a090-8c4be88a3aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.253647 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd154c70-8ab8-437e-a090-8c4be88a3aef None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.253926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd154c70-8ab8-437e-a090-8c4be88a3aef None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.254195 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd154c70-8ab8-437e-a090-8c4be88a3aef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.265677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd154c70-8ab8-437e-a090-8c4be88a3aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.267115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd154c70-8ab8-437e-a090-8c4be88a3aef None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-fd154c70-8ab8-437e-a090-8c4be88a3aef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:03.282109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:03.283054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:03.283878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:03.283878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:03.283878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:03.283878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 261/521] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:03.284232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd154c70-8ab8-437e-a090-8c4be88a3aef None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.343681 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:03.376731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 261/522] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:03.382175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5c869-c588-42cc-bb56-912a299e2234 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.397663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd154c70-8ab8-437e-a090-8c4be88a3aef None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.436811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4254ea-7782-44e6-8de9-cfe1df6fbf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.437446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4254ea-7782-44e6-8de9-cfe1df6fbf08 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.437729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4254ea-7782-44e6-8de9-cfe1df6fbf08 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.438005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4254ea-7782-44e6-8de9-cfe1df6fbf08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.445875 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4254ea-7782-44e6-8de9-cfe1df6fbf08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.447341 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4254ea-7782-44e6-8de9-cfe1df6fbf08 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-3e4254ea-7782-44e6-8de9-cfe1df6fbf08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:03.460130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:03.461156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:03.462194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:03.462194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:03.462194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:03.462194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:03.462194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:03.462194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:03.462194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:03.462194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:03.463835 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 262/523] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:03.464773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4254ea-7782-44e6-8de9-cfe1df6fbf08 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.496249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:03.505042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5c869-c588-42cc-bb56-912a299e2234 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.542369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c299c-db90-4f01-9faa-966c59975eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.542955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c299c-db90-4f01-9faa-966c59975eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.543291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c299c-db90-4f01-9faa-966c59975eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.544377 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c299c-db90-4f01-9faa-966c59975eb9 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.544377 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c299c-db90-4f01-9faa-966c59975eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:03.544645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c299c-db90-4f01-9faa-966c59975eb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.546125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c299c-db90-4f01-9faa-966c59975eb9 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.564523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 262/524] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Sep 7 15:57:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:03.565384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c299c-db90-4f01-9faa-966c59975eb9 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.582321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4254ea-7782-44e6-8de9-cfe1df6fbf08 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.595467 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:03.621618 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adebf7-3b90-488e-b2d3-9d7c00fb901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.622224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adebf7-3b90-488e-b2d3-9d7c00fb901b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.623111 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adebf7-3b90-488e-b2d3-9d7c00fb901b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.623417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adebf7-3b90-488e-b2d3-9d7c00fb901b None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.624270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adebf7-3b90-488e-b2d3-9d7c00fb901b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:03.624644 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adebf7-3b90-488e-b2d3-9d7c00fb901b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.626647 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adebf7-3b90-488e-b2d3-9d7c00fb901b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.643961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 263/525] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:03.643961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adebf7-3b90-488e-b2d3-9d7c00fb901b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.688147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c299c-db90-4f01-9faa-966c59975eb9 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.726750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c421891-2f1b-47e3-8d27-48beb36d2ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.727663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c421891-2f1b-47e3-8d27-48beb36d2ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.728120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c421891-2f1b-47e3-8d27-48beb36d2ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.728238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c421891-2f1b-47e3-8d27-48beb36d2ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.739142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c421891-2f1b-47e3-8d27-48beb36d2ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.740626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c421891-2f1b-47e3-8d27-48beb36d2ff6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.750670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adebf7-3b90-488e-b2d3-9d7c00fb901b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-7c421891-2f1b-47e3-8d27-48beb36d2ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:03.756078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:03.761740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:03.762692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:03.762692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:03.762692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:03.762692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 263/526] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:03.762692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c421891-2f1b-47e3-8d27-48beb36d2ff6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.772849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:03.796024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa65ea4-8d1b-4175-a2d5-ebfca7316aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.796900 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa65ea4-8d1b-4175-a2d5-ebfca7316aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.797186 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa65ea4-8d1b-4175-a2d5-ebfca7316aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.797460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa65ea4-8d1b-4175-a2d5-ebfca7316aa5 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.798161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa65ea4-8d1b-4175-a2d5-ebfca7316aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:03.798470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa65ea4-8d1b-4175-a2d5-ebfca7316aa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.800036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa65ea4-8d1b-4175-a2d5-ebfca7316aa5 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.824713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 264/527] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:03.824713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa65ea4-8d1b-4175-a2d5-ebfca7316aa5 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.858598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:03.884113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c421891-2f1b-47e3-8d27-48beb36d2ff6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.921135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee5780-90c1-484d-ad14-535413e40ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.921804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee5780-90c1-484d-ad14-535413e40ead None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.922129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee5780-90c1-484d-ad14-535413e40ead None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.922459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee5780-90c1-484d-ad14-535413e40ead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.952829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa65ea4-8d1b-4175-a2d5-ebfca7316aa5 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.995110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee5780-90c1-484d-ad14-535413e40ead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.997032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee5780-90c1-484d-ad14-535413e40ead None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:04.000485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72effa2c-19e2-4999-8194-b9135c555dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:04.001148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72effa2c-19e2-4999-8194-b9135c555dda None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.001427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72effa2c-19e2-4999-8194-b9135c555dda None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.001697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72effa2c-19e2-4999-8194-b9135c555dda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.007508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:04.008652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72effa2c-19e2-4999-8194-b9135c555dda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:04.010704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72effa2c-19e2-4999-8194-b9135c555dda None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-72effa2c-19e2-4999-8194-b9135c555dda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:04.028481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:04.029899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:04.030730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:04.030730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:04.030730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:04.030730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:04.030730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:04.030730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:04.030730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:04.030730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:04.035030 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 265/528] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:04.035883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72effa2c-19e2-4999-8194-b9135c555dda None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:04.115148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 264/529] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:04.117621 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee5780-90c1-484d-ad14-535413e40ead None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:04.146728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:04.158099 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72effa2c-19e2-4999-8194-b9135c555dda None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:04.194005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19bc80-ae8a-4fce-9a4a-29a9b6105aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:04.194616 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19bc80-ae8a-4fce-9a4a-29a9b6105aea None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.194896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19bc80-ae8a-4fce-9a4a-29a9b6105aea None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.195168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19bc80-ae8a-4fce-9a4a-29a9b6105aea None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.195812 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19bc80-ae8a-4fce-9a4a-29a9b6105aea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:04.196109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19bc80-ae8a-4fce-9a4a-29a9b6105aea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:04.197523 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19bc80-ae8a-4fce-9a4a-29a9b6105aea None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:04.214383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 266/530] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:04.214383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19bc80-ae8a-4fce-9a4a-29a9b6105aea None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:04.238339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee5780-90c1-484d-ad14-535413e40ead None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:04.249234 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:04.277555 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de78f10-b674-4aa3-976a-5ef56e7a7730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:04.278167 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de78f10-b674-4aa3-976a-5ef56e7a7730 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.278447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de78f10-b674-4aa3-976a-5ef56e7a7730 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.279287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de78f10-b674-4aa3-976a-5ef56e7a7730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.280199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de78f10-b674-4aa3-976a-5ef56e7a7730 None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=9d71c0688ea84c05af925f3fb08f35ad) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:04.280537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de78f10-b674-4aa3-976a-5ef56e7a7730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:04.282118 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de78f10-b674-4aa3-976a-5ef56e7a7730 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:04.289430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 265/531] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:04 2022] GET /identity/v3/role_assignments?user.id=9d71c0688ea84c05af925f3fb08f35ad&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:04.297799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de78f10-b674-4aa3-976a-5ef56e7a7730 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:04.330742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19bc80-ae8a-4fce-9a4a-29a9b6105aea None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:04.379693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a6125-fd54-45a5-b908-34aa9f4431b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:04.380464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a6125-fd54-45a5-b908-34aa9f4431b8 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.380464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a6125-fd54-45a5-b908-34aa9f4431b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.380958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a6125-fd54-45a5-b908-34aa9f4431b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.381495 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a6125-fd54-45a5-b908-34aa9f4431b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:04.381817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a6125-fd54-45a5-b908-34aa9f4431b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:04.383806 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a6125-fd54-45a5-b908-34aa9f4431b8 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:04.396585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 267/532] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:04.401793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a6125-fd54-45a5-b908-34aa9f4431b8 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:04.420182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:04.446461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de78f10-b674-4aa3-976a-5ef56e7a7730 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:04.485891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed3799-1195-4440-b373-1ecbfc384abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:04.486789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed3799-1195-4440-b373-1ecbfc384abf None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.487218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed3799-1195-4440-b373-1ecbfc384abf None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.487492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed3799-1195-4440-b373-1ecbfc384abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.499083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed3799-1195-4440-b373-1ecbfc384abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:04.500547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed3799-1195-4440-b373-1ecbfc384abf None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:04.513731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a6125-fd54-45a5-b908-34aa9f4431b8 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-3fed3799-1195-4440-b373-1ecbfc384abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:04.515476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:04.516386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:04.517296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:04.517296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:04.517296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:04.517296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 266/533] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:04.517937 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed3799-1195-4440-b373-1ecbfc384abf None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:04.545473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:04.555479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad25f9-aed2-4ffc-b2aa-05a418fa5f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:04.556175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad25f9-aed2-4ffc-b2aa-05a418fa5f63 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.556530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad25f9-aed2-4ffc-b2aa-05a418fa5f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.556783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad25f9-aed2-4ffc-b2aa-05a418fa5f63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.565191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad25f9-aed2-4ffc-b2aa-05a418fa5f63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:04.566655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad25f9-aed2-4ffc-b2aa-05a418fa5f63 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-cfad25f9-aed2-4ffc-b2aa-05a418fa5f63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:04.579077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:04.579981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:04.580856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:04.580856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:04.580856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:04.580856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:04.580856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:04.580856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:04.580856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:04.580856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:04.580856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 268/534] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:04.581309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad25f9-aed2-4ffc-b2aa-05a418fa5f63 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:04.644082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed3799-1195-4440-b373-1ecbfc384abf None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:04.671754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:04.683771 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed4982-2e83-43ce-b210-53e4daae4d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:04.684583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed4982-2e83-43ce-b210-53e4daae4d81 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.685040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed4982-2e83-43ce-b210-53e4daae4d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.685481 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed4982-2e83-43ce-b210-53e4daae4d81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.686354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed4982-2e83-43ce-b210-53e4daae4d81 None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=bc71e3a41ac644ff8a908b766495b5f0) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:04.686744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed4982-2e83-43ce-b210-53e4daae4d81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:04.688290 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed4982-2e83-43ce-b210-53e4daae4d81 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:04.694524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 267/535] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:04 2022] GET /identity/v3/role_assignments?user.id=bc71e3a41ac644ff8a908b766495b5f0&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:04.700191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed4982-2e83-43ce-b210-53e4daae4d81 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:04.713483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad25f9-aed2-4ffc-b2aa-05a418fa5f63 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:04.761414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613e5d0-2a50-455a-b1e0-7657e1fc3623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:04.762032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613e5d0-2a50-455a-b1e0-7657e1fc3623 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.762312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613e5d0-2a50-455a-b1e0-7657e1fc3623 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.762587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613e5d0-2a50-455a-b1e0-7657e1fc3623 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.763891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613e5d0-2a50-455a-b1e0-7657e1fc3623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:04.764437 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613e5d0-2a50-455a-b1e0-7657e1fc3623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:04.765943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613e5d0-2a50-455a-b1e0-7657e1fc3623 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:04.781950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 269/536] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:04.783330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175343ec-48d3-4b60-b330-82ae7353c6db None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.783614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175343ec-48d3-4b60-b330-82ae7353c6db None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.783887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175343ec-48d3-4b60-b330-82ae7353c6db None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.789543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 270/537] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:04.790670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175343ec-48d3-4b60-b330-82ae7353c6db None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:04.830775 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:04.847968 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed4982-2e83-43ce-b210-53e4daae4d81 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:04.890437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04569e-ac83-4a65-b41d-118c9449cd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:04.891103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04569e-ac83-4a65-b41d-118c9449cd07 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.891391 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04569e-ac83-4a65-b41d-118c9449cd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.891669 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04569e-ac83-4a65-b41d-118c9449cd07 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.892378 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04569e-ac83-4a65-b41d-118c9449cd07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:04.892706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04569e-ac83-4a65-b41d-118c9449cd07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:04.894589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04569e-ac83-4a65-b41d-118c9449cd07 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:04.911700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175343ec-48d3-4b60-b330-82ae7353c6db None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:04.916147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 268/538] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:04.917452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafce91-a548-4759-a087-c9d01c9b4a17 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.917744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafce91-a548-4759-a087-c9d01c9b4a17 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.918025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafce91-a548-4759-a087-c9d01c9b4a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.937842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-5fafce91-a548-4759-a087-c9d01c9b4a17 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:04.939123 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-5fafce91-a548-4759-a087-c9d01c9b4a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:04.946687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:04.952313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf44fb-976a-4751-9456-cbfed41a2ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:04.953318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf44fb-976a-4751-9456-cbfed41a2ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.953770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf44fb-976a-4751-9456-cbfed41a2ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.954239 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf44fb-976a-4751-9456-cbfed41a2ee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.961909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf44fb-976a-4751-9456-cbfed41a2ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:04.963687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf44fb-976a-4751-9456-cbfed41a2ee0 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-d5bf44fb-976a-4751-9456-cbfed41a2ee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:04.976969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:04.977878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:04.978724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:04.978724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:04.978724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:04.978724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:04.978724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:04.978724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:04.978724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:04.978724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:04.980923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 271/539] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:04.981986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf44fb-976a-4751-9456-cbfed41a2ee0 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:05.024717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 269/540] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:05.024717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafce91-a548-4759-a087-c9d01c9b4a17 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:05.125400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:05.146996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafce91-a548-4759-a087-c9d01c9b4a17 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:05.180520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf44fb-976a-4751-9456-cbfed41a2ee0 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:05.194348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298fbfd-ddf9-4ad9-8ee9-ef7e24e544dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:05.194960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298fbfd-ddf9-4ad9-8ee9-ef7e24e544dc None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:05.195238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298fbfd-ddf9-4ad9-8ee9-ef7e24e544dc None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:05.195507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298fbfd-ddf9-4ad9-8ee9-ef7e24e544dc None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:05.196199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298fbfd-ddf9-4ad9-8ee9-ef7e24e544dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:05.196502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298fbfd-ddf9-4ad9-8ee9-ef7e24e544dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:05.200197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298fbfd-ddf9-4ad9-8ee9-ef7e24e544dc None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:05.227716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 270/541] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:05.247273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298fbfd-ddf9-4ad9-8ee9-ef7e24e544dc None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:05.266009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ced0dd-9cfe-4070-8708-764e5362b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:05.266634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ced0dd-9cfe-4070-8708-764e5362b190 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:05.266917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ced0dd-9cfe-4070-8708-764e5362b190 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:05.267192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ced0dd-9cfe-4070-8708-764e5362b190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:05.267930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ced0dd-9cfe-4070-8708-764e5362b190 None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=e91f048f8885448383f4a361b07dac4f) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:05.268240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ced0dd-9cfe-4070-8708-764e5362b190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:05.270056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ced0dd-9cfe-4070-8708-764e5362b190 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:05.295267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 272/542] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:04 2022] GET /identity/v3/role_assignments?user.id=e91f048f8885448383f4a361b07dac4f&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:05.374729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ced0dd-9cfe-4070-8708-764e5362b190 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:05.392715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298fbfd-ddf9-4ad9-8ee9-ef7e24e544dc None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:05.430111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654308f-e869-4f35-9fe5-465e42367b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:05.430941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654308f-e869-4f35-9fe5-465e42367b5a None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:05.431221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654308f-e869-4f35-9fe5-465e42367b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:05.431495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654308f-e869-4f35-9fe5-465e42367b5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:05.432228 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654308f-e869-4f35-9fe5-465e42367b5a None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=c901e018aa1c429da33b5809873d0aea) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:05.432535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654308f-e869-4f35-9fe5-465e42367b5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:05.434400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654308f-e869-4f35-9fe5-465e42367b5a None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:05.448734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 271/543] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:05 2022] GET /identity/v3/role_assignments?user.id=c901e018aa1c429da33b5809873d0aea&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:05.484233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:05.561493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ced0dd-9cfe-4070-8708-764e5362b190 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:05.614312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a870b77-a055-42c2-89f1-171730a2125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:05.615355 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a870b77-a055-42c2-89f1-171730a2125f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:05.615868 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a870b77-a055-42c2-89f1-171730a2125f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:05.616358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a870b77-a055-42c2-89f1-171730a2125f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:05.635944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a870b77-a055-42c2-89f1-171730a2125f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-8a870b77-a055-42c2-89f1-171730a2125f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:05.642766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:05.643969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:05.644805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:05.644805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:05.644805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:05.644805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:05.644805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:05.644805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:05.644805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:05.644805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:05.644805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:05.644805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:05.644805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:05.644805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:05.647661 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 273/544] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:05.655821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654308f-e869-4f35-9fe5-465e42367b5a None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:05.663789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:05.798833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654308f-e869-4f35-9fe5-465e42367b5a None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:05.843598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303f37e-26ca-47a4-8151-862430bff566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:05.844212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303f37e-26ca-47a4-8151-862430bff566 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:05.844486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303f37e-26ca-47a4-8151-862430bff566 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:05.845690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303f37e-26ca-47a4-8151-862430bff566 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:05.845690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303f37e-26ca-47a4-8151-862430bff566 None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:05.846685 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303f37e-26ca-47a4-8151-862430bff566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:05.848076 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303f37e-26ca-47a4-8151-862430bff566 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:05.861040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 272/545] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:05.863336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a870b77-a055-42c2-89f1-171730a2125f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:05.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a870b77-a055-42c2-89f1-171730a2125f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:05.998109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:06.021769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49483df-f621-4613-baf5-acee8d1e8e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:06.022406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49483df-f621-4613-baf5-acee8d1e8e8b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:06.022687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49483df-f621-4613-baf5-acee8d1e8e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:06.022960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49483df-f621-4613-baf5-acee8d1e8e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:06.039372 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49483df-f621-4613-baf5-acee8d1e8e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:06.040872 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49483df-f621-4613-baf5-acee8d1e8e8b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-e49483df-f621-4613-baf5-acee8d1e8e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:06.057041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:06.058185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:06.059229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:06.059229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:06.059229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:06.059229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 274/546] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:06.065479 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303f37e-26ca-47a4-8151-862430bff566 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:06.171657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:06.214450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303f37e-26ca-47a4-8151-862430bff566 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:06.257494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedce594-c10b-4862-aa55-025b249d1ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:06.258109 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedce594-c10b-4862-aa55-025b249d1ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:06.258387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedce594-c10b-4862-aa55-025b249d1ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:06.258657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedce594-c10b-4862-aa55-025b249d1ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:06.259294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedce594-c10b-4862-aa55-025b249d1ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:06.259591 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedce594-c10b-4862-aa55-025b249d1ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:06.260994 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedce594-c10b-4862-aa55-025b249d1ef8 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:06.276393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 273/547] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:06.281846 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49483df-f621-4613-baf5-acee8d1e8e8b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:06.445934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49483df-f621-4613-baf5-acee8d1e8e8b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:06.494439 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cab6d-a6c0-46f8-bc3a-0a11cef8e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:06.495167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cab6d-a6c0-46f8-bc3a-0a11cef8e990 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:06.495396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cab6d-a6c0-46f8-bc3a-0a11cef8e990 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:06.495670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cab6d-a6c0-46f8-bc3a-0a11cef8e990 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:06.504572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78cab6d-a6c0-46f8-bc3a-0a11cef8e990 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:06.506055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78cab6d-a6c0-46f8-bc3a-0a11cef8e990 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-e78cab6d-a6c0-46f8-bc3a-0a11cef8e990 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:06.526031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:06.527556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:06.529212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:06.529212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:06.529212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:06.529212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:06.529212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:06.529212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:06.529212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:06.529212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:06.529212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:57:06.529212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:06.529212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 275/548] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:57:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:06.533192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedce594-c10b-4862-aa55-025b249d1ef8 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:06.718348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedce594-c10b-4862-aa55-025b249d1ef8 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:06.752721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:06.767803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6d273-1645-428a-9f79-9f92a6963cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:06.769077 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6d273-1645-428a-9f79-9f92a6963cdf None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:06.769566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6d273-1645-428a-9f79-9f92a6963cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:06.770063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6d273-1645-428a-9f79-9f92a6963cdf None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:06.771001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6d273-1645-428a-9f79-9f92a6963cdf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:06.771511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6d273-1645-428a-9f79-9f92a6963cdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:06.773190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6d273-1645-428a-9f79-9f92a6963cdf None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:06.792516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 274/549] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Sep 7 15:57:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:06.800713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cab6d-a6c0-46f8-bc3a-0a11cef8e990 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:06.862453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:06.955310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cab6d-a6c0-46f8-bc3a-0a11cef8e990 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:06.967560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535a13f-29f8-4013-93db-9a6166becc2b None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:06.967892 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535a13f-29f8-4013-93db-9a6166becc2b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:06.968110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535a13f-29f8-4013-93db-9a6166becc2b None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:06.969939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 275/550] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:06.974904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1ef1-6f97-4d8c-b1d1-e5b18cae6ae6 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:06.975188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1ef1-6f97-4d8c-b1d1-e5b18cae6ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:06.975462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1ef1-6f97-4d8c-b1d1-e5b18cae6ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:06.999303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645deb7-b013-430f-8555-123d6f82b75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:06.999841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645deb7-b013-430f-8555-123d6f82b75b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:07.000122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645deb7-b013-430f-8555-123d6f82b75b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:07.000398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645deb7-b013-430f-8555-123d6f82b75b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:07.008426 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e29d1ef1-6f97-4d8c-b1d1-e5b18cae6ae6 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:07.012203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e29d1ef1-6f97-4d8c-b1d1-e5b18cae6ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:07.117851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 276/551] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:57:07.129705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645deb7-b013-430f-8555-123d6f82b75b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:07.131378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645deb7-b013-430f-8555-123d6f82b75b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:07.161551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:07.260521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 276/552] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:07.265710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1ef1-6f97-4d8c-b1d1-e5b18cae6ae6 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:07.416676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1ef1-6f97-4d8c-b1d1-e5b18cae6ae6 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:07.431603 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:07.461925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742b6cc-8338-4bef-a462-d54fab37bcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:07.462571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742b6cc-8338-4bef-a462-d54fab37bcee None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:07.462854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742b6cc-8338-4bef-a462-d54fab37bcee None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:07.463130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742b6cc-8338-4bef-a462-d54fab37bcee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:07.475617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742b6cc-8338-4bef-a462-d54fab37bcee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:07.477160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742b6cc-8338-4bef-a462-d54fab37bcee None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-f742b6cc-8338-4bef-a462-d54fab37bcee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:07.496641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:07.498130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:07.499005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:07.499005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:07.499005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:07.499005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 277/553] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:07.504569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645deb7-b013-430f-8555-123d6f82b75b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:07.517796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742b6cc-8338-4bef-a462-d54fab37bcee None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:07.650560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742b6cc-8338-4bef-a462-d54fab37bcee None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:07.652859 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645deb7-b013-430f-8555-123d6f82b75b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:07.687222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:07.697385 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9441b-a909-4d8f-8c4c-ebd6e3c06c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:07.698485 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9441b-a909-4d8f-8c4c-ebd6e3c06c78 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:07.698761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9441b-a909-4d8f-8c4c-ebd6e3c06c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:07.699093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9441b-a909-4d8f-8c4c-ebd6e3c06c78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:07.707307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea159d-312b-460a-94d1-3cc29eae9c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:07.707930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea159d-312b-460a-94d1-3cc29eae9c0b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:07.708237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea159d-312b-460a-94d1-3cc29eae9c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:07.708797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea159d-312b-460a-94d1-3cc29eae9c0b None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:07.709872 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea159d-312b-460a-94d1-3cc29eae9c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:07.710178 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea159d-312b-460a-94d1-3cc29eae9c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:07.711708 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea159d-312b-460a-94d1-3cc29eae9c0b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:07.712368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9441b-a909-4d8f-8c4c-ebd6e3c06c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-9ed9441b-a909-4d8f-8c4c-ebd6e3c06c78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:07.719476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:07.721343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 278/554] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:07.723307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13235e-422d-486e-8116-2fba3679cab1 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:07.725644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13235e-422d-486e-8116-2fba3679cab1 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:07.725644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13235e-422d-486e-8116-2fba3679cab1 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:07.732806 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 279/555] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:07.732806 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13235e-422d-486e-8116-2fba3679cab1 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:07.733167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 277/556] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:07.733167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8781b0-6017-4a4f-a903-34a74cf19212 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:07.733167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8781b0-6017-4a4f-a903-34a74cf19212 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:07.733167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8781b0-6017-4a4f-a903-34a74cf19212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:07.756915 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-4e8781b0-6017-4a4f-a903-34a74cf19212 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:07.758423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4e8781b0-6017-4a4f-a903-34a74cf19212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:07.767718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:07.854193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 278/557] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:07.855127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8781b0-6017-4a4f-a903-34a74cf19212 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:07.894657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13235e-422d-486e-8116-2fba3679cab1 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:07.977909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8781b0-6017-4a4f-a903-34a74cf19212 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:07.989490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b8c19-1b91-49bb-92b0-8781ebdcf8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:07.990407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b8c19-1b91-49bb-92b0-8781ebdcf8af None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:07.990854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b8c19-1b91-49bb-92b0-8781ebdcf8af None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:07.991311 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b8c19-1b91-49bb-92b0-8781ebdcf8af None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:07.992161 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b8c19-1b91-49bb-92b0-8781ebdcf8af None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:07.992655 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b8c19-1b91-49bb-92b0-8781ebdcf8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:07.994734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b8c19-1b91-49bb-92b0-8781ebdcf8af None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:07.999008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:08.019172 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 280/558] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:08.020906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d78c08-018b-47b1-a674-9a0b148f81cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:08.021789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d78c08-018b-47b1-a674-9a0b148f81cb None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.022254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d78c08-018b-47b1-a674-9a0b148f81cb None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.022667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d78c08-018b-47b1-a674-9a0b148f81cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.025359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b8c19-1b91-49bb-92b0-8781ebdcf8af None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:08.032470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d78c08-018b-47b1-a674-9a0b148f81cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:08.035317 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d78c08-018b-47b1-a674-9a0b148f81cb None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-38d78c08-018b-47b1-a674-9a0b148f81cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:08.048836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:08.049820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:08.050711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:08.050711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:08.050711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:08.050711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:08.050711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:08.050711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:08.050711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:08.050711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:08.053055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 279/559] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:08.059622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d78c08-018b-47b1-a674-9a0b148f81cb None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:08.227983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:08.237904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d78c08-018b-47b1-a674-9a0b148f81cb None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:08.250736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b8c19-1b91-49bb-92b0-8781ebdcf8af None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:08.285984 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba3a28-c919-43ca-bdb1-903abc4ce51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:08.286615 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba3a28-c919-43ca-bdb1-903abc4ce51c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.286899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba3a28-c919-43ca-bdb1-903abc4ce51c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.287350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba3a28-c919-43ca-bdb1-903abc4ce51c None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.287877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba3a28-c919-43ca-bdb1-903abc4ce51c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:08.288203 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba3a28-c919-43ca-bdb1-903abc4ce51c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:08.289716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba3a28-c919-43ca-bdb1-903abc4ce51c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:08.293457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0c51c-c04b-452c-91ad-73a1f03c8e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:08.294197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c51c-c04b-452c-91ad-73a1f03c8e43 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.294532 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c51c-c04b-452c-91ad-73a1f03c8e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.294532 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c51c-c04b-452c-91ad-73a1f03c8e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.303486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 280/560] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:08.305087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b12787-544c-43ae-876b-f7727c25b69b None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.305378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b12787-544c-43ae-876b-f7727c25b69b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.305654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b12787-544c-43ae-876b-f7727c25b69b None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.308234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 281/561] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:08.308234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b006f4-a16e-40f1-92cb-5f2a79916a0c None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.308528 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b006f4-a16e-40f1-92cb-5f2a79916a0c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.308862 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b006f4-a16e-40f1-92cb-5f2a79916a0c None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.310240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0c51c-c04b-452c-91ad-73a1f03c8e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:08.310730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 282/562] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:08.311610 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b006f4-a16e-40f1-92cb-5f2a79916a0c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:08.312024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0c51c-c04b-452c-91ad-73a1f03c8e43 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-6de0c51c-c04b-452c-91ad-73a1f03c8e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:08.327573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:08.329536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:08.331129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:08.331129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:08.331129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:08.331129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 281/563] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:08.331129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0c51c-c04b-452c-91ad-73a1f03c8e43 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:08.358750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:08.426485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b006f4-a16e-40f1-92cb-5f2a79916a0c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:08.440908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0c51c-c04b-452c-91ad-73a1f03c8e43 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:08.463013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043592c-8caf-4592-96ac-91eaea6c910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:08.463638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043592c-8caf-4592-96ac-91eaea6c910b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.463918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043592c-8caf-4592-96ac-91eaea6c910b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.464186 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043592c-8caf-4592-96ac-91eaea6c910b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.474319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043592c-8caf-4592-96ac-91eaea6c910b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:08.475341 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d2375-1316-48f3-9dfb-c3e34744fbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:08.475943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2375-1316-48f3-9dfb-c3e34744fbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.476224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2375-1316-48f3-9dfb-c3e34744fbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.476498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2375-1316-48f3-9dfb-c3e34744fbf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.477293 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d2375-1316-48f3-9dfb-c3e34744fbf5 None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=d853bab10d9d4060809476bfc44d3822) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:08.477605 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d2375-1316-48f3-9dfb-c3e34744fbf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:08.479079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d2375-1316-48f3-9dfb-c3e34744fbf5 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-2043592c-8caf-4592-96ac-91eaea6c910b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:08.479448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:08.480342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 283/564] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:08.484350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14a4d-b8e1-4acc-b345-0077b5460963 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.485923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14a4d-b8e1-4acc-b345-0077b5460963 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.485923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14a4d-b8e1-4acc-b345-0077b5460963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.499197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 282/565] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:08 2022] GET /identity/v3/role_assignments?user.id=d853bab10d9d4060809476bfc44d3822&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:08.499197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5c9da-fa7e-48d4-a64d-194af5004adb None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.499197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5c9da-fa7e-48d4-a64d-194af5004adb None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.499197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5c9da-fa7e-48d4-a64d-194af5004adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.499651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:08.513850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-0bb14a4d-b8e1-4acc-b345-0077b5460963 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:08.515095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0bb14a4d-b8e1-4acc-b345-0077b5460963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:08.515671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9ae5c9da-fa7e-48d4-a64d-194af5004adb None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:08.516914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9ae5c9da-fa7e-48d4-a64d-194af5004adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:08.609671 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 284/566] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:08.610541 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb14a4d-b8e1-4acc-b345-0077b5460963 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:08.631590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 283/567] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:08.633014 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5c9da-fa7e-48d4-a64d-194af5004adb None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:08.683297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:08.772374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb14a4d-b8e1-4acc-b345-0077b5460963 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:08.774240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5c9da-fa7e-48d4-a64d-194af5004adb None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:08.811462 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c986c9-78e8-4166-a638-ad4f1a99bb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:08.812037 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:08.812149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c986c9-78e8-4166-a638-ad4f1a99bb2c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.812340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c986c9-78e8-4166-a638-ad4f1a99bb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.812609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c986c9-78e8-4166-a638-ad4f1a99bb2c None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.813390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c986c9-78e8-4166-a638-ad4f1a99bb2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:08.813580 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c986c9-78e8-4166-a638-ad4f1a99bb2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:08.815136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c986c9-78e8-4166-a638-ad4f1a99bb2c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:08.820829 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ed1cc-075e-4cbe-8473-e2d818813c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:08.821745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ed1cc-075e-4cbe-8473-e2d818813c5e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.822245 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ed1cc-075e-4cbe-8473-e2d818813c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.822846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ed1cc-075e-4cbe-8473-e2d818813c5e None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.823780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ed1cc-075e-4cbe-8473-e2d818813c5e None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:08.824302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ed1cc-075e-4cbe-8473-e2d818813c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:08.826671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ed1cc-075e-4cbe-8473-e2d818813c5e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:08.829086 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 285/568] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:08.834636 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c986c9-78e8-4166-a638-ad4f1a99bb2c None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:08.837456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 284/569] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:08.845944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ed1cc-075e-4cbe-8473-e2d818813c5e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:08.986358 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ed1cc-075e-4cbe-8473-e2d818813c5e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:08.988060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:09.002267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c986c9-78e8-4166-a638-ad4f1a99bb2c None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.040310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecdab3-c3ed-4445-bc36-02f4d4e3b79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.041003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecdab3-c3ed-4445-bc36-02f4d4e3b79e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.041370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecdab3-c3ed-4445-bc36-02f4d4e3b79e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.041640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecdab3-c3ed-4445-bc36-02f4d4e3b79e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.046955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bc006-63da-4407-bf5d-18d723390fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.047904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bc006-63da-4407-bf5d-18d723390fcd None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.048385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bc006-63da-4407-bf5d-18d723390fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.048889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bc006-63da-4407-bf5d-18d723390fcd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.056229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecdab3-c3ed-4445-bc36-02f4d4e3b79e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.057502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bc006-63da-4407-bf5d-18d723390fcd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.057730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecdab3-c3ed-4445-bc36-02f4d4e3b79e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.059596 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bc006-63da-4407-bf5d-18d723390fcd None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-eb8bc006-63da-4407-bf5d-18d723390fcd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:09.072719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:09.073754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:09.080629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:09.080629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:09.080629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:09.080629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:09.080629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:09.080629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:09.080629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:09.080629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:09.080629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:57:09.080629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-22ecdab3-c3ed-4445-bc36-02f4d4e3b79e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:09.081274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:09.082121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:09.084436 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:09.084436 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:09.084436 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:09.084646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 286/570] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Sep 7 15:57:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:09.084646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bc006-63da-4407-bf5d-18d723390fcd None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.084941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 285/571] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:09.084941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecdab3-c3ed-4445-bc36-02f4d4e3b79e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.145067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:09.202820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bc006-63da-4407-bf5d-18d723390fcd None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.214462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecdab3-c3ed-4445-bc36-02f4d4e3b79e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.251577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd8b70-52f5-4db0-996b-78761ff18069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.251577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd8b70-52f5-4db0-996b-78761ff18069 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.251855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd8b70-52f5-4db0-996b-78761ff18069 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.252485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd8b70-52f5-4db0-996b-78761ff18069 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.258870 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e68d8-c6b2-4288-b943-ebc306e840e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.259834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e68d8-c6b2-4288-b943-ebc306e840e6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.259834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e68d8-c6b2-4288-b943-ebc306e840e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.260152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e68d8-c6b2-4288-b943-ebc306e840e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.271456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd8b70-52f5-4db0-996b-78761ff18069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-01bd8b70-52f5-4db0-996b-78761ff18069 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:09.280459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:09.284735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 287/572] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:09.285809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd8b70-52f5-4db0-996b-78761ff18069 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.289032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e68d8-c6b2-4288-b943-ebc306e840e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-759e68d8-c6b2-4288-b943-ebc306e840e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:09.296653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:09.297711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:09.298596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:09.298596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:09.298596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:09.298596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:09.298596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:09.298596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:09.298596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:09.298596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:09.298596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:09.298596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:09.298596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:09.298596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:09.299258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 286/573] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:09.299875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e68d8-c6b2-4288-b943-ebc306e840e6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.306290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:09.421114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd8b70-52f5-4db0-996b-78761ff18069 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.431420 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e68d8-c6b2-4288-b943-ebc306e840e6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.442031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:09.473253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d515ca0-ebbd-414c-93c4-5a31472b00d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.473865 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d515ca0-ebbd-414c-93c4-5a31472b00d8 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.474143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d515ca0-ebbd-414c-93c4-5a31472b00d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.474411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d515ca0-ebbd-414c-93c4-5a31472b00d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.475059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d515ca0-ebbd-414c-93c4-5a31472b00d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:09.475362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d515ca0-ebbd-414c-93c4-5a31472b00d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.477001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d515ca0-ebbd-414c-93c4-5a31472b00d8 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.486652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c5da7-2bd9-44fa-ab63-5b68100e97ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.487333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c5da7-2bd9-44fa-ab63-5b68100e97ca None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.487621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c5da7-2bd9-44fa-ab63-5b68100e97ca None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.488172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c5da7-2bd9-44fa-ab63-5b68100e97ca None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.489044 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c5da7-2bd9-44fa-ab63-5b68100e97ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:09.489387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c5da7-2bd9-44fa-ab63-5b68100e97ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.494500 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 287/574] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:09.494500 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d515ca0-ebbd-414c-93c4-5a31472b00d8 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.494705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c5da7-2bd9-44fa-ab63-5b68100e97ca None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.514301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 288/575] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Sep 7 15:57:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:09.515032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c5da7-2bd9-44fa-ab63-5b68100e97ca None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.589968 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:09.615431 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d515ca0-ebbd-414c-93c4-5a31472b00d8 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.632217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c5da7-2bd9-44fa-ab63-5b68100e97ca None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.652177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3bf7e-f6e3-4e33-9e5f-1c1f2092101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.652839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3bf7e-f6e3-4e33-9e5f-1c1f2092101d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.653116 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3bf7e-f6e3-4e33-9e5f-1c1f2092101d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.653392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3bf7e-f6e3-4e33-9e5f-1c1f2092101d None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.654638 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3bf7e-f6e3-4e33-9e5f-1c1f2092101d None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:09.654949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3bf7e-f6e3-4e33-9e5f-1c1f2092101d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.656375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3bf7e-f6e3-4e33-9e5f-1c1f2092101d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.670834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 288/576] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:09.670834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3bf7e-f6e3-4e33-9e5f-1c1f2092101d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.678550 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d3d8-961b-418a-b10d-523b99cf7073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.679153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d3d8-961b-418a-b10d-523b99cf7073 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.679429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d3d8-961b-418a-b10d-523b99cf7073 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.679697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d3d8-961b-418a-b10d-523b99cf7073 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.680356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d3d8-961b-418a-b10d-523b99cf7073 None admin] RBAC: Adding query filter params (name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:09.680736 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d3d8-961b-418a-b10d-523b99cf7073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.682617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d3d8-961b-418a-b10d-523b99cf7073 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.692341 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 289/577] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:09.693058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d3d8-961b-418a-b10d-523b99cf7073 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:09.802203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3bf7e-f6e3-4e33-9e5f-1c1f2092101d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.820106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d3d8-961b-418a-b10d-523b99cf7073 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.841233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2462da7-d6fb-4a22-9943-15eb01654e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.841804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2462da7-d6fb-4a22-9943-15eb01654e00 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.842301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2462da7-d6fb-4a22-9943-15eb01654e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.842586 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2462da7-d6fb-4a22-9943-15eb01654e00 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.850153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:09.852007 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2462da7-d6fb-4a22-9943-15eb01654e00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.853601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2462da7-d6fb-4a22-9943-15eb01654e00 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.860012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc3afb-1873-4cb8-ab86-666943534ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.860791 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc3afb-1873-4cb8-ab86-666943534ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.861178 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc3afb-1873-4cb8-ab86-666943534ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.861576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc3afb-1873-4cb8-ab86-666943534ab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-d2462da7-d6fb-4a22-9943-15eb01654e00 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:09.865440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:09.866537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:09.867788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:09.867788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:09.867788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:09.867788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:09.867788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:09.867788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:09.867788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:09.867788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:09.867788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 15:57:09.867788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:09.867788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 289/578] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:57:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:09.867788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2462da7-d6fb-4a22-9943-15eb01654e00 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.879106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc3afb-1873-4cb8-ab86-666943534ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.880568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc3afb-1873-4cb8-ab86-666943534ab8 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-48bc3afb-1873-4cb8-ab86-666943534ab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:09.899664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:09.900660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:09.901621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:09.901621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:09.901621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:09.901621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 290/579] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:09.901621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc3afb-1873-4cb8-ab86-666943534ab8 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.973184 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:09.989588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2462da7-d6fb-4a22-9943-15eb01654e00 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.022748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc3afb-1873-4cb8-ab86-666943534ab8 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.030482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83160cfe-fd54-4cc9-977c-393f6e6bf7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.031009 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83160cfe-fd54-4cc9-977c-393f6e6bf7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.031287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83160cfe-fd54-4cc9-977c-393f6e6bf7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.031558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83160cfe-fd54-4cc9-977c-393f6e6bf7b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.045467 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83160cfe-fd54-4cc9-977c-393f6e6bf7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.047103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83160cfe-fd54-4cc9-977c-393f6e6bf7b8 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.060886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b1f2b-950c-4cb3-b00d-4e6f25af529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.061523 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b1f2b-950c-4cb3-b00d-4e6f25af529d None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.061802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b1f2b-950c-4cb3-b00d-4e6f25af529d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.062129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b1f2b-950c-4cb3-b00d-4e6f25af529d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-83160cfe-fd54-4cc9-977c-393f6e6bf7b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:10.063956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:10.065115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:10.066236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:10.066236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:10.066236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:10.066236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 290/580] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:10.066236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83160cfe-fd54-4cc9-977c-393f6e6bf7b8 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.078933 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b1f2b-950c-4cb3-b00d-4e6f25af529d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.080469 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b1f2b-950c-4cb3-b00d-4e6f25af529d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-d49b1f2b-950c-4cb3-b00d-4e6f25af529d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:10.095366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:10.096500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:10.097662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:10.097662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:10.097662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:10.101033 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 291/581] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:10.101962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b1f2b-950c-4cb3-b00d-4e6f25af529d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.140124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:10.183758 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83160cfe-fd54-4cc9-977c-393f6e6bf7b8 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.218036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b1f2b-950c-4cb3-b00d-4e6f25af529d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.228473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9b216-d95f-40e4-8cbc-f240c1ae0711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.229305 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b216-d95f-40e4-8cbc-f240c1ae0711 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.229588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b216-d95f-40e4-8cbc-f240c1ae0711 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.229861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b216-d95f-40e4-8cbc-f240c1ae0711 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.230596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9b216-d95f-40e4-8cbc-f240c1ae0711 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:10.230899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9b216-d95f-40e4-8cbc-f240c1ae0711 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.233179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9b216-d95f-40e4-8cbc-f240c1ae0711 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.243866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:10.258260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 291/582] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Sep 7 15:57:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:10.258260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9b216-d95f-40e4-8cbc-f240c1ae0711 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.271685 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc4f18-ca85-49ac-8d01-f73804443b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.273384 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc4f18-ca85-49ac-8d01-f73804443b64 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.273573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc4f18-ca85-49ac-8d01-f73804443b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.273862 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc4f18-ca85-49ac-8d01-f73804443b64 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.274491 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc4f18-ca85-49ac-8d01-f73804443b64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:10.274797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc4f18-ca85-49ac-8d01-f73804443b64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.276254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc4f18-ca85-49ac-8d01-f73804443b64 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.290055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 292/583] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:10.291013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc4f18-ca85-49ac-8d01-f73804443b64 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.389622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9b216-d95f-40e4-8cbc-f240c1ae0711 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.418130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:10.429302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbda97-e7f9-4078-a3f7-bf38ed69fb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.429493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc4f18-ca85-49ac-8d01-f73804443b64 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.430011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbda97-e7f9-4078-a3f7-bf38ed69fb12 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.430295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbda97-e7f9-4078-a3f7-bf38ed69fb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.430567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbda97-e7f9-4078-a3f7-bf38ed69fb12 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.431212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbda97-e7f9-4078-a3f7-bf38ed69fb12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:10.431515 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbda97-e7f9-4078-a3f7-bf38ed69fb12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.432923 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbda97-e7f9-4078-a3f7-bf38ed69fb12 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.451477 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 292/584] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:10.452452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbda97-e7f9-4078-a3f7-bf38ed69fb12 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.468905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a303a0-5711-4fda-8218-46357b2fdd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.469513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a303a0-5711-4fda-8218-46357b2fdd51 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.469795 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a303a0-5711-4fda-8218-46357b2fdd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.470059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a303a0-5711-4fda-8218-46357b2fdd51 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.470692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a303a0-5711-4fda-8218-46357b2fdd51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:10.470989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a303a0-5711-4fda-8218-46357b2fdd51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.472349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a303a0-5711-4fda-8218-46357b2fdd51 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.489048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 293/585] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:10.489048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a303a0-5711-4fda-8218-46357b2fdd51 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.524548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:10.581552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbda97-e7f9-4078-a3f7-bf38ed69fb12 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.597879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a303a0-5711-4fda-8218-46357b2fdd51 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.617608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bc42c-3f10-4844-90c5-0357b1334d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.618353 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bc42c-3f10-4844-90c5-0357b1334d53 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.618703 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bc42c-3f10-4844-90c5-0357b1334d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.619092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bc42c-3f10-4844-90c5-0357b1334d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.632028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bc42c-3f10-4844-90c5-0357b1334d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.633627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bc42c-3f10-4844-90c5-0357b1334d53 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.634155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde536e1-86cf-4360-849e-c133093a5e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.634817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde536e1-86cf-4360-849e-c133093a5e63 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.635160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde536e1-86cf-4360-849e-c133093a5e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.635496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde536e1-86cf-4360-849e-c133093a5e63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.643353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde536e1-86cf-4360-849e-c133093a5e63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.645095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde536e1-86cf-4360-849e-c133093a5e63 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-954bc42c-3f10-4844-90c5-0357b1334d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:10.650761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:10.651897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:10.653154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:10.653154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:10.653154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:10.656893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 293/586] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:10.657507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bc42c-3f10-4844-90c5-0357b1334d53 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-dde536e1-86cf-4360-849e-c133093a5e63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:10.659542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:10.660572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:10.661881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:10.661881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:10.661881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:10.661881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:10.661881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:10.661881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:10.661881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:10.661881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:10.662687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 294/587] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:10.663315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde536e1-86cf-4360-849e-c133093a5e63 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.679319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:10.775588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bc42c-3f10-4844-90c5-0357b1334d53 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.781777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde536e1-86cf-4360-849e-c133093a5e63 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.788554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:10.816258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53527731-eb3e-474d-8ac4-cb55916cdcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.816953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fba05-a27f-4b09-9774-7f5c4fa65723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.817173 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527731-eb3e-474d-8ac4-cb55916cdcd9 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.817558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527731-eb3e-474d-8ac4-cb55916cdcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.817711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fba05-a27f-4b09-9774-7f5c4fa65723 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.818014 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527731-eb3e-474d-8ac4-cb55916cdcd9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.818195 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fba05-a27f-4b09-9774-7f5c4fa65723 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.818410 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fba05-a27f-4b09-9774-7f5c4fa65723 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.826825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fba05-a27f-4b09-9774-7f5c4fa65723 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.827032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53527731-eb3e-474d-8ac4-cb55916cdcd9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.828254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fba05-a27f-4b09-9774-7f5c4fa65723 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.828666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53527731-eb3e-474d-8ac4-cb55916cdcd9 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-53527731-eb3e-474d-8ac4-cb55916cdcd9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:10.840280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:10.846873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:10.848592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:10.848592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:10.848592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:10.848592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:10.848592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:10.848592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:10.848592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:10.848592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:10.848592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 15:57:10.848592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-4f2fba05-a27f-4b09-9774-7f5c4fa65723 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:10.849443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:10.850456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:10.851666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:10.851666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:10.851666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:10.851666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:10.851666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:10.851666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:10.851666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:10.851666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:10.851666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:57:10.851666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:10.851666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 295/588] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:57:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:10.851666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fba05-a27f-4b09-9774-7f5c4fa65723 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.852442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 294/589] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:10.852442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53527731-eb3e-474d-8ac4-cb55916cdcd9 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.929341 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:10.965393 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fba05-a27f-4b09-9774-7f5c4fa65723 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.965626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53527731-eb3e-474d-8ac4-cb55916cdcd9 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.002509 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c40684-47ec-4ad3-aafe-a0f754362f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.002785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fbbb5-6138-4be6-ab79-a2403f576c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.003117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c40684-47ec-4ad3-aafe-a0f754362f31 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.003272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fbbb5-6138-4be6-ab79-a2403f576c11 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.003505 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c40684-47ec-4ad3-aafe-a0f754362f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.003612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fbbb5-6138-4be6-ab79-a2403f576c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.003777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c40684-47ec-4ad3-aafe-a0f754362f31 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.003867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fbbb5-6138-4be6-ab79-a2403f576c11 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.004413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fbbb5-6138-4be6-ab79-a2403f576c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:11.004512 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c40684-47ec-4ad3-aafe-a0f754362f31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:11.004737 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fbbb5-6138-4be6-ab79-a2403f576c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.004830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c40684-47ec-4ad3-aafe-a0f754362f31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.006129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fbbb5-6138-4be6-ab79-a2403f576c11 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.006217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c40684-47ec-4ad3-aafe-a0f754362f31 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.019207 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 295/590] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:11.019375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 296/591] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:11.019857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c40684-47ec-4ad3-aafe-a0f754362f31 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.020003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fbbb5-6138-4be6-ab79-a2403f576c11 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.051654 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:11.120741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fbbb5-6138-4be6-ab79-a2403f576c11 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.121409 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c40684-47ec-4ad3-aafe-a0f754362f31 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.151316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:11.156738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ff130-064b-45be-9d47-bc08c9b504d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.156919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b048dbc-4b3e-4e0e-a865-ab135d84ecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.157343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ff130-064b-45be-9d47-bc08c9b504d0 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.157448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b048dbc-4b3e-4e0e-a865-ab135d84ecc2 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.157619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ff130-064b-45be-9d47-bc08c9b504d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.157719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b048dbc-4b3e-4e0e-a865-ab135d84ecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.157888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ff130-064b-45be-9d47-bc08c9b504d0 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.157988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b048dbc-4b3e-4e0e-a865-ab135d84ecc2 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.158601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ff130-064b-45be-9d47-bc08c9b504d0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:11.158692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b048dbc-4b3e-4e0e-a865-ab135d84ecc2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:11.158901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ff130-064b-45be-9d47-bc08c9b504d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.158992 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b048dbc-4b3e-4e0e-a865-ab135d84ecc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.160310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ff130-064b-45be-9d47-bc08c9b504d0 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.160403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b048dbc-4b3e-4e0e-a865-ab135d84ecc2 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.177519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 297/592] 10.222.0.43 () {56 vars in 1139 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:11.182494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 296/593] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:11.182643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11387d0d-8ce4-45d6-a557-5107d5d06426 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.182643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11387d0d-8ce4-45d6-a557-5107d5d06426 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.182643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11387d0d-8ce4-45d6-a557-5107d5d06426 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.182909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b048dbc-4b3e-4e0e-a865-ab135d84ecc2 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.182992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 298/594] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:11.182992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11387d0d-8ce4-45d6-a557-5107d5d06426 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.275769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:11.287845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11387d0d-8ce4-45d6-a557-5107d5d06426 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.288503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b048dbc-4b3e-4e0e-a865-ab135d84ecc2 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.327391 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecee7c2-049d-4fc2-a7fc-0476f77f93c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.328051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecee7c2-049d-4fc2-a7fc-0476f77f93c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.328335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecee7c2-049d-4fc2-a7fc-0476f77f93c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.328615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecee7c2-049d-4fc2-a7fc-0476f77f93c6 None admin] PATH_INFO: `/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/9d71c0688ea84c05af925f3fb08f35ad/roles/aa755d19c52f4e299b98898217cbc688` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.330067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebdb6f-d19d-4ea7-b591-ac7976e52ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.330695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebdb6f-d19d-4ea7-b591-ac7976e52ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.330977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebdb6f-d19d-4ea7-b591-ac7976e52ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.331248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebdb6f-d19d-4ea7-b591-ac7976e52ea4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.337969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebdb6f-d19d-4ea7-b591-ac7976e52ea4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.339402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebdb6f-d19d-4ea7-b591-ac7976e52ea4 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.343496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecee7c2-049d-4fc2-a7fc-0476f77f93c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=983beac5fc784756b6bdf11b07e219ac, user_id=9d71c0688ea84c05af925f3fb08f35ad, role_id=aa755d19c52f4e299b98898217cbc688)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.344997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecee7c2-049d-4fc2-a7fc-0476f77f93c6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-1eebdb6f-d19d-4ea7-b591-ac7976e52ea4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:11.355750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:11.356889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:11.357821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:11.357821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:11.357821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:11.357821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:11.357821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:11.357821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:11.357821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:11.357821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:11.357821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 299/595] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:11.357821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebdb6f-d19d-4ea7-b591-ac7976e52ea4 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.358538 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 297/596] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:57:11 2022] PUT /identity/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/9d71c0688ea84c05af925f3fb08f35ad/roles/aa755d19c52f4e299b98898217cbc688 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:11.359052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecee7c2-049d-4fc2-a7fc-0476f77f93c6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.427872 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:11.485270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecee7c2-049d-4fc2-a7fc-0476f77f93c6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.488105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebdb6f-d19d-4ea7-b591-ac7976e52ea4 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.524370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb836650-b812-420f-a10d-e0dd7a48563a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.525153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb836650-b812-420f-a10d-e0dd7a48563a None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.525510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb836650-b812-420f-a10d-e0dd7a48563a None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.525849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb836650-b812-420f-a10d-e0dd7a48563a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.527681 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2cab9-5268-4d52-b4b1-af6de14658db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.528321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2cab9-5268-4d52-b4b1-af6de14658db None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.529657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2cab9-5268-4d52-b4b1-af6de14658db None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.530016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2cab9-5268-4d52-b4b1-af6de14658db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.534679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:11.539917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb836650-b812-420f-a10d-e0dd7a48563a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.543044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb836650-b812-420f-a10d-e0dd7a48563a None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.545546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2cab9-5268-4d52-b4b1-af6de14658db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.547297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2cab9-5268-4d52-b4b1-af6de14658db None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-bb836650-b812-420f-a10d-e0dd7a48563a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:11.561086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:11.562356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:11.567267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:11.567267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:11.567267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:11.567267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 298/597] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:11.567267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38326e0e-5a9a-4e92-a974-17efcd6bfdbd None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.567267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38326e0e-5a9a-4e92-a974-17efcd6bfdbd None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.567267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38326e0e-5a9a-4e92-a974-17efcd6bfdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-91d2cab9-5268-4d52-b4b1-af6de14658db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:11.568700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:11.569894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:11.570870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:11.570870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:11.570870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:11.570870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 300/598] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:11.573567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2cab9-5268-4d52-b4b1-af6de14658db None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.586411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-38326e0e-5a9a-4e92-a974-17efcd6bfdbd None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:11.587752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-38326e0e-5a9a-4e92-a974-17efcd6bfdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:11.662062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 299/599] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:11.665612 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38326e0e-5a9a-4e92-a974-17efcd6bfdbd None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.691251 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2cab9-5268-4d52-b4b1-af6de14658db None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.693633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:11.744852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384660d-0ca2-42fb-89a9-178360634384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.746597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384660d-0ca2-42fb-89a9-178360634384 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.746872 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384660d-0ca2-42fb-89a9-178360634384 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.747652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384660d-0ca2-42fb-89a9-178360634384 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.748719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384660d-0ca2-42fb-89a9-178360634384 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:11.749119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384660d-0ca2-42fb-89a9-178360634384 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.750920 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384660d-0ca2-42fb-89a9-178360634384 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.769667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 301/600] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:11.770257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384660d-0ca2-42fb-89a9-178360634384 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.805653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38326e0e-5a9a-4e92-a974-17efcd6bfdbd None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.835289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:11.856117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6593329-0fec-4ef2-a1a7-2b7bbee486b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.856963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6593329-0fec-4ef2-a1a7-2b7bbee486b6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.857332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6593329-0fec-4ef2-a1a7-2b7bbee486b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.857690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6593329-0fec-4ef2-a1a7-2b7bbee486b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.858370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6593329-0fec-4ef2-a1a7-2b7bbee486b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:11.858680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6593329-0fec-4ef2-a1a7-2b7bbee486b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.860069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6593329-0fec-4ef2-a1a7-2b7bbee486b6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.880759 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 300/601] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:11.880759 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6593329-0fec-4ef2-a1a7-2b7bbee486b6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.898279 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384660d-0ca2-42fb-89a9-178360634384 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.943398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80810535-6256-472f-a7ae-2b3c3ab353aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.944018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80810535-6256-472f-a7ae-2b3c3ab353aa None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.944289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80810535-6256-472f-a7ae-2b3c3ab353aa None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.944548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80810535-6256-472f-a7ae-2b3c3ab353aa None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.945220 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80810535-6256-472f-a7ae-2b3c3ab353aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:11.945547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80810535-6256-472f-a7ae-2b3c3ab353aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.947014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80810535-6256-472f-a7ae-2b3c3ab353aa None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.960544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 302/602] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:11.961435 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80810535-6256-472f-a7ae-2b3c3ab353aa None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.996237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:12.016855 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6593329-0fec-4ef2-a1a7-2b7bbee486b6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:12.062462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f365fb-3c0f-4d55-b6cb-3b7dc373e3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:12.063140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f365fb-3c0f-4d55-b6cb-3b7dc373e3a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:12.063418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f365fb-3c0f-4d55-b6cb-3b7dc373e3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:12.063696 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f365fb-3c0f-4d55-b6cb-3b7dc373e3a0 None admin] PATH_INFO: `/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/bc71e3a41ac644ff8a908b766495b5f0/roles/aa755d19c52f4e299b98898217cbc688` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:12.079548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f365fb-3c0f-4d55-b6cb-3b7dc373e3a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=983beac5fc784756b6bdf11b07e219ac, user_id=bc71e3a41ac644ff8a908b766495b5f0, role_id=aa755d19c52f4e299b98898217cbc688)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:12.081122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f365fb-3c0f-4d55-b6cb-3b7dc373e3a0 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:12.084023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80810535-6256-472f-a7ae-2b3c3ab353aa None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:12.095152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 301/603] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:57:11 2022] PUT /identity/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/bc71e3a41ac644ff8a908b766495b5f0/roles/aa755d19c52f4e299b98898217cbc688 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:12.096281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f365fb-3c0f-4d55-b6cb-3b7dc373e3a0 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:12.139826 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655af902-340d-4fee-b8c1-6855edec8412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:12.140781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655af902-340d-4fee-b8c1-6855edec8412 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:12.141057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655af902-340d-4fee-b8c1-6855edec8412 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:12.141324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655af902-340d-4fee-b8c1-6855edec8412 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:12.149857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655af902-340d-4fee-b8c1-6855edec8412 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:12.151316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655af902-340d-4fee-b8c1-6855edec8412 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:12.154238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-655af902-340d-4fee-b8c1-6855edec8412 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:12.165200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:12.166370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:12.167486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:12.167486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:12.167486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:12.167486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:12.167486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:12.167486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:12.167486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:12.167486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:12.172450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 303/604] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:12.173473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655af902-340d-4fee-b8c1-6855edec8412 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:12.270059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f365fb-3c0f-4d55-b6cb-3b7dc373e3a0 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:12.279945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:12.313561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655af902-340d-4fee-b8c1-6855edec8412 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:12.326246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd7ff4-60d6-4a55-bc89-78d63f41b242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:12.327385 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd7ff4-60d6-4a55-bc89-78d63f41b242 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:12.327690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd7ff4-60d6-4a55-bc89-78d63f41b242 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:12.327968 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd7ff4-60d6-4a55-bc89-78d63f41b242 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:12.344732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd7ff4-60d6-4a55-bc89-78d63f41b242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-2fcd7ff4-60d6-4a55-bc89-78d63f41b242 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:12.348608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:12.349825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:12.350692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 302/605] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:12.351557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd7ff4-60d6-4a55-bc89-78d63f41b242 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:12.366183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb2948-389f-45c9-8136-56b52c81533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:12.366925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb2948-389f-45c9-8136-56b52c81533f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:12.367300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb2948-389f-45c9-8136-56b52c81533f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:12.367700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb2948-389f-45c9-8136-56b52c81533f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:12.375811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb2948-389f-45c9-8136-56b52c81533f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:12.377455 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb2948-389f-45c9-8136-56b52c81533f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-6bcb2948-389f-45c9-8136-56b52c81533f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:12.390488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:12.391472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:12.392367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:12.392367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:12.392367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:12.392367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:12.392367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:12.392367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:12.392367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:12.392367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:12.392367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 304/606] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:12.392899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb2948-389f-45c9-8136-56b52c81533f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:12.476120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:12.492965 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd7ff4-60d6-4a55-bc89-78d63f41b242 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:12.539474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca94f90-3e0c-46cd-b268-d877e150369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:12.540181 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca94f90-3e0c-46cd-b268-d877e150369f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:12.540464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca94f90-3e0c-46cd-b268-d877e150369f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:12.540902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca94f90-3e0c-46cd-b268-d877e150369f None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:12.541738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca94f90-3e0c-46cd-b268-d877e150369f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:12.542119 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca94f90-3e0c-46cd-b268-d877e150369f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:12.543955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca94f90-3e0c-46cd-b268-d877e150369f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:12.557358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb2948-389f-45c9-8136-56b52c81533f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:12.558259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 303/607] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:12.559201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca94f90-3e0c-46cd-b268-d877e150369f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:12.609707 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff0f1f-19e3-4c16-918d-98dd9b63433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:12.610721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff0f1f-19e3-4c16-918d-98dd9b63433f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:12.611273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff0f1f-19e3-4c16-918d-98dd9b63433f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:12.612197 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff0f1f-19e3-4c16-918d-98dd9b63433f None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:12.613532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff0f1f-19e3-4c16-918d-98dd9b63433f None admin] RBAC: Adding query filter params (name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:12.614080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff0f1f-19e3-4c16-918d-98dd9b63433f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:12.616258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff0f1f-19e3-4c16-918d-98dd9b63433f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:12.630664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 305/608] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:12.633156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff0f1f-19e3-4c16-918d-98dd9b63433f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:12.639516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:12.693547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca94f90-3e0c-46cd-b268-d877e150369f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:12.744768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0add9-f7df-4af9-bed9-9d7544ef4e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:12.745839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0add9-f7df-4af9-bed9-9d7544ef4e41 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:12.746787 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0add9-f7df-4af9-bed9-9d7544ef4e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:12.747860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0add9-f7df-4af9-bed9-9d7544ef4e41 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:12.749018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0add9-f7df-4af9-bed9-9d7544ef4e41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:12.749480 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0add9-f7df-4af9-bed9-9d7544ef4e41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:12.751748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0add9-f7df-4af9-bed9-9d7544ef4e41 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:12.772248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff0f1f-19e3-4c16-918d-98dd9b63433f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:12.774799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 304/609] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:12.775880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0add9-f7df-4af9-bed9-9d7544ef4e41 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:12.789093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:12.826199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4defc-034d-463f-a801-9627109febe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:12.827150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4defc-034d-463f-a801-9627109febe0 None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:12.827845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4defc-034d-463f-a801-9627109febe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:12.828267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4defc-034d-463f-a801-9627109febe0 None admin] PATH_INFO: `/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/c901e018aa1c429da33b5809873d0aea/roles/aa755d19c52f4e299b98898217cbc688` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:12.851761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4defc-034d-463f-a801-9627109febe0 None admin] RBAC: Authorizing `identity:create_grant(project_id=983beac5fc784756b6bdf11b07e219ac, user_id=c901e018aa1c429da33b5809873d0aea, role_id=aa755d19c52f4e299b98898217cbc688)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:12.854097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4defc-034d-463f-a801-9627109febe0 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:12.885631 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 306/610] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:57:12 2022] PUT /identity/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/c901e018aa1c429da33b5809873d0aea/roles/aa755d19c52f4e299b98898217cbc688 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:12.886722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4defc-034d-463f-a801-9627109febe0 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:12.925781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0add9-f7df-4af9-bed9-9d7544ef4e41 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:13.020332 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:13.030511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0c689-8fae-45c7-9231-8666e8d2b7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:13.031291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0c689-8fae-45c7-9231-8666e8d2b7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:13.031691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0c689-8fae-45c7-9231-8666e8d2b7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:13.032701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0c689-8fae-45c7-9231-8666e8d2b7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:13.056971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0c689-8fae-45c7-9231-8666e8d2b7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:13.060358 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0c689-8fae-45c7-9231-8666e8d2b7d4 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-7cc0c689-8fae-45c7-9231-8666e8d2b7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:13.094414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:13.095404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:13.096387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:13.096387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:13.096387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:13.096387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 305/611] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:13.103703 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0c689-8fae-45c7-9231-8666e8d2b7d4 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:13.148356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4defc-034d-463f-a801-9627109febe0 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:13.225981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2474f8-3aec-4537-8c07-63b98720d72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:13.227129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2474f8-3aec-4537-8c07-63b98720d72e None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:13.227614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2474f8-3aec-4537-8c07-63b98720d72e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:13.228089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2474f8-3aec-4537-8c07-63b98720d72e None admin] PATH_INFO: `/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/e91f048f8885448383f4a361b07dac4f/roles/aa755d19c52f4e299b98898217cbc688` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:13.257181 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:13.265204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2474f8-3aec-4537-8c07-63b98720d72e None admin] RBAC: Authorizing `identity:create_grant(project_id=983beac5fc784756b6bdf11b07e219ac, user_id=e91f048f8885448383f4a361b07dac4f, role_id=aa755d19c52f4e299b98898217cbc688)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:13.267542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2474f8-3aec-4537-8c07-63b98720d72e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:13.296352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 307/612] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:57:12 2022] PUT /identity/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/e91f048f8885448383f4a361b07dac4f/roles/aa755d19c52f4e299b98898217cbc688 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:13.310619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0c689-8fae-45c7-9231-8666e8d2b7d4 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:13.378889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90da8a-2a3d-4830-98b7-2ce186038d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:13.380025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90da8a-2a3d-4830-98b7-2ce186038d6c None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:13.380518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90da8a-2a3d-4830-98b7-2ce186038d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:13.381040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90da8a-2a3d-4830-98b7-2ce186038d6c None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:13.382319 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90da8a-2a3d-4830-98b7-2ce186038d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:13.382928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90da8a-2a3d-4830-98b7-2ce186038d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:13.385442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90da8a-2a3d-4830-98b7-2ce186038d6c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:13.411185 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 306/613] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:13.420449 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2474f8-3aec-4537-8c07-63b98720d72e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:13.637185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2474f8-3aec-4537-8c07-63b98720d72e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:13.640340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:13.701495 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeccea-8cff-424e-bc94-0798666da0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:13.703021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeccea-8cff-424e-bc94-0798666da0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:13.703771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeccea-8cff-424e-bc94-0798666da0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:13.704283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeccea-8cff-424e-bc94-0798666da0b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:13.713085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eeccea-8cff-424e-bc94-0798666da0b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:13.714811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eeccea-8cff-424e-bc94-0798666da0b3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-79eeccea-8cff-424e-bc94-0798666da0b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:13.728200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:13.729224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:13.730309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:13.730309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:13.730309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:13.730309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:13.730309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:13.730309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:13.730309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:13.730309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:13.730309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:57:13.730309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:13.734652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 308/614] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:57:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:13.740508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90da8a-2a3d-4830-98b7-2ce186038d6c None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:13.902713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90da8a-2a3d-4830-98b7-2ce186038d6c None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:13.957792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:14.009445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfbd03-7b0d-435f-9b57-6bac25058faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:14.010699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfbd03-7b0d-435f-9b57-6bac25058faf None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:14.011190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfbd03-7b0d-435f-9b57-6bac25058faf None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:14.011692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfbd03-7b0d-435f-9b57-6bac25058faf None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:14.013323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfbd03-7b0d-435f-9b57-6bac25058faf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:14.024740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfbd03-7b0d-435f-9b57-6bac25058faf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:14.024740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfbd03-7b0d-435f-9b57-6bac25058faf None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:14.072740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 307/615] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Sep 7 15:57:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:14.081891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeccea-8cff-424e-bc94-0798666da0b3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:14.088519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6771af-a3b2-4f2f-9863-e0dc4ffd9227 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:14.089067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6771af-a3b2-4f2f-9863-e0dc4ffd9227 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:14.089560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6771af-a3b2-4f2f-9863-e0dc4ffd9227 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:14.099994 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 308/616] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:14.103518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4c59a-324e-4a30-8565-81ef14a503ce None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:14.103934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4c59a-324e-4a30-8565-81ef14a503ce None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:14.104331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4c59a-324e-4a30-8565-81ef14a503ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:14.170995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-a3f4c59a-324e-4a30-8565-81ef14a503ce None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:14.172252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-a3f4c59a-324e-4a30-8565-81ef14a503ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:14.233400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeccea-8cff-424e-bc94-0798666da0b3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:14.318899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e15d34-ea64-47f8-b366-29bab550ed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:14.319740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e15d34-ea64-47f8-b366-29bab550ed8d None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:14.320201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e15d34-ea64-47f8-b366-29bab550ed8d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:14.320863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e15d34-ea64-47f8-b366-29bab550ed8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:14.350055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e15d34-ea64-47f8-b366-29bab550ed8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:14.356202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e15d34-ea64-47f8-b366-29bab550ed8d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-07e15d34-ea64-47f8-b366-29bab550ed8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:14.413073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:14.414548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:14.416242 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:14.416242 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:14.416242 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:14.420657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 309/617] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:14.427445 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e15d34-ea64-47f8-b366-29bab550ed8d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:14.471889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 309/618] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:14.478015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:14.715202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e15d34-ea64-47f8-b366-29bab550ed8d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:14.791974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7104ea-ba7e-4323-a99d-0650c045019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:14.792823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7104ea-ba7e-4323-a99d-0650c045019f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:14.793341 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7104ea-ba7e-4323-a99d-0650c045019f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:14.793722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7104ea-ba7e-4323-a99d-0650c045019f None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:14.795618 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7104ea-ba7e-4323-a99d-0650c045019f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:14.800716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7104ea-ba7e-4323-a99d-0650c045019f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:14.800716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7104ea-ba7e-4323-a99d-0650c045019f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:14.835843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 310/619] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:14.842156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4c59a-324e-4a30-8565-81ef14a503ce None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:14.886563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7104ea-ba7e-4323-a99d-0650c045019f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:15.085650 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:15.087839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4c59a-324e-4a30-8565-81ef14a503ce None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:15.102750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:15.133318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7104ea-ba7e-4323-a99d-0650c045019f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:15.134469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776c62e-1d15-4ea5-b8a5-f2f7464dca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:15.135190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776c62e-1d15-4ea5-b8a5-f2f7464dca3e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:15.135527 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776c62e-1d15-4ea5-b8a5-f2f7464dca3e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:15.135883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776c62e-1d15-4ea5-b8a5-f2f7464dca3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:15.147910 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776c62e-1d15-4ea5-b8a5-f2f7464dca3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:15.150720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776c62e-1d15-4ea5-b8a5-f2f7464dca3e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-2776c62e-1d15-4ea5-b8a5-f2f7464dca3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:15.171497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:15.173003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:15.174454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:15.174454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:15.174454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:15.174454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:15.174454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:15.174454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:15.174454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:15.174454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:15.177811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 310/620] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:15.179753 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07310c-3439-44c6-bd55-003f22d7186b None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:15.180508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07310c-3439-44c6-bd55-003f22d7186b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:15.181256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07310c-3439-44c6-bd55-003f22d7186b None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:15.184343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 311/621] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:15.186315 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07310c-3439-44c6-bd55-003f22d7186b None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:15.198628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7bc1e-fc44-4519-aa83-a0f34532bda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:15.198628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7bc1e-fc44-4519-aa83-a0f34532bda3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:15.198628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7bc1e-fc44-4519-aa83-a0f34532bda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:15.198628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7bc1e-fc44-4519-aa83-a0f34532bda3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:15.210599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7bc1e-fc44-4519-aa83-a0f34532bda3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-d1a7bc1e-fc44-4519-aa83-a0f34532bda3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:15.216816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:15.218303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:15.219649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:15.219649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:15.219649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:15.219649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:15.219649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:15.219649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:15.219649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:15.219649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:15.219649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:15.219649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:15.219649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:15.219649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:15.222973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 311/622] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:15.224350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4253ad-03b6-4ad6-aac1-e92983ebc21e None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:15.225145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4253ad-03b6-4ad6-aac1-e92983ebc21e None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:15.225425 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4253ad-03b6-4ad6-aac1-e92983ebc21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:15.250113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-ce4253ad-03b6-4ad6-aac1-e92983ebc21e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:15.251609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ce4253ad-03b6-4ad6-aac1-e92983ebc21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:15.352759 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 312/623] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:15.354362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4253ad-03b6-4ad6-aac1-e92983ebc21e None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:15.366617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07310c-3439-44c6-bd55-003f22d7186b None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:15.420777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3608ae6-de74-4db9-b01e-2b7c302950a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:15.420777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3608ae6-de74-4db9-b01e-2b7c302950a2 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:15.420777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3608ae6-de74-4db9-b01e-2b7c302950a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:15.420777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3608ae6-de74-4db9-b01e-2b7c302950a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:15.421372 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3608ae6-de74-4db9-b01e-2b7c302950a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:15.421372 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3608ae6-de74-4db9-b01e-2b7c302950a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:15.421940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3608ae6-de74-4db9-b01e-2b7c302950a2 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:15.436737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 312/624] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:15.446193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3608ae6-de74-4db9-b01e-2b7c302950a2 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:15.473719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:15.525070 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4253ad-03b6-4ad6-aac1-e92983ebc21e None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:15.525847 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:15.589946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c882-2e4f-4bbc-be32-f2925ab7139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:15.591572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c882-2e4f-4bbc-be32-f2925ab7139b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:15.593079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c882-2e4f-4bbc-be32-f2925ab7139b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:15.593753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c882-2e4f-4bbc-be32-f2925ab7139b None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:15.595835 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c882-2e4f-4bbc-be32-f2925ab7139b None admin] RBAC: Adding query filter params (name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:15.596357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c882-2e4f-4bbc-be32-f2925ab7139b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:15.598176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c882-2e4f-4bbc-be32-f2925ab7139b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:15.624615 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 313/625] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:15.648704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c882-2e4f-4bbc-be32-f2925ab7139b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:15.703607 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3608ae6-de74-4db9-b01e-2b7c302950a2 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:15.754702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb279c26-7daa-4b06-a578-8bed454cf63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:15.756208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb279c26-7daa-4b06-a578-8bed454cf63e None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:15.757108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb279c26-7daa-4b06-a578-8bed454cf63e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:15.757817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb279c26-7daa-4b06-a578-8bed454cf63e None admin] PATH_INFO: `/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/d853bab10d9d4060809476bfc44d3822/roles/aa755d19c52f4e299b98898217cbc688` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:15.796003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb279c26-7daa-4b06-a578-8bed454cf63e None admin] RBAC: Authorizing `identity:create_grant(project_id=983beac5fc784756b6bdf11b07e219ac, user_id=d853bab10d9d4060809476bfc44d3822, role_id=aa755d19c52f4e299b98898217cbc688)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:15.798935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb279c26-7daa-4b06-a578-8bed454cf63e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:15.831144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 313/626] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:57:15 2022] PUT /identity/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/d853bab10d9d4060809476bfc44d3822/roles/aa755d19c52f4e299b98898217cbc688 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:15.832644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb279c26-7daa-4b06-a578-8bed454cf63e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:15.880721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c882-2e4f-4bbc-be32-f2925ab7139b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:15.933722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:15.944027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baf801-ee13-4ad9-b50d-cce953d69aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:15.944773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baf801-ee13-4ad9-b50d-cce953d69aad None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:15.945060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baf801-ee13-4ad9-b50d-cce953d69aad None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:15.945338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baf801-ee13-4ad9-b50d-cce953d69aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:15.958794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baf801-ee13-4ad9-b50d-cce953d69aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:15.960421 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baf801-ee13-4ad9-b50d-cce953d69aad None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-77baf801-ee13-4ad9-b50d-cce953d69aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:15.977851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:15.979202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:15.980096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:15.980096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:15.980096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:15.980766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 314/627] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:15.993930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:16.000638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baf801-ee13-4ad9-b50d-cce953d69aad None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:16.015214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb279c26-7daa-4b06-a578-8bed454cf63e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:16.068852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f65150-c6ea-4960-a188-94572ce9ac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:16.070123 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f65150-c6ea-4960-a188-94572ce9ac2a None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.070729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f65150-c6ea-4960-a188-94572ce9ac2a None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.071324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f65150-c6ea-4960-a188-94572ce9ac2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.106004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f65150-c6ea-4960-a188-94572ce9ac2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-24f65150-c6ea-4960-a188-94572ce9ac2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:16.127080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:16.128253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:16.129351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:16.129351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:16.129351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:16.129351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:16.129351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:16.129351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:16.129351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:16.129351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:16.129351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:16.129351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:16.129351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:16.129351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:16.137262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 314/628] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:16.145437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f65150-c6ea-4960-a188-94572ce9ac2a None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:16.205860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baf801-ee13-4ad9-b50d-cce953d69aad None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:16.260668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7a385-5a6a-4a77-96b0-4651697906ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:16.262037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7a385-5a6a-4a77-96b0-4651697906ec None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.262723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7a385-5a6a-4a77-96b0-4651697906ec None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.263424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7a385-5a6a-4a77-96b0-4651697906ec None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.264257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7a385-5a6a-4a77-96b0-4651697906ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:16.265913 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7a385-5a6a-4a77-96b0-4651697906ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:16.267804 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7a385-5a6a-4a77-96b0-4651697906ec None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:16.287813 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 315/629] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:16.293905 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f65150-c6ea-4960-a188-94572ce9ac2a None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:16.296454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7a385-5a6a-4a77-96b0-4651697906ec None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:16.368475 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:16.371157 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526082a2-d694-4b24-9c85-d3933022e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:16.371915 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526082a2-d694-4b24-9c85-d3933022e400 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.372792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526082a2-d694-4b24-9c85-d3933022e400 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.373261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526082a2-d694-4b24-9c85-d3933022e400 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.374061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526082a2-d694-4b24-9c85-d3933022e400 None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:16.374479 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526082a2-d694-4b24-9c85-d3933022e400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:16.380957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526082a2-d694-4b24-9c85-d3933022e400 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:16.407427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 315/630] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:16.409237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526082a2-d694-4b24-9c85-d3933022e400 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:16.415826 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:16.459932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7a385-5a6a-4a77-96b0-4651697906ec None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:16.526985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44842729-ee9c-41a8-be29-5b4ecc46d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:16.527944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44842729-ee9c-41a8-be29-5b4ecc46d08e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.529018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44842729-ee9c-41a8-be29-5b4ecc46d08e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.529449 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44842729-ee9c-41a8-be29-5b4ecc46d08e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.549067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44842729-ee9c-41a8-be29-5b4ecc46d08e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:16.553148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44842729-ee9c-41a8-be29-5b4ecc46d08e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-44842729-ee9c-41a8-be29-5b4ecc46d08e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:16.571901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:16.573038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:16.574474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:16.574474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:16.574474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:16.574474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:16.574474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:16.574474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:16.574474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:16.574474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:16.574474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:57:16.574474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:16.574474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 316/631] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Sep 7 15:57:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:16.575727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f3e3f-9f0d-4593-b81d-2192bd2c959c None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.575727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f3e3f-9f0d-4593-b81d-2192bd2c959c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.575855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f3e3f-9f0d-4593-b81d-2192bd2c959c None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.585021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 317/632] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:16.585021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977df1e6-2e1e-441a-a093-726de825f594 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.585021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977df1e6-2e1e-441a-a093-726de825f594 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.585021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977df1e6-2e1e-441a-a093-726de825f594 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.586585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 318/633] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:16.587351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977df1e6-2e1e-441a-a093-726de825f594 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:16.637536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526082a2-d694-4b24-9c85-d3933022e400 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:16.689778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d69ed-0337-4429-9dc9-fdd41e2bc1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:16.690835 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d69ed-0337-4429-9dc9-fdd41e2bc1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.691309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d69ed-0337-4429-9dc9-fdd41e2bc1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.691777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d69ed-0337-4429-9dc9-fdd41e2bc1d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.712513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d69ed-0337-4429-9dc9-fdd41e2bc1d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:16.715293 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d69ed-0337-4429-9dc9-fdd41e2bc1d2 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:16.721808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:16.728197 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977df1e6-2e1e-441a-a093-726de825f594 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-b83d69ed-0337-4429-9dc9-fdd41e2bc1d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:16.743609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:16.745285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:16.754598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:16.754598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:16.754598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:16.754598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 316/634] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:16.754598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaa848-ec78-4661-95dd-116e6aa4f0e3 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.754598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaa848-ec78-4661-95dd-116e6aa4f0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.754598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaa848-ec78-4661-95dd-116e6aa4f0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.784570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-0aeaa848-ec78-4661-95dd-116e6aa4f0e3 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:16.786736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0aeaa848-ec78-4661-95dd-116e6aa4f0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:16.787764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4be6e-3508-46db-bbd3-1c37979547c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:16.788387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4be6e-3508-46db-bbd3-1c37979547c1 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.788662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4be6e-3508-46db-bbd3-1c37979547c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.789036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4be6e-3508-46db-bbd3-1c37979547c1 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.789855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4be6e-3508-46db-bbd3-1c37979547c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:16.790160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4be6e-3508-46db-bbd3-1c37979547c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:16.792448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4be6e-3508-46db-bbd3-1c37979547c1 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:16.821646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 319/635] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Sep 7 15:57:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:16.821646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990914c-651a-433f-ac36-cb8706d7b5f3 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.821646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990914c-651a-433f-ac36-cb8706d7b5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.821646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990914c-651a-433f-ac36-cb8706d7b5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.846018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-9990914c-651a-433f-ac36-cb8706d7b5f3 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:16.848602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9990914c-651a-433f-ac36-cb8706d7b5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:16.865369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:16.895951 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 317/636] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:16.896861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaa848-ec78-4661-95dd-116e6aa4f0e3 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:16.981233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 320/637] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:16.982711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990914c-651a-433f-ac36-cb8706d7b5f3 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:17.042079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaa848-ec78-4661-95dd-116e6aa4f0e3 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:17.085136 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b695b-72dc-41e1-9cce-cd2bdcaf1a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:17.086146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b695b-72dc-41e1-9cce-cd2bdcaf1a1e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:17.086433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b695b-72dc-41e1-9cce-cd2bdcaf1a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:17.086709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b695b-72dc-41e1-9cce-cd2bdcaf1a1e None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:17.087369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b695b-72dc-41e1-9cce-cd2bdcaf1a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:17.087929 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b695b-72dc-41e1-9cce-cd2bdcaf1a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:17.089424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b695b-72dc-41e1-9cce-cd2bdcaf1a1e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:17.109240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 318/638] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:17.111265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b695b-72dc-41e1-9cce-cd2bdcaf1a1e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:17.172779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:17.245264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:17.260355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b695b-72dc-41e1-9cce-cd2bdcaf1a1e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:17.277244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990914c-651a-433f-ac36-cb8706d7b5f3 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:17.302020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103091cf-c5fc-4b8e-af06-df8be714effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:17.302674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103091cf-c5fc-4b8e-af06-df8be714effa None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:17.302956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103091cf-c5fc-4b8e-af06-df8be714effa None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:17.303241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103091cf-c5fc-4b8e-af06-df8be714effa None admin] PATH_INFO: `/v3/users/glance` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:17.312412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103091cf-c5fc-4b8e-af06-df8be714effa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:17.313958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103091cf-c5fc-4b8e-af06-df8be714effa None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-103091cf-c5fc-4b8e-af06-df8be714effa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:17.326292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:17.327531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:17.328606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:17.328606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:17.328606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:17.328606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:17.328606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:17.328606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:17.328606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:17.328606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:17.328606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 15:57:17.328606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:17.332147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 319/639] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:57:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:17.333149 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103091cf-c5fc-4b8e-af06-df8be714effa None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:17.333895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16765e2-d4d8-4078-a494-0533e6775edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:17.335242 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16765e2-d4d8-4078-a494-0533e6775edc None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:17.335866 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16765e2-d4d8-4078-a494-0533e6775edc None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:17.336497 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16765e2-d4d8-4078-a494-0533e6775edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:17.442296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16765e2-d4d8-4078-a494-0533e6775edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:17.444162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16765e2-d4d8-4078-a494-0533e6775edc None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:17.465881 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103091cf-c5fc-4b8e-af06-df8be714effa None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:17.469648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:17.526128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8782af3-1a6b-4a2b-8b2d-d1834df7f885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:17.527034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8782af3-1a6b-4a2b-8b2d-d1834df7f885 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:17.527441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8782af3-1a6b-4a2b-8b2d-d1834df7f885 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:17.527851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8782af3-1a6b-4a2b-8b2d-d1834df7f885 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:17.541636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8782af3-1a6b-4a2b-8b2d-d1834df7f885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-d8782af3-1a6b-4a2b-8b2d-d1834df7f885 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:17.548115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:17.549886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 320/640] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:17.551054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8782af3-1a6b-4a2b-8b2d-d1834df7f885 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:17.578510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:17.602000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 321/641] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:17.602966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16765e2-d4d8-4078-a494-0533e6775edc None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:17.726530 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8782af3-1a6b-4a2b-8b2d-d1834df7f885 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:17.772103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16765e2-d4d8-4078-a494-0533e6775edc None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:17.783604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f4a9f-2c77-40b1-b8f1-cd0affaebf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:17.784131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f4a9f-2c77-40b1-b8f1-cd0affaebf58 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:17.784417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f4a9f-2c77-40b1-b8f1-cd0affaebf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:17.784711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f4a9f-2c77-40b1-b8f1-cd0affaebf58 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:17.785491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f4a9f-2c77-40b1-b8f1-cd0affaebf58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:17.785777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f4a9f-2c77-40b1-b8f1-cd0affaebf58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:17.787274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f4a9f-2c77-40b1-b8f1-cd0affaebf58 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:17.813467 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 321/642] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Sep 7 15:57:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:17.814289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f4a9f-2c77-40b1-b8f1-cd0affaebf58 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:17.833107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3444d-b726-4f12-8c1f-994dc256c4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:17.833970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3444d-b726-4f12-8c1f-994dc256c4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:17.834243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3444d-b726-4f12-8c1f-994dc256c4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:17.834513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3444d-b726-4f12-8c1f-994dc256c4f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:17.849736 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3444d-b726-4f12-8c1f-994dc256c4f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:17.850979 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-6ad3444d-b726-4f12-8c1f-994dc256c4f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:17.856192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:17.860969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 322/643] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:17.861879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3444d-b726-4f12-8c1f-994dc256c4f6 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:17.928356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:17.963937 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f4a9f-2c77-40b1-b8f1-cd0affaebf58 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:18.005735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3444d-b726-4f12-8c1f-994dc256c4f6 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:18.011380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a882fc-57ed-4192-a543-758d822689a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:18.013485 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a882fc-57ed-4192-a543-758d822689a3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.013485 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a882fc-57ed-4192-a543-758d822689a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.013485 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a882fc-57ed-4192-a543-758d822689a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.013856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a882fc-57ed-4192-a543-758d822689a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:18.014060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a882fc-57ed-4192-a543-758d822689a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:18.016114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a882fc-57ed-4192-a543-758d822689a3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:18.029705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 322/644] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:18.030681 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a882fc-57ed-4192-a543-758d822689a3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:18.048905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6e5e6-c16e-4aea-92f4-8251cfe4cfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:18.049634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6e5e6-c16e-4aea-92f4-8251cfe4cfcd None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.050246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6e5e6-c16e-4aea-92f4-8251cfe4cfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.050515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6e5e6-c16e-4aea-92f4-8251cfe4cfcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.062023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6e5e6-c16e-4aea-92f4-8251cfe4cfcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:18.063480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6e5e6-c16e-4aea-92f4-8251cfe4cfcd None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-1cd6e5e6-c16e-4aea-92f4-8251cfe4cfcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:18.081792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:18.083629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:18.086003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:18.086003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:18.086003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:18.086003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 323/645] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:18.086003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6e5e6-c16e-4aea-92f4-8251cfe4cfcd None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:18.153950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:18.176202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a882fc-57ed-4192-a543-758d822689a3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:18.206883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:18.211913 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6e5e6-c16e-4aea-92f4-8251cfe4cfcd None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:18.224920 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c998d-eba0-41e2-b95f-398ad74a217e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:18.225549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c998d-eba0-41e2-b95f-398ad74a217e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.225827 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c998d-eba0-41e2-b95f-398ad74a217e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.226104 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c998d-eba0-41e2-b95f-398ad74a217e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.260279 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff443a3-e587-4691-9c3d-33a8176317c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:18.260845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff443a3-e587-4691-9c3d-33a8176317c3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.261102 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff443a3-e587-4691-9c3d-33a8176317c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.261381 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff443a3-e587-4691-9c3d-33a8176317c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.262084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff443a3-e587-4691-9c3d-33a8176317c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:18.262585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff443a3-e587-4691-9c3d-33a8176317c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:18.264375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff443a3-e587-4691-9c3d-33a8176317c3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:18.280480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 324/646] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:18.280480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff443a3-e587-4691-9c3d-33a8176317c3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:18.336119 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c998d-eba0-41e2-b95f-398ad74a217e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:18.338804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c998d-eba0-41e2-b95f-398ad74a217e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:18.400749 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff443a3-e587-4691-9c3d-33a8176317c3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:18.456982 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df0caf-1285-4db0-a9f2-4bb67f8f4037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:18.457956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0caf-1285-4db0-a9f2-4bb67f8f4037 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.458419 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0caf-1285-4db0-a9f2-4bb67f8f4037 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.458861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0caf-1285-4db0-a9f2-4bb67f8f4037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.473288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df0caf-1285-4db0-a9f2-4bb67f8f4037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:18.473911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:18.475432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df0caf-1285-4db0-a9f2-4bb67f8f4037 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-90df0caf-1285-4db0-a9f2-4bb67f8f4037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:18.496722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:18.499693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:18.501173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:18.501173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:18.501173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:18.501173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 325/647] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:18.501173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df0caf-1285-4db0-a9f2-4bb67f8f4037 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:18.513092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 323/648] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:18.514913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c998d-eba0-41e2-b95f-398ad74a217e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:18.528014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:18.633916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df0caf-1285-4db0-a9f2-4bb67f8f4037 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:18.661359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c998d-eba0-41e2-b95f-398ad74a217e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:18.677153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3473239-d513-44c1-a2ef-a56b01bcfce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:18.677799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3473239-d513-44c1-a2ef-a56b01bcfce6 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.678082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3473239-d513-44c1-a2ef-a56b01bcfce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.678358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3473239-d513-44c1-a2ef-a56b01bcfce6 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.679160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3473239-d513-44c1-a2ef-a56b01bcfce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:18.679493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3473239-d513-44c1-a2ef-a56b01bcfce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:18.681057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3473239-d513-44c1-a2ef-a56b01bcfce6 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:18.695753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 326/649] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:18.696623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3473239-d513-44c1-a2ef-a56b01bcfce6 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:18.713353 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18ca00-644f-4d65-b4ec-6d108d752356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:18.714115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18ca00-644f-4d65-b4ec-6d108d752356 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.714395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18ca00-644f-4d65-b4ec-6d108d752356 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.714664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18ca00-644f-4d65-b4ec-6d108d752356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.725943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18ca00-644f-4d65-b4ec-6d108d752356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:18.727412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18ca00-644f-4d65-b4ec-6d108d752356 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-8b18ca00-644f-4d65-b4ec-6d108d752356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:18.743668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:18.753545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:18.755667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:18.755667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:18.755667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:18.755667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 324/650] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:18.755667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18ca00-644f-4d65-b4ec-6d108d752356 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:18.806883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:18.812127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:18.852848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3473239-d513-44c1-a2ef-a56b01bcfce6 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:18.886995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18ca00-644f-4d65-b4ec-6d108d752356 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:18.894413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79219344-aa8b-4972-8b98-b6210d252181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:18.895023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79219344-aa8b-4972-8b98-b6210d252181 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.895304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79219344-aa8b-4972-8b98-b6210d252181 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.895578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79219344-aa8b-4972-8b98-b6210d252181 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.896225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79219344-aa8b-4972-8b98-b6210d252181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:18.896529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79219344-aa8b-4972-8b98-b6210d252181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:18.897946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79219344-aa8b-4972-8b98-b6210d252181 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:18.915127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 327/651] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:18.915906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79219344-aa8b-4972-8b98-b6210d252181 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:18.927576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182036d-f5da-4fef-b643-e4e7575adc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:18.928301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182036d-f5da-4fef-b643-e4e7575adc5d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.928630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182036d-f5da-4fef-b643-e4e7575adc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.928944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182036d-f5da-4fef-b643-e4e7575adc5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.941811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182036d-f5da-4fef-b643-e4e7575adc5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:18.943279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182036d-f5da-4fef-b643-e4e7575adc5d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-6182036d-f5da-4fef-b643-e4e7575adc5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:18.960941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:18.962595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:18.964344 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:18.964344 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:18.964344 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:18.964344 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 325/652] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:18.964344 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182036d-f5da-4fef-b643-e4e7575adc5d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.047105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79219344-aa8b-4972-8b98-b6210d252181 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.069629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:19.083753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f38b6-2cc1-469b-9366-7b0d65bdf1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.084048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182036d-f5da-4fef-b643-e4e7575adc5d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.084380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f38b6-2cc1-469b-9366-7b0d65bdf1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.084660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f38b6-2cc1-469b-9366-7b0d65bdf1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.084957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f38b6-2cc1-469b-9366-7b0d65bdf1c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.086996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:19.093460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f38b6-2cc1-469b-9366-7b0d65bdf1c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.094930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f38b6-2cc1-469b-9366-7b0d65bdf1c7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-5f3f38b6-2cc1-469b-9366-7b0d65bdf1c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:19.108918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:19.110065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:19.111205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:19.111205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:19.111205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:19.111205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:19.111205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:19.111205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:19.111205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:19.111205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:19.111205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 328/653] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:19.111805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e14dbe-adf1-4518-a4f9-bd5358d3e117 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.111805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e14dbe-adf1-4518-a4f9-bd5358d3e117 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.111805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e14dbe-adf1-4518-a4f9-bd5358d3e117 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.113007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 329/654] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:19.113842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e14dbe-adf1-4518-a4f9-bd5358d3e117 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.130013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e207c-1596-4823-92a6-1b31da021daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.130882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e207c-1596-4823-92a6-1b31da021daa None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.131263 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e207c-1596-4823-92a6-1b31da021daa None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.131644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e207c-1596-4823-92a6-1b31da021daa None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.132366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e207c-1596-4823-92a6-1b31da021daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:19.132674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e207c-1596-4823-92a6-1b31da021daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.134089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e207c-1596-4823-92a6-1b31da021daa None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.148092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 326/655] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:19.149000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e207c-1596-4823-92a6-1b31da021daa None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.253243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e14dbe-adf1-4518-a4f9-bd5358d3e117 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.271026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e207c-1596-4823-92a6-1b31da021daa None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.297296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d95a8-36cd-4d70-9331-0944f817b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.298128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d95a8-36cd-4d70-9331-0944f817b506 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.298594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d95a8-36cd-4d70-9331-0944f817b506 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.299046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d95a8-36cd-4d70-9331-0944f817b506 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.308749 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d95a8-36cd-4d70-9331-0944f817b506 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.309779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70f066-100a-4068-bd06-f3fb8c642932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.310221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70f066-100a-4068-bd06-f3fb8c642932 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.310587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70f066-100a-4068-bd06-f3fb8c642932 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.310771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d95a8-36cd-4d70-9331-0944f817b506 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.310866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70f066-100a-4068-bd06-f3fb8c642932 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.311484 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70f066-100a-4068-bd06-f3fb8c642932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:19.311793 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70f066-100a-4068-bd06-f3fb8c642932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.313210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70f066-100a-4068-bd06-f3fb8c642932 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-715d95a8-36cd-4d70-9331-0944f817b506 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:19.323172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:19.324373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:19.325485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:19.325485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:19.325485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:19.325485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:19.325485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:19.325485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:19.325485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:19.325485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:19.325485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:57:19.325485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:19.325485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 330/656] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:57:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:19.325485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d95a8-36cd-4d70-9331-0944f817b506 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.326151 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 327/657] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:19.327093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e014d20-f850-40e6-b981-9aca9e499266 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.327440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e014d20-f850-40e6-b981-9aca9e499266 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.327729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e014d20-f850-40e6-b981-9aca9e499266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.351868 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-3e014d20-f850-40e6-b981-9aca9e499266 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:19.353661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3e014d20-f850-40e6-b981-9aca9e499266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:19.358336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:19.412271 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:19.452960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 328/658] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:19.454238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e014d20-f850-40e6-b981-9aca9e499266 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.479178 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d95a8-36cd-4d70-9331-0944f817b506 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.537635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0079dc9-40b2-41ca-8fc3-b2acc6cca6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.538562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0079dc9-40b2-41ca-8fc3-b2acc6cca6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.538842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0079dc9-40b2-41ca-8fc3-b2acc6cca6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.539248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0079dc9-40b2-41ca-8fc3-b2acc6cca6f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.539941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0079dc9-40b2-41ca-8fc3-b2acc6cca6f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:19.540248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0079dc9-40b2-41ca-8fc3-b2acc6cca6f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.542472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0079dc9-40b2-41ca-8fc3-b2acc6cca6f5 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.568730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 331/659] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:19.568730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0079dc9-40b2-41ca-8fc3-b2acc6cca6f5 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.630220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e014d20-f850-40e6-b981-9aca9e499266 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.682230 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aea409-6e13-4887-9f6a-da33d968385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.683303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aea409-6e13-4887-9f6a-da33d968385f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.683944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aea409-6e13-4887-9f6a-da33d968385f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.684425 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aea409-6e13-4887-9f6a-da33d968385f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.693597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aea409-6e13-4887-9f6a-da33d968385f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.695608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aea409-6e13-4887-9f6a-da33d968385f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.699469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:19.706637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0079dc9-40b2-41ca-8fc3-b2acc6cca6f5 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-c9aea409-6e13-4887-9f6a-da33d968385f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:19.719032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:19.720834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:19.722544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:19.722544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:19.722544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:19.722544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:19.722544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:19.722544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:19.722544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:19.722544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:19.722544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 15:57:19.722544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:19.722544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 329/660] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:19.722544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aea409-6e13-4887-9f6a-da33d968385f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.728540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:19.760795 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9f65-4c47-4e51-a3c0-61d54e5362f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.761653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9f65-4c47-4e51-a3c0-61d54e5362f6 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.762057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9f65-4c47-4e51-a3c0-61d54e5362f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.762509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9f65-4c47-4e51-a3c0-61d54e5362f6 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.763913 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9f65-4c47-4e51-a3c0-61d54e5362f6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:19.764221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9f65-4c47-4e51-a3c0-61d54e5362f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.765971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9f65-4c47-4e51-a3c0-61d54e5362f6 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.787239 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 332/661] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Sep 7 15:57:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:19.788234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9f65-4c47-4e51-a3c0-61d54e5362f6 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.860254 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aea409-6e13-4887-9f6a-da33d968385f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.904400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a4c6-ea5e-4225-8f46-25cd4a4a716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.905072 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a4c6-ea5e-4225-8f46-25cd4a4a716b None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.905354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a4c6-ea5e-4225-8f46-25cd4a4a716b None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.905625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a4c6-ea5e-4225-8f46-25cd4a4a716b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.912843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a4c6-ea5e-4225-8f46-25cd4a4a716b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.914429 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a4c6-ea5e-4225-8f46-25cd4a4a716b None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.922829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9f65-4c47-4e51-a3c0-61d54e5362f6 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-3568a4c6-ea5e-4225-8f46-25cd4a4a716b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:19.927034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:19.928624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:19.929715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:19.929715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:19.929715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:19.929715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:19.929715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:19.929715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:19.929715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:19.929715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:19.929715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 330/662] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:19.929715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a4c6-ea5e-4225-8f46-25cd4a4a716b None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.977518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa5b10-2cc4-4901-a6f8-50d19ba4ef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.978492 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa5b10-2cc4-4901-a6f8-50d19ba4ef9a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.978977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa5b10-2cc4-4901-a6f8-50d19ba4ef9a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.979464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa5b10-2cc4-4901-a6f8-50d19ba4ef9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.980829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa5b10-2cc4-4901-a6f8-50d19ba4ef9a None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=9d71c0688ea84c05af925f3fb08f35ad) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:19.981374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa5b10-2cc4-4901-a6f8-50d19ba4ef9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.984133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa5b10-2cc4-4901-a6f8-50d19ba4ef9a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:20.000097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 333/663] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:19 2022] GET /identity/v3/role_assignments?user.id=9d71c0688ea84c05af925f3fb08f35ad&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:20.001873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa5b10-2cc4-4901-a6f8-50d19ba4ef9a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:20.031895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:20.065837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:20.094629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a4c6-ea5e-4225-8f46-25cd4a4a716b None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:20.160096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28bf24-3f9c-4f6b-915b-6a9aab1da30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:20.160805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28bf24-3f9c-4f6b-915b-6a9aab1da30e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:20.161926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28bf24-3f9c-4f6b-915b-6a9aab1da30e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:20.162231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28bf24-3f9c-4f6b-915b-6a9aab1da30e None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:20.163023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28bf24-3f9c-4f6b-915b-6a9aab1da30e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:20.163330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28bf24-3f9c-4f6b-915b-6a9aab1da30e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:20.164846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28bf24-3f9c-4f6b-915b-6a9aab1da30e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:20.175643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa5b10-2cc4-4901-a6f8-50d19ba4ef9a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:20.188846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 331/664] 10.222.0.43 () {56 vars in 1139 bytes} [Wed Sep 7 15:57:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:20.188846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28bf24-3f9c-4f6b-915b-6a9aab1da30e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:20.240585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6353b0-0df8-4ff5-ab73-2b87f5e7b457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:20.242538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6353b0-0df8-4ff5-ab73-2b87f5e7b457 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:20.242538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6353b0-0df8-4ff5-ab73-2b87f5e7b457 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:20.242538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6353b0-0df8-4ff5-ab73-2b87f5e7b457 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:20.265725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6353b0-0df8-4ff5-ab73-2b87f5e7b457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-9d6353b0-0df8-4ff5-ab73-2b87f5e7b457 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:20.272014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:20.273940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 334/665] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:20.274986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6353b0-0df8-4ff5-ab73-2b87f5e7b457 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:20.335009 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28bf24-3f9c-4f6b-915b-6a9aab1da30e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:20.360365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:20.383074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d76c28-5226-451f-ad1b-bc63cb110c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:20.383688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d76c28-5226-451f-ad1b-bc63cb110c77 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:20.383967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d76c28-5226-451f-ad1b-bc63cb110c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:20.384237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d76c28-5226-451f-ad1b-bc63cb110c77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:20.444370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:20.454092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6353b0-0df8-4ff5-ab73-2b87f5e7b457 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:20.498287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d76c28-5226-451f-ad1b-bc63cb110c77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:20.498533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd15045-f1de-477b-b81d-4c0034603ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:20.499343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd15045-f1de-477b-b81d-4c0034603ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:20.499685 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d76c28-5226-451f-ad1b-bc63cb110c77 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:20.499979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd15045-f1de-477b-b81d-4c0034603ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:20.500443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd15045-f1de-477b-b81d-4c0034603ec2 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:20.502192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd15045-f1de-477b-b81d-4c0034603ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:20.507207 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd15045-f1de-477b-b81d-4c0034603ec2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:20.510030 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd15045-f1de-477b-b81d-4c0034603ec2 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:20.537682 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 335/666] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:20.537682 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd15045-f1de-477b-b81d-4c0034603ec2 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:20.676940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 332/667] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:20.678335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d76c28-5226-451f-ad1b-bc63cb110c77 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:20.704553 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd15045-f1de-477b-b81d-4c0034603ec2 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:20.712735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:20.751726 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df1935-e917-4cfe-baca-ffa42edf9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:20.752582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df1935-e917-4cfe-baca-ffa42edf9cac None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:20.753069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df1935-e917-4cfe-baca-ffa42edf9cac None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:20.753481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df1935-e917-4cfe-baca-ffa42edf9cac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:20.789741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:20.836712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d76c28-5226-451f-ad1b-bc63cb110c77 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:20.850357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df1935-e917-4cfe-baca-ffa42edf9cac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:20.852075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df1935-e917-4cfe-baca-ffa42edf9cac None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:20.882750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c50d9b-a39b-4236-bfd8-98a3739c0d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:20.883688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c50d9b-a39b-4236-bfd8-98a3739c0d68 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:20.884121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c50d9b-a39b-4236-bfd8-98a3739c0d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:20.884555 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c50d9b-a39b-4236-bfd8-98a3739c0d68 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:20.885638 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c50d9b-a39b-4236-bfd8-98a3739c0d68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:20.886112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c50d9b-a39b-4236-bfd8-98a3739c0d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:20.888983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c50d9b-a39b-4236-bfd8-98a3739c0d68 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:20.899584 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 333/668] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:20.900230 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c50d9b-a39b-4236-bfd8-98a3739c0d68 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.034627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 336/669] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:21.035689 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df1935-e917-4cfe-baca-ffa42edf9cac None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.045993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:21.086908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c50d9b-a39b-4236-bfd8-98a3739c0d68 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.128122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:21.145035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e496c-c765-4a20-9ec9-0bf2b7f705cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.146015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e496c-c765-4a20-9ec9-0bf2b7f705cb None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.146480 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e496c-c765-4a20-9ec9-0bf2b7f705cb None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.146940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e496c-c765-4a20-9ec9-0bf2b7f705cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.148190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e496c-c765-4a20-9ec9-0bf2b7f705cb None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=bc71e3a41ac644ff8a908b766495b5f0) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:21.149355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e496c-c765-4a20-9ec9-0bf2b7f705cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.150963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e496c-c765-4a20-9ec9-0bf2b7f705cb None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:21.172715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 334/670] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:20 2022] GET /identity/v3/role_assignments?user.id=bc71e3a41ac644ff8a908b766495b5f0&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:21.172715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e496c-c765-4a20-9ec9-0bf2b7f705cb None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.223783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df1935-e917-4cfe-baca-ffa42edf9cac None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.269805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eeae9-b7b8-4ff7-9037-a95909f7daab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.271322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eeae9-b7b8-4ff7-9037-a95909f7daab None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.271675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eeae9-b7b8-4ff7-9037-a95909f7daab None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.272020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eeae9-b7b8-4ff7-9037-a95909f7daab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.288321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427eeae9-b7b8-4ff7-9037-a95909f7daab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.290649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427eeae9-b7b8-4ff7-9037-a95909f7daab None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-427eeae9-b7b8-4ff7-9037-a95909f7daab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:21.322047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:21.323441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:21.324656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:21.324656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:21.324656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:21.333208 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 337/671] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:21.334288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eeae9-b7b8-4ff7-9037-a95909f7daab None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.335990 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e496c-c765-4a20-9ec9-0bf2b7f705cb None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.378927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3b1b-abd2-41bd-9f79-fe2b0dcb82d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.379915 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3b1b-abd2-41bd-9f79-fe2b0dcb82d9 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.380382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3b1b-abd2-41bd-9f79-fe2b0dcb82d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.380932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3b1b-abd2-41bd-9f79-fe2b0dcb82d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.394504 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3b1b-abd2-41bd-9f79-fe2b0dcb82d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.396225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3b1b-abd2-41bd-9f79-fe2b0dcb82d9 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:21.398848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-607b3b1b-abd2-41bd-9f79-fe2b0dcb82d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:21.417048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:21.418240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:21.419381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:21.419381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:21.419381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:21.419381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 335/672] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:21.419381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3b1b-abd2-41bd-9f79-fe2b0dcb82d9 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.505311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eeae9-b7b8-4ff7-9037-a95909f7daab None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.520048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:21.564074 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5516e1b-f537-49b3-8ed2-0f93fb56755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.565360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5516e1b-f537-49b3-8ed2-0f93fb56755f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.565798 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5516e1b-f537-49b3-8ed2-0f93fb56755f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.566693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5516e1b-f537-49b3-8ed2-0f93fb56755f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.582216 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5516e1b-f537-49b3-8ed2-0f93fb56755f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.584563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5516e1b-f537-49b3-8ed2-0f93fb56755f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:21.595457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3b1b-abd2-41bd-9f79-fe2b0dcb82d9 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-c5516e1b-f537-49b3-8ed2-0f93fb56755f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:21.602202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:21.603382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:21.604468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:21.604468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:21.604468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:21.606434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 338/673] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:21.607677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5516e1b-f537-49b3-8ed2-0f93fb56755f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.641407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d53e38-2e7a-4a79-bab8-9000fbdb0605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.642036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53e38-2e7a-4a79-bab8-9000fbdb0605 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.642375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53e38-2e7a-4a79-bab8-9000fbdb0605 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.642651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53e38-2e7a-4a79-bab8-9000fbdb0605 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.643487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d53e38-2e7a-4a79-bab8-9000fbdb0605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:21.644057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d53e38-2e7a-4a79-bab8-9000fbdb0605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.645615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d53e38-2e7a-4a79-bab8-9000fbdb0605 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:21.665215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 336/674] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:21.665215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d53e38-2e7a-4a79-bab8-9000fbdb0605 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.752510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:21.764577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5516e1b-f537-49b3-8ed2-0f93fb56755f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.827651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe947f-4959-47d3-b9af-9386eee7026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.828323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe947f-4959-47d3-b9af-9386eee7026e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.828669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe947f-4959-47d3-b9af-9386eee7026e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.829035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe947f-4959-47d3-b9af-9386eee7026e None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.829757 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe947f-4959-47d3-b9af-9386eee7026e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:21.830135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe947f-4959-47d3-b9af-9386eee7026e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.835951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe947f-4959-47d3-b9af-9386eee7026e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:21.846482 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 339/675] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:21.848809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe947f-4959-47d3-b9af-9386eee7026e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.866388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d53e38-2e7a-4a79-bab8-9000fbdb0605 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.885944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:21.939264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb9ef7-68ed-4406-9389-f5804ba6a1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.940503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb9ef7-68ed-4406-9389-f5804ba6a1ca None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.941091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb9ef7-68ed-4406-9389-f5804ba6a1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.941666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb9ef7-68ed-4406-9389-f5804ba6a1ca None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.942912 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb9ef7-68ed-4406-9389-f5804ba6a1ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:21.943656 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb9ef7-68ed-4406-9389-f5804ba6a1ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.946666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb9ef7-68ed-4406-9389-f5804ba6a1ca None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:21.970311 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 337/676] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:21.971991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb9ef7-68ed-4406-9389-f5804ba6a1ca None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:22.021404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe947f-4959-47d3-b9af-9386eee7026e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.065522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c8d44-a498-4c6a-b2e9-17cd48ebdbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.066454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c8d44-a498-4c6a-b2e9-17cd48ebdbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.066885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c8d44-a498-4c6a-b2e9-17cd48ebdbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.067411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c8d44-a498-4c6a-b2e9-17cd48ebdbd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.075975 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c8d44-a498-4c6a-b2e9-17cd48ebdbd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.077879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c8d44-a498-4c6a-b2e9-17cd48ebdbd6 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-4b6c8d44-a498-4c6a-b2e9-17cd48ebdbd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:22.091263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:22.092209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:22.093155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:22.093155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:22.093155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:22.093155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:22.093155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:22.093155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:22.093155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:22.093155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:22.100186 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 340/677] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:22.101669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c8d44-a498-4c6a-b2e9-17cd48ebdbd6 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:22.158266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb9ef7-68ed-4406-9389-f5804ba6a1ca None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.193649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:22.198715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:22.229954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c8d44-a498-4c6a-b2e9-17cd48ebdbd6 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.237192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c66c4-0a70-4c28-bb34-2bfe30ad90bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.238387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c66c4-0a70-4c28-bb34-2bfe30ad90bc None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.239222 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c66c4-0a70-4c28-bb34-2bfe30ad90bc None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.239797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c66c4-0a70-4c28-bb34-2bfe30ad90bc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.255596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c66c4-0a70-4c28-bb34-2bfe30ad90bc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.258832 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c66c4-0a70-4c28-bb34-2bfe30ad90bc None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-958c66c4-0a70-4c28-bb34-2bfe30ad90bc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:22.288208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:22.289926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:22.291619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:22.291619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:22.291619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:22.291619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:22.291619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:22.291619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:22.291619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:22.291619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:22.291619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:57:22.291619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:22.293892 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 338/678] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:57:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:22.296152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c66c4-0a70-4c28-bb34-2bfe30ad90bc None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:22.301705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c27b8f-d24a-4bb0-9f33-9fb2bb75e859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.303177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c27b8f-d24a-4bb0-9f33-9fb2bb75e859 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.303920 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c27b8f-d24a-4bb0-9f33-9fb2bb75e859 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.304645 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c27b8f-d24a-4bb0-9f33-9fb2bb75e859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.321819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c27b8f-d24a-4bb0-9f33-9fb2bb75e859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.324887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c27b8f-d24a-4bb0-9f33-9fb2bb75e859 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-d4c27b8f-d24a-4bb0-9f33-9fb2bb75e859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:22.346918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:22.348472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:22.350149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:22.350149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:22.350149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:22.350149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:22.350149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:22.350149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:22.350149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:22.350149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:22.354245 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 341/679] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:22.355716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c27b8f-d24a-4bb0-9f33-9fb2bb75e859 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:22.472516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c27b8f-d24a-4bb0-9f33-9fb2bb75e859 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.494745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c66c4-0a70-4c28-bb34-2bfe30ad90bc None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.512974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc8327-e902-4d87-bed0-7e1e1730a110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.514371 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc8327-e902-4d87-bed0-7e1e1730a110 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.514889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc8327-e902-4d87-bed0-7e1e1730a110 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.515366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc8327-e902-4d87-bed0-7e1e1730a110 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.516416 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc8327-e902-4d87-bed0-7e1e1730a110 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:22.516967 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc8327-e902-4d87-bed0-7e1e1730a110 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.519023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc8327-e902-4d87-bed0-7e1e1730a110 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.530750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:22.541857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 342/680] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Sep 7 15:57:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:22.543148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc8327-e902-4d87-bed0-7e1e1730a110 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:22.564919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14708eea-2ded-414d-ba7d-38a6afdc8828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.566035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14708eea-2ded-414d-ba7d-38a6afdc8828 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.566511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14708eea-2ded-414d-ba7d-38a6afdc8828 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.567042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14708eea-2ded-414d-ba7d-38a6afdc8828 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.568325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14708eea-2ded-414d-ba7d-38a6afdc8828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:22.569002 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14708eea-2ded-414d-ba7d-38a6afdc8828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.571634 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14708eea-2ded-414d-ba7d-38a6afdc8828 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.600904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 339/681] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:22.600904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14708eea-2ded-414d-ba7d-38a6afdc8828 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:22.662974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:22.678421 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc8327-e902-4d87-bed0-7e1e1730a110 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.720515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc922a9-afba-4b8d-8cbd-2990530d3ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.721722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc922a9-afba-4b8d-8cbd-2990530d3ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.722258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc922a9-afba-4b8d-8cbd-2990530d3ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.722781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc922a9-afba-4b8d-8cbd-2990530d3ee2 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.723840 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc922a9-afba-4b8d-8cbd-2990530d3ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:22.724387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc922a9-afba-4b8d-8cbd-2990530d3ee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.726138 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc922a9-afba-4b8d-8cbd-2990530d3ee2 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.741536 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 343/682] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:22.742766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc922a9-afba-4b8d-8cbd-2990530d3ee2 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:22.801946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14708eea-2ded-414d-ba7d-38a6afdc8828 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.815943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:22.869925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ecf3a-c488-4d81-baf7-5d06f9cdecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.871095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ecf3a-c488-4d81-baf7-5d06f9cdecb7 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.871590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ecf3a-c488-4d81-baf7-5d06f9cdecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.873119 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ecf3a-c488-4d81-baf7-5d06f9cdecb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.889853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc922a9-afba-4b8d-8cbd-2990530d3ee2 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.946678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535ec8f-e259-49a1-a1cf-affcc1adeecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.947292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ec8f-e259-49a1-a1cf-affcc1adeecd None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.947577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ec8f-e259-49a1-a1cf-affcc1adeecd None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.947912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ec8f-e259-49a1-a1cf-affcc1adeecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.948713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535ec8f-e259-49a1-a1cf-affcc1adeecd None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=c901e018aa1c429da33b5809873d0aea) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:22.949534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535ec8f-e259-49a1-a1cf-affcc1adeecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.951917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535ec8f-e259-49a1-a1cf-affcc1adeecd None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.968729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 344/683] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:22 2022] GET /identity/v3/role_assignments?user.id=c901e018aa1c429da33b5809873d0aea&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:22.968729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535ec8f-e259-49a1-a1cf-affcc1adeecd None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:23.017961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ecf3a-c488-4d81-baf7-5d06f9cdecb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:23.019830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ecf3a-c488-4d81-baf7-5d06f9cdecb7 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:23.081593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:23.137519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535ec8f-e259-49a1-a1cf-affcc1adeecd None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:23.172789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:23.192773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe8f28-9efa-4f1d-952e-3342ea9452db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:23.193204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe8f28-9efa-4f1d-952e-3342ea9452db None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.193563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe8f28-9efa-4f1d-952e-3342ea9452db None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.193992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe8f28-9efa-4f1d-952e-3342ea9452db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.195546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe8f28-9efa-4f1d-952e-3342ea9452db None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=e91f048f8885448383f4a361b07dac4f) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:23.195546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe8f28-9efa-4f1d-952e-3342ea9452db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:23.198681 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe8f28-9efa-4f1d-952e-3342ea9452db None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:23.204905 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 340/684] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:23.207472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa11fd-7ad9-4f08-9e6c-18cef40722fb None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.207991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa11fd-7ad9-4f08-9e6c-18cef40722fb None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.208532 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa11fd-7ad9-4f08-9e6c-18cef40722fb None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.211491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 341/685] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:23.212995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa11fd-7ad9-4f08-9e6c-18cef40722fb None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:23.217215 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 345/686] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:22 2022] GET /identity/v3/role_assignments?user.id=e91f048f8885448383f4a361b07dac4f&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:23.223950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725bd03-4a90-416a-97c7-eb8d8d293708 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.224445 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725bd03-4a90-416a-97c7-eb8d8d293708 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.227260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725bd03-4a90-416a-97c7-eb8d8d293708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.258009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b725bd03-4a90-416a-97c7-eb8d8d293708 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:23.259965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b725bd03-4a90-416a-97c7-eb8d8d293708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:23.369160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 346/687] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:57:23.391157 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa11fd-7ad9-4f08-9e6c-18cef40722fb None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:23.455469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be3782-7dec-4b9f-a602-af4d6c4dc355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:23.456523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be3782-7dec-4b9f-a602-af4d6c4dc355 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.457063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be3782-7dec-4b9f-a602-af4d6c4dc355 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.457345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be3782-7dec-4b9f-a602-af4d6c4dc355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.460155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:23.476694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be3782-7dec-4b9f-a602-af4d6c4dc355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:23.478294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be3782-7dec-4b9f-a602-af4d6c4dc355 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-96be3782-7dec-4b9f-a602-af4d6c4dc355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:23.501578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:23.502983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:23.504426 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:23.504426 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:23.504426 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:23.504426 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 342/688] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:23.508500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725bd03-4a90-416a-97c7-eb8d8d293708 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:23.651226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725bd03-4a90-416a-97c7-eb8d8d293708 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:23.670745 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:23.694830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94b5cf-a6bc-4e86-8679-baf3ec602c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:23.695859 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94b5cf-a6bc-4e86-8679-baf3ec602c0a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.696366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94b5cf-a6bc-4e86-8679-baf3ec602c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.696906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94b5cf-a6bc-4e86-8679-baf3ec602c0a None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.697696 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94b5cf-a6bc-4e86-8679-baf3ec602c0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:23.698007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94b5cf-a6bc-4e86-8679-baf3ec602c0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:23.699414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94b5cf-a6bc-4e86-8679-baf3ec602c0a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:23.702114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be3782-7dec-4b9f-a602-af4d6c4dc355 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:23.721550 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 347/689] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:23.726889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94b5cf-a6bc-4e86-8679-baf3ec602c0a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:23.922584 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be3782-7dec-4b9f-a602-af4d6c4dc355 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:23.937065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94b5cf-a6bc-4e86-8679-baf3ec602c0a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:23.994769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2b262-fea5-4a9c-9a32-0836d656a6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:23.995551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2b262-fea5-4a9c-9a32-0836d656a6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.995861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2b262-fea5-4a9c-9a32-0836d656a6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.996153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2b262-fea5-4a9c-9a32-0836d656a6f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.020940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e474b-2ce3-4722-bdd4-7615e36be2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.021591 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e474b-2ce3-4722-bdd4-7615e36be2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.021877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e474b-2ce3-4722-bdd4-7615e36be2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.022156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e474b-2ce3-4722-bdd4-7615e36be2e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.027650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2b262-fea5-4a9c-9a32-0836d656a6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-62f2b262-fea5-4a9c-9a32-0836d656a6f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:24.036746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:24.037769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:24.038611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:24.038611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:24.038611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:24.038611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:24.038611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:24.038611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:24.038611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:24.038611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:24.038611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:24.038611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:24.038611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:57:24.038611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:24.043146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e474b-2ce3-4722-bdd4-7615e36be2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.046501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e474b-2ce3-4722-bdd4-7615e36be2e8 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:24.047288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 343/690] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:57:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:24.052804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2b262-fea5-4a9c-9a32-0836d656a6f7 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-957e474b-2ce3-4722-bdd4-7615e36be2e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:24.070458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:24.071614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:24.072879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:24.072879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:24.072879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:24.072879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:24.072879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:24.072879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:24.072879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:24.072879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:24.075456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 348/691] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:24.089899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e474b-2ce3-4722-bdd4-7615e36be2e8 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.123977 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:24.183464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2b262-fea5-4a9c-9a32-0836d656a6f7 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.197221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:24.221187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51ff8e-580b-467e-9777-12377e4a2160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.222222 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51ff8e-580b-467e-9777-12377e4a2160 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.222707 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51ff8e-580b-467e-9777-12377e4a2160 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.223150 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51ff8e-580b-467e-9777-12377e4a2160 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.224031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51ff8e-580b-467e-9777-12377e4a2160 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:24.224486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51ff8e-580b-467e-9777-12377e4a2160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.226135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51ff8e-580b-467e-9777-12377e4a2160 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:24.235947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 344/692] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:57:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:24.242147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51ff8e-580b-467e-9777-12377e4a2160 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.392569 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51ff8e-580b-467e-9777-12377e4a2160 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.405969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:24.418362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e474b-2ce3-4722-bdd4-7615e36be2e8 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.436217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee888cb0-a9ff-4e05-90e1-fe75810ad7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.437244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee888cb0-a9ff-4e05-90e1-fe75810ad7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.437669 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee888cb0-a9ff-4e05-90e1-fe75810ad7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.438302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee888cb0-a9ff-4e05-90e1-fe75810ad7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.452963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee888cb0-a9ff-4e05-90e1-fe75810ad7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.455318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee888cb0-a9ff-4e05-90e1-fe75810ad7d4 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:24.467956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740201a-3dfb-4aca-add7-bb3aec59a2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.468766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740201a-3dfb-4aca-add7-bb3aec59a2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.469157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740201a-3dfb-4aca-add7-bb3aec59a2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.469532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740201a-3dfb-4aca-add7-bb3aec59a2e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.470349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740201a-3dfb-4aca-add7-bb3aec59a2e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:24.470756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740201a-3dfb-4aca-add7-bb3aec59a2e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.472526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740201a-3dfb-4aca-add7-bb3aec59a2e7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-ee888cb0-a9ff-4e05-90e1-fe75810ad7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:24.475211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:24.476321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:24.477429 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:24.477429 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:24.477429 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:24.479615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 345/693] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:24.486219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3fab-5696-42bb-985b-305c2a5d8ef5 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.486748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3fab-5696-42bb-985b-305c2a5d8ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.487188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3fab-5696-42bb-985b-305c2a5d8ef5 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.494573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 346/694] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:24.495475 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 349/695] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:24.500879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b3fab-5696-42bb-985b-305c2a5d8ef5 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.504094 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471484b2-0330-4140-aa05-0487426861cd None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.504570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471484b2-0330-4140-aa05-0487426861cd None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.505065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471484b2-0330-4140-aa05-0487426861cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.531274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-471484b2-0330-4140-aa05-0487426861cd None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:24.533754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-471484b2-0330-4140-aa05-0487426861cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:24.648843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 350/696] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:24.650584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471484b2-0330-4140-aa05-0487426861cd None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.667226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b3fab-5696-42bb-985b-305c2a5d8ef5 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.716807 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:24.721208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dd7ec-c8f2-4442-a02d-af4926dfa10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.722168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dd7ec-c8f2-4442-a02d-af4926dfa10a None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.722591 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dd7ec-c8f2-4442-a02d-af4926dfa10a None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.723289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dd7ec-c8f2-4442-a02d-af4926dfa10a None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.724616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473dd7ec-c8f2-4442-a02d-af4926dfa10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:24.725086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473dd7ec-c8f2-4442-a02d-af4926dfa10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.726740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473dd7ec-c8f2-4442-a02d-af4926dfa10a None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:24.743940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 347/697] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:24.754213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dd7ec-c8f2-4442-a02d-af4926dfa10a None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.789831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:24.920401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dd7ec-c8f2-4442-a02d-af4926dfa10a None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.921382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471484b2-0330-4140-aa05-0487426861cd None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.965799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1454b3-489d-4a5c-a330-4a301b8e3fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.970455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1454b3-489d-4a5c-a330-4a301b8e3fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.970954 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1454b3-489d-4a5c-a330-4a301b8e3fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.971427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1454b3-489d-4a5c-a330-4a301b8e3fa5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.985752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1454b3-489d-4a5c-a330-4a301b8e3fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.989005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1454b3-489d-4a5c-a330-4a301b8e3fa5 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:25.007947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac002435-5c49-49f0-8c0b-04e0c40132be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:25.008960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002435-5c49-49f0-8c0b-04e0c40132be None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:25.009445 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002435-5c49-49f0-8c0b-04e0c40132be None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:25.009916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002435-5c49-49f0-8c0b-04e0c40132be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:25.010864 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002435-5c49-49f0-8c0b-04e0c40132be None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=d853bab10d9d4060809476bfc44d3822) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:25.014081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002435-5c49-49f0-8c0b-04e0c40132be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:25.015769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002435-5c49-49f0-8c0b-04e0c40132be None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-3e1454b3-489d-4a5c-a330-4a301b8e3fa5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:25.023763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:25.024765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:25.025734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:25.025734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:25.025734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:25.025734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:25.025734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:25.025734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:25.025734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:25.025734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:25.025734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:57:25.025734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:25.040874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 348/698] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Sep 7 15:57:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:25.041094 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 351/699] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:24 2022] GET /identity/v3/role_assignments?user.id=d853bab10d9d4060809476bfc44d3822&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 608 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:25.043141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1454b3-489d-4a5c-a330-4a301b8e3fa5 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:25.090248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac002435-5c49-49f0-8c0b-04e0c40132be None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:25.225408 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:25.239536 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac002435-5c49-49f0-8c0b-04e0c40132be None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:25.253728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:25.285538 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1454b3-489d-4a5c-a330-4a301b8e3fa5 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:25.287843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8946a-a812-4ebf-b18b-84ff900dea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:25.288654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8946a-a812-4ebf-b18b-84ff900dea7a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:25.288962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8946a-a812-4ebf-b18b-84ff900dea7a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:25.289235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8946a-a812-4ebf-b18b-84ff900dea7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:25.303970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8946a-a812-4ebf-b18b-84ff900dea7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:25.305434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8946a-a812-4ebf-b18b-84ff900dea7a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-3ad8946a-a812-4ebf-b18b-84ff900dea7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:25.326095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:25.327115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:25.328605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:25.328605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:25.328605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:25.328605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 352/700] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:25.335114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8946a-a812-4ebf-b18b-84ff900dea7a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:25.344740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa515c0-2509-4507-8984-737d3408a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:25.345822 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa515c0-2509-4507-8984-737d3408a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:25.346346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa515c0-2509-4507-8984-737d3408a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:25.346867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa515c0-2509-4507-8984-737d3408a9c5 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:25.347810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa515c0-2509-4507-8984-737d3408a9c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:25.348320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa515c0-2509-4507-8984-737d3408a9c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:25.350087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa515c0-2509-4507-8984-737d3408a9c5 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:25.378322 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 349/701] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Sep 7 15:57:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:25.387012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa515c0-2509-4507-8984-737d3408a9c5 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:25.479319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8946a-a812-4ebf-b18b-84ff900dea7a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:25.524455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa515c0-2509-4507-8984-737d3408a9c5 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:25.525184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd188f8-8010-47c8-8db9-31980e880e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:25.526046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd188f8-8010-47c8-8db9-31980e880e50 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:25.526593 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd188f8-8010-47c8-8db9-31980e880e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:25.527059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd188f8-8010-47c8-8db9-31980e880e50 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:25.528121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd188f8-8010-47c8-8db9-31980e880e50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:25.528631 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd188f8-8010-47c8-8db9-31980e880e50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:25.530537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd188f8-8010-47c8-8db9-31980e880e50 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:25.546262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 353/702] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:25.555019 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd188f8-8010-47c8-8db9-31980e880e50 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:25.560205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:25.584154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021f15-8db3-4bfc-b2a7-189b2119daea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:25.585390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021f15-8db3-4bfc-b2a7-189b2119daea None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:25.585908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021f15-8db3-4bfc-b2a7-189b2119daea None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:25.586382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021f15-8db3-4bfc-b2a7-189b2119daea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:25.602431 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:25.704611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40021f15-8db3-4bfc-b2a7-189b2119daea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:25.707720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40021f15-8db3-4bfc-b2a7-189b2119daea None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:25.716697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd188f8-8010-47c8-8db9-31980e880e50 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:25.772271 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd50325-03fa-46ad-9334-3cb9a851c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:25.772991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50325-03fa-46ad-9334-3cb9a851c22a None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:25.773364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50325-03fa-46ad-9334-3cb9a851c22a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:25.773730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50325-03fa-46ad-9334-3cb9a851c22a None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:25.774484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd50325-03fa-46ad-9334-3cb9a851c22a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:25.776024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd50325-03fa-46ad-9334-3cb9a851c22a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:25.813630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 354/703] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:57:25 2022] POST /identity/v3/users => generated 254 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:25.875633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 350/704] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:25.882710 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd50325-03fa-46ad-9334-3cb9a851c22a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:25.925972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c30e-d2f6-4b7f-a8e5-400bbd7fc0b4 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:25.927193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c30e-d2f6-4b7f-a8e5-400bbd7fc0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:25.928618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06c30e-d2f6-4b7f-a8e5-400bbd7fc0b4 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:25.933031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 351/705] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:25.942500 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993e27b-2fb2-48c5-a903-83a397a341fa None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:25.943021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993e27b-2fb2-48c5-a903-83a397a341fa None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:25.943472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993e27b-2fb2-48c5-a903-83a397a341fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:25.981966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:25.983653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-0993e27b-2fb2-48c5-a903-83a397a341fa None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:25.985931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0993e27b-2fb2-48c5-a903-83a397a341fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:26.036761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd50325-03fa-46ad-9334-3cb9a851c22a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:26.077736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:26.101506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d970eef-25a7-42d6-9a39-2d82ec264e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:26.102185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d970eef-25a7-42d6-9a39-2d82ec264e9f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:26.102471 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d970eef-25a7-42d6-9a39-2d82ec264e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:26.102748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d970eef-25a7-42d6-9a39-2d82ec264e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:26.132359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d970eef-25a7-42d6-9a39-2d82ec264e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:26.133926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d970eef-25a7-42d6-9a39-2d82ec264e9f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:26.154844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 352/706] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-7d970eef-25a7-42d6-9a39-2d82ec264e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:26.162266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:26.163426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:26.164457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:26.164457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:26.164457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:26.164457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 355/707] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:26.173863 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993e27b-2fb2-48c5-a903-83a397a341fa None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:26.184212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0182b0-6657-4bb2-a556-130e0d51b01f None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:26.185462 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0182b0-6657-4bb2-a556-130e0d51b01f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:26.185928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0182b0-6657-4bb2-a556-130e0d51b01f None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:26.188454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 356/708] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:26.200577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f69b2-d8f2-4962-a6a1-3cf98aa0c3e4 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:26.201087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f69b2-d8f2-4962-a6a1-3cf98aa0c3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:26.201455 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f69b2-d8f2-4962-a6a1-3cf98aa0c3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:26.228177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-528f69b2-d8f2-4962-a6a1-3cf98aa0c3e4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:26.229575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-528f69b2-d8f2-4962-a6a1-3cf98aa0c3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:26.339700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 357/709] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:26.340197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993e27b-2fb2-48c5-a903-83a397a341fa None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:26.379563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8fa4f-a1e9-4559-b37a-3b8c9bb88cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:26.380549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8fa4f-a1e9-4559-b37a-3b8c9bb88cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:26.381059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8fa4f-a1e9-4559-b37a-3b8c9bb88cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:26.381536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8fa4f-a1e9-4559-b37a-3b8c9bb88cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:26.382395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8fa4f-a1e9-4559-b37a-3b8c9bb88cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:26.382941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8fa4f-a1e9-4559-b37a-3b8c9bb88cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:26.384570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8fa4f-a1e9-4559-b37a-3b8c9bb88cc6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:26.398899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 353/710] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:26.404166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f69b2-d8f2-4962-a6a1-3cf98aa0c3e4 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:26.469614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:26.483280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8fa4f-a1e9-4559-b37a-3b8c9bb88cc6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:26.522550 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:26.547405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f69b2-d8f2-4962-a6a1-3cf98aa0c3e4 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:26.594589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76dd61-520b-4fa0-b89b-4a57bfcafee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:26.595615 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76dd61-520b-4fa0-b89b-4a57bfcafee3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:26.596104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76dd61-520b-4fa0-b89b-4a57bfcafee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:26.596629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76dd61-520b-4fa0-b89b-4a57bfcafee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:26.605219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76dd61-520b-4fa0-b89b-4a57bfcafee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:26.608062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76dd61-520b-4fa0-b89b-4a57bfcafee3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-cf76dd61-520b-4fa0-b89b-4a57bfcafee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:26.623873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:26.624929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:26.625843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:26.625843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:26.625843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:26.625843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:26.625843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:26.625843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:26.625843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:26.625843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:26.628522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 358/711] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:26.633980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76dd61-520b-4fa0-b89b-4a57bfcafee3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:26.654823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8fa4f-a1e9-4559-b37a-3b8c9bb88cc6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:26.721326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb794d-d16c-4da5-80f4-8ad116428b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:26.723460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb794d-d16c-4da5-80f4-8ad116428b36 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:26.723947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb794d-d16c-4da5-80f4-8ad116428b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:26.724373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb794d-d16c-4da5-80f4-8ad116428b36 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:26.725226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb794d-d16c-4da5-80f4-8ad116428b36 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:26.727740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb794d-d16c-4da5-80f4-8ad116428b36 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-5ccb794d-d16c-4da5-80f4-8ad116428b36 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:26.743840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:26.745221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:57:26.746235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:26.750404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 354/712] 10.222.0.43 () {56 vars in 1129 bytes} [Wed Sep 7 15:57:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:26.751474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb794d-d16c-4da5-80f4-8ad116428b36 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:26.796086 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:26.802082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76dd61-520b-4fa0-b89b-4a57bfcafee3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:26.857861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10edc6-cda8-44a0-b7b5-17011a8decb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:26.859336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10edc6-cda8-44a0-b7b5-17011a8decb8 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:26.859958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10edc6-cda8-44a0-b7b5-17011a8decb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:26.860552 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10edc6-cda8-44a0-b7b5-17011a8decb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:26.863476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10edc6-cda8-44a0-b7b5-17011a8decb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:26.864259 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10edc6-cda8-44a0-b7b5-17011a8decb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:26.866626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10edc6-cda8-44a0-b7b5-17011a8decb8 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:26.888924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 359/713] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:26.890190 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10edc6-cda8-44a0-b7b5-17011a8decb8 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:26.907284 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:26.914367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb794d-d16c-4da5-80f4-8ad116428b36 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:26.971502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5a8b3-f99d-488b-ad67-ac2e685ecccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:26.972454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a8b3-f99d-488b-ad67-ac2e685ecccb None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:26.972969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a8b3-f99d-488b-ad67-ac2e685ecccb None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:26.973386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a8b3-f99d-488b-ad67-ac2e685ecccb None admin] PATH_INFO: `/v3/services/network` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:26.974144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5a8b3-f99d-488b-ad67-ac2e685ecccb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:26.975722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5a8b3-f99d-488b-ad67-ac2e685ecccb None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-46a5a8b3-f99d-488b-ad67-ac2e685ecccb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:26.988096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:26.989225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:57:26.990108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:26.993451 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 355/714] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:26 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:26.994880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5a8b3-f99d-488b-ad67-ac2e685ecccb None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:27.058395 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10edc6-cda8-44a0-b7b5-17011a8decb8 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:27.101029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0fd40-8498-4013-9f43-523656a57a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:27.101763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0fd40-8498-4013-9f43-523656a57a18 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:27.102167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0fd40-8498-4013-9f43-523656a57a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:27.102518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0fd40-8498-4013-9f43-523656a57a18 None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:27.103277 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0fd40-8498-4013-9f43-523656a57a18 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:27.103652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0fd40-8498-4013-9f43-523656a57a18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:27.105146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0fd40-8498-4013-9f43-523656a57a18 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:27.115505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 360/715] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Sep 7 15:57:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:27.116545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0fd40-8498-4013-9f43-523656a57a18 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:27.160523 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:27.161855 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5a8b3-f99d-488b-ad67-ac2e685ecccb None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:27.214066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442d2b4-8e78-4797-815c-c36a4a69f914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:27.214988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442d2b4-8e78-4797-815c-c36a4a69f914 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:27.215560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442d2b4-8e78-4797-815c-c36a4a69f914 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:27.216040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442d2b4-8e78-4797-815c-c36a4a69f914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:27.217297 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442d2b4-8e78-4797-815c-c36a4a69f914 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=9d71c0688ea84c05af925f3fb08f35ad) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:27.217984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442d2b4-8e78-4797-815c-c36a4a69f914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:27.219639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442d2b4-8e78-4797-815c-c36a4a69f914 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:27.228169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 356/716] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:26 2022] GET /identity/v3/role_assignments?user.id=9d71c0688ea84c05af925f3fb08f35ad&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:27.230007 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442d2b4-8e78-4797-815c-c36a4a69f914 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:27.300637 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:27.318259 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0fd40-8498-4013-9f43-523656a57a18 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:27.385565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5672d20-5116-42b8-8915-e23f93f063ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:27.386147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5672d20-5116-42b8-8915-e23f93f063ed None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:27.386429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5672d20-5116-42b8-8915-e23f93f063ed None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:27.386702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5672d20-5116-42b8-8915-e23f93f063ed None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:27.387855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5672d20-5116-42b8-8915-e23f93f063ed None admin] RBAC: Adding query filter params (name=network) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:27.389478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5672d20-5116-42b8-8915-e23f93f063ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:27.391096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5672d20-5116-42b8-8915-e23f93f063ed None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:27.411479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 361/717] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:57:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:27.419504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5672d20-5116-42b8-8915-e23f93f063ed None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:27.486117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442d2b4-8e78-4797-815c-c36a4a69f914 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:27.532532 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394e630-4da9-4ec5-adbe-66800ced3e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:27.537114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394e630-4da9-4ec5-adbe-66800ced3e55 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:27.537423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394e630-4da9-4ec5-adbe-66800ced3e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:27.537758 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394e630-4da9-4ec5-adbe-66800ced3e55 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:27.538429 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394e630-4da9-4ec5-adbe-66800ced3e55 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:27.538736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394e630-4da9-4ec5-adbe-66800ced3e55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:27.540140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394e630-4da9-4ec5-adbe-66800ced3e55 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:27.558537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 357/718] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Sep 7 15:57:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:27.574352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:27.588976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5672d20-5116-42b8-8915-e23f93f063ed None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:27.630295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed971ec2-1f69-4111-a925-86c35d0a550a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:27.631029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed971ec2-1f69-4111-a925-86c35d0a550a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:27.631312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed971ec2-1f69-4111-a925-86c35d0a550a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:27.631587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed971ec2-1f69-4111-a925-86c35d0a550a None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:27.632234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed971ec2-1f69-4111-a925-86c35d0a550a None admin] RBAC: Adding query filter params (type=network) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:27.632537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed971ec2-1f69-4111-a925-86c35d0a550a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:27.633963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed971ec2-1f69-4111-a925-86c35d0a550a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:27.641287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 362/719] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:57:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:28.311393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543ca71-9c6f-44cc-925f-27f9fb84955d None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:28.312408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543ca71-9c6f-44cc-925f-27f9fb84955d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:28.313101 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543ca71-9c6f-44cc-925f-27f9fb84955d None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:28.315346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 358/720] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:57:28.322091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc034bf-add8-4838-a465-13a75d06458a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:28.322602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc034bf-add8-4838-a465-13a75d06458a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:28.322816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc034bf-add8-4838-a465-13a75d06458a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:28.350133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-3fc034bf-add8-4838-a465-13a75d06458a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:28.351378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3fc034bf-add8-4838-a465-13a75d06458a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:28.461320 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 363/721] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:29.005323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543ca71-9c6f-44cc-925f-27f9fb84955d None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:29.130484 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:29.158282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543ca71-9c6f-44cc-925f-27f9fb84955d None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:29.205307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29302b36-cb0f-4489-bc8b-4d9a61121927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:29.205953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29302b36-cb0f-4489-bc8b-4d9a61121927 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:29.206227 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29302b36-cb0f-4489-bc8b-4d9a61121927 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:29.206498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29302b36-cb0f-4489-bc8b-4d9a61121927 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:29.228606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29302b36-cb0f-4489-bc8b-4d9a61121927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-29302b36-cb0f-4489-bc8b-4d9a61121927 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:29.234688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:29.235616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:29.236452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 359/722] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:57:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:29.243637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc034bf-add8-4838-a465-13a75d06458a None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:29.294511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f37779-f36e-4848-bee8-ddb425e7cb67 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:29.294920 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f37779-f36e-4848-bee8-ddb425e7cb67 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:29.295398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f37779-f36e-4848-bee8-ddb425e7cb67 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:29.302516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 360/723] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:29.310411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8f03d-c3ab-459b-a8b3-4afd56f7d3db None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:29.310782 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8f03d-c3ab-459b-a8b3-4afd56f7d3db None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:29.310971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8f03d-c3ab-459b-a8b3-4afd56f7d3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:29.368989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-3fa8f03d-c3ab-459b-a8b3-4afd56f7d3db None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:29.374560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3fa8f03d-c3ab-459b-a8b3-4afd56f7d3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:29.402904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:29.429910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc034bf-add8-4838-a465-13a75d06458a None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:29.484387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 361/724] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:57:29.521961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a073f-c49b-4660-acff-bd87274ebd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:29.522689 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a073f-c49b-4660-acff-bd87274ebd3a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:29.522972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a073f-c49b-4660-acff-bd87274ebd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:29.523233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a073f-c49b-4660-acff-bd87274ebd3a None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:29.523908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a073f-c49b-4660-acff-bd87274ebd3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:29.524206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a073f-c49b-4660-acff-bd87274ebd3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:29.525597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a073f-c49b-4660-acff-bd87274ebd3a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:29.540141 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 364/725] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:57:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:29.546992 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8f03d-c3ab-459b-a8b3-4afd56f7d3db None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:29.677922 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:29.725725 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8f03d-c3ab-459b-a8b3-4afd56f7d3db None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:29.775045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228f413-bf4b-4615-9585-b19ae0ec7361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:29.775734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228f413-bf4b-4615-9585-b19ae0ec7361 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:29.776041 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228f413-bf4b-4615-9585-b19ae0ec7361 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:29.776328 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228f413-bf4b-4615-9585-b19ae0ec7361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:29.784212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a073f-c49b-4660-acff-bd87274ebd3a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:29.789641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228f413-bf4b-4615-9585-b19ae0ec7361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:29.791268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228f413-bf4b-4615-9585-b19ae0ec7361 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-4228f413-bf4b-4615-9585-b19ae0ec7361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:29.807845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:29.810468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:29.812825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:29.812825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:29.812825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:29.812825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 362/726] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:29.817459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228f413-bf4b-4615-9585-b19ae0ec7361 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:29.944910 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228f413-bf4b-4615-9585-b19ae0ec7361 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:30.068087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a073f-c49b-4660-acff-bd87274ebd3a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:30.134613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058572d-0089-4dcc-8860-ca82c5f5ff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:30.135407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058572d-0089-4dcc-8860-ca82c5f5ff27 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.135787 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058572d-0089-4dcc-8860-ca82c5f5ff27 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.136158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058572d-0089-4dcc-8860-ca82c5f5ff27 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.136969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058572d-0089-4dcc-8860-ca82c5f5ff27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:30.137473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058572d-0089-4dcc-8860-ca82c5f5ff27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:30.139334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058572d-0089-4dcc-8860-ca82c5f5ff27 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:30.141998 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:30.158333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 363/727] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:30.163257 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058572d-0089-4dcc-8860-ca82c5f5ff27 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:30.190785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07ea62-7a55-4e90-b13e-442570824be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:30.191496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07ea62-7a55-4e90-b13e-442570824be0 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.191777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07ea62-7a55-4e90-b13e-442570824be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.192050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07ea62-7a55-4e90-b13e-442570824be0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.241343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07ea62-7a55-4e90-b13e-442570824be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-ed07ea62-7a55-4e90-b13e-442570824be0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:30.246881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:30.247871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:30.249058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 365/728] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:30.257852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07ea62-7a55-4e90-b13e-442570824be0 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:30.273111 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:30.298825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058572d-0089-4dcc-8860-ca82c5f5ff27 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:30.344457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1b243-7cfb-4bec-83bf-5467c6de9533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:30.345258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1b243-7cfb-4bec-83bf-5467c6de9533 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.345551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1b243-7cfb-4bec-83bf-5467c6de9533 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.345827 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1b243-7cfb-4bec-83bf-5467c6de9533 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.354617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1b243-7cfb-4bec-83bf-5467c6de9533 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:30.356880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1b243-7cfb-4bec-83bf-5467c6de9533 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-b5c1b243-7cfb-4bec-83bf-5467c6de9533 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:30.372375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:30.374162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:30.375444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:30.375444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:30.375444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:30.375444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:30.375444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:30.375444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:30.375444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:30.375444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:30.375444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:57:30.375444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:30.375444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 364/729] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:57:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:30.379497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1b243-7cfb-4bec-83bf-5467c6de9533 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:30.458762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:30.511937 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07ea62-7a55-4e90-b13e-442570824be0 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:30.535012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1b243-7cfb-4bec-83bf-5467c6de9533 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:30.566290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0e417-1a7d-4308-a19c-ce38c07c4e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:30.566911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0e417-1a7d-4308-a19c-ce38c07c4e0b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.567219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0e417-1a7d-4308-a19c-ce38c07c4e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.567466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0e417-1a7d-4308-a19c-ce38c07c4e0b None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.568138 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0e417-1a7d-4308-a19c-ce38c07c4e0b None admin] RBAC: Adding query filter params (name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:30.568439 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0e417-1a7d-4308-a19c-ce38c07c4e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:30.569874 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0e417-1a7d-4308-a19c-ce38c07c4e0b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:30.578700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 366/730] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:30.579967 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed439f90-cedf-4c3d-ba6a-61afebee88f3 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.580266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed439f90-cedf-4c3d-ba6a-61afebee88f3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.580520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed439f90-cedf-4c3d-ba6a-61afebee88f3 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.582114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 367/731] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:30.583484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f55ca4-e12b-4766-a39c-2b322cd11a7c None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.583484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f55ca4-e12b-4766-a39c-2b322cd11a7c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.583484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f55ca4-e12b-4766-a39c-2b322cd11a7c None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.584668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 368/732] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:30.585421 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f55ca4-e12b-4766-a39c-2b322cd11a7c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:30.590193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25905c-df91-416b-b756-01295030a24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:30.592113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25905c-df91-416b-b756-01295030a24c None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.592574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25905c-df91-416b-b756-01295030a24c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.593079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25905c-df91-416b-b756-01295030a24c None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.594408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25905c-df91-416b-b756-01295030a24c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:30.594992 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25905c-df91-416b-b756-01295030a24c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:30.597558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25905c-df91-416b-b756-01295030a24c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:30.627455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 365/733] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Sep 7 15:57:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:30.628651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3192b34-dd11-4e7c-b92d-41c83d0f5cb6 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.629271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3192b34-dd11-4e7c-b92d-41c83d0f5cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.629271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3192b34-dd11-4e7c-b92d-41c83d0f5cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.655256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e3192b34-dd11-4e7c-b92d-41c83d0f5cb6 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:30.656468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e3192b34-dd11-4e7c-b92d-41c83d0f5cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:30.680622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:30.719875 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f55ca4-e12b-4766-a39c-2b322cd11a7c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:30.733511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 366/734] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:30.734787 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01c082-7db8-4b80-a78b-9f6b19c66fa8 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.735071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01c082-7db8-4b80-a78b-9f6b19c66fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.735345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01c082-7db8-4b80-a78b-9f6b19c66fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.764361 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c923d-9ec3-422d-b720-ddb583a250d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:30.765031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c923d-9ec3-422d-b720-ddb583a250d7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.765319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c923d-9ec3-422d-b720-ddb583a250d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.765587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c923d-9ec3-422d-b720-ddb583a250d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.769874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8c01c082-7db8-4b80-a78b-9f6b19c66fa8 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:30.771173 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8c01c082-7db8-4b80-a78b-9f6b19c66fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:30.778390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c923d-9ec3-422d-b720-ddb583a250d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:30.780123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c923d-9ec3-422d-b720-ddb583a250d7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-f80c923d-9ec3-422d-b720-ddb583a250d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:30.797626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:30.799626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:30.801382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:30.801382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:30.801382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:30.801382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 369/735] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:30.801382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c923d-9ec3-422d-b720-ddb583a250d7 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:30.811935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:30.864232 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 367/736] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:30.870132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194a8aa-2768-46d3-98b4-2ac03fa09133 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.870862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194a8aa-2768-46d3-98b4-2ac03fa09133 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.871331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194a8aa-2768-46d3-98b4-2ac03fa09133 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.874048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 368/737] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:30.875183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194a8aa-2768-46d3-98b4-2ac03fa09133 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:30.963422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c923d-9ec3-422d-b720-ddb583a250d7 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.000554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:31.021514 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194a8aa-2768-46d3-98b4-2ac03fa09133 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.034143 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe17240-17a2-4be6-ba52-e47322ca9ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.034811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe17240-17a2-4be6-ba52-e47322ca9ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.035095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe17240-17a2-4be6-ba52-e47322ca9ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.035366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe17240-17a2-4be6-ba52-e47322ca9ab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.070970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fedf6-d3bb-431a-b249-88af54ad7bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.071620 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fedf6-d3bb-431a-b249-88af54ad7bad None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.071877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fedf6-d3bb-431a-b249-88af54ad7bad None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.072160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fedf6-d3bb-431a-b249-88af54ad7bad None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.072800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fedf6-d3bb-431a-b249-88af54ad7bad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:31.073099 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fedf6-d3bb-431a-b249-88af54ad7bad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.074663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fedf6-d3bb-431a-b249-88af54ad7bad None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.089801 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 369/738] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:31.091310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4241-6636-4d9f-b73b-fa8d520d6e94 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.091658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4241-6636-4d9f-b73b-fa8d520d6e94 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.092000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4241-6636-4d9f-b73b-fa8d520d6e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.110672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-661c4241-6636-4d9f-b73b-fa8d520d6e94 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:31.111920 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-661c4241-6636-4d9f-b73b-fa8d520d6e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:31.133480 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:31.133765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe17240-17a2-4be6-ba52-e47322ca9ab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.135882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe17240-17a2-4be6-ba52-e47322ca9ab4 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.199100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 370/739] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:57:31.199981 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4241-6636-4d9f-b73b-fa8d520d6e94 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.260712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 370/740] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:31.262554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe17240-17a2-4be6-ba52-e47322ca9ab4 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.289217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:31.326797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4241-6636-4d9f-b73b-fa8d520d6e94 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.380305 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7a65e-25b3-456e-869d-b28a5970b49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.381152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7a65e-25b3-456e-869d-b28a5970b49e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.381319 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7a65e-25b3-456e-869d-b28a5970b49e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.381555 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7a65e-25b3-456e-869d-b28a5970b49e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.395558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7a65e-25b3-456e-869d-b28a5970b49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-51c7a65e-25b3-456e-869d-b28a5970b49e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:31.400492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:31.401699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:31.402551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 371/741] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:57:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:31.403991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7a65e-25b3-456e-869d-b28a5970b49e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.405804 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe17240-17a2-4be6-ba52-e47322ca9ab4 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.432529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:31.466564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9057bc-7fce-40a0-bf79-b73253c8149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.467512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9057bc-7fce-40a0-bf79-b73253c8149a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.468124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9057bc-7fce-40a0-bf79-b73253c8149a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.468815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9057bc-7fce-40a0-bf79-b73253c8149a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.477323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9057bc-7fce-40a0-bf79-b73253c8149a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.479102 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9057bc-7fce-40a0-bf79-b73253c8149a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-0b9057bc-7fce-40a0-bf79-b73253c8149a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:31.494397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:31.495450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:31.496413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:31.496413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:31.496413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:31.496413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:31.496413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:31.496413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:31.496413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:31.496413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:31.496413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:57:31.496413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:31.496413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 371/742] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Sep 7 15:57:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:31.496413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9057bc-7fce-40a0-bf79-b73253c8149a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.562129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7a65e-25b3-456e-869d-b28a5970b49e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.595145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:31.600443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d12e43-f4b5-4d07-a643-1b3ca1cfed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.601101 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d12e43-f4b5-4d07-a643-1b3ca1cfed94 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.601393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d12e43-f4b5-4d07-a643-1b3ca1cfed94 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.601666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d12e43-f4b5-4d07-a643-1b3ca1cfed94 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.602327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d12e43-f4b5-4d07-a643-1b3ca1cfed94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.603713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d12e43-f4b5-4d07-a643-1b3ca1cfed94 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.619336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 372/743] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:57:31 2022] POST /identity/v3/services => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:31.620218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d12e43-f4b5-4d07-a643-1b3ca1cfed94 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.620323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9057bc-7fce-40a0-bf79-b73253c8149a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.693595 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e5824-5020-4d9d-af92-db4d3b9254a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.694263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e5824-5020-4d9d-af92-db4d3b9254a2 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.694540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e5824-5020-4d9d-af92-db4d3b9254a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.694817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e5824-5020-4d9d-af92-db4d3b9254a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.706281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e5824-5020-4d9d-af92-db4d3b9254a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.707781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e5824-5020-4d9d-af92-db4d3b9254a2 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.727011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-f09e5824-5020-4d9d-af92-db4d3b9254a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:31.729263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:31.730265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:31.731981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:31.731981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:31.731981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:31.731981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 372/744] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:31.731981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e5824-5020-4d9d-af92-db4d3b9254a2 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.766539 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d12e43-f4b5-4d07-a643-1b3ca1cfed94 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.815580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc92462-a32c-4b5b-b7c5-a119751eab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.816204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc92462-a32c-4b5b-b7c5-a119751eab92 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.816486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc92462-a32c-4b5b-b7c5-a119751eab92 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.816790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc92462-a32c-4b5b-b7c5-a119751eab92 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.817533 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc92462-a32c-4b5b-b7c5-a119751eab92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:31.817842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc92462-a32c-4b5b-b7c5-a119751eab92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.819269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc92462-a32c-4b5b-b7c5-a119751eab92 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.831547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 373/745] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:57:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:31.832876 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc92462-a32c-4b5b-b7c5-a119751eab92 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.866632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e5824-5020-4d9d-af92-db4d3b9254a2 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.899288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:31.909706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a634aa7-626a-4d14-bf73-4a01ae9c9ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.910315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634aa7-626a-4d14-bf73-4a01ae9c9ffc None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.910594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634aa7-626a-4d14-bf73-4a01ae9c9ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.910870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634aa7-626a-4d14-bf73-4a01ae9c9ffc None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.911550 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a634aa7-626a-4d14-bf73-4a01ae9c9ffc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.912912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a634aa7-626a-4d14-bf73-4a01ae9c9ffc None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.938120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 373/746] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:57:31 2022] POST /identity/v3/services => generated 240 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:31.939289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a634aa7-626a-4d14-bf73-4a01ae9c9ffc None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.972165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc92462-a32c-4b5b-b7c5-a119751eab92 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.030089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:32.036747 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3805d6-0381-4147-a34d-962fb6ef5836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.037813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3805d6-0381-4147-a34d-962fb6ef5836 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.038291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3805d6-0381-4147-a34d-962fb6ef5836 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.038747 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3805d6-0381-4147-a34d-962fb6ef5836 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.039695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3805d6-0381-4147-a34d-962fb6ef5836 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:32.040195 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3805d6-0381-4147-a34d-962fb6ef5836 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.042046 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3805d6-0381-4147-a34d-962fb6ef5836 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.067556 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 374/747] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Sep 7 15:57:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:32.069590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3805d6-0381-4147-a34d-962fb6ef5836 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:32.119444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a634aa7-626a-4d14-bf73-4a01ae9c9ffc None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.165576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7174472-9e7d-4ba3-aa71-ef6841b02b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.166290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7174472-9e7d-4ba3-aa71-ef6841b02b57 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.166579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7174472-9e7d-4ba3-aa71-ef6841b02b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.166851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7174472-9e7d-4ba3-aa71-ef6841b02b57 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.167512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7174472-9e7d-4ba3-aa71-ef6841b02b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:32.167830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7174472-9e7d-4ba3-aa71-ef6841b02b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.170563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7174472-9e7d-4ba3-aa71-ef6841b02b57 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.185740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 374/748] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:32.186491 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7174472-9e7d-4ba3-aa71-ef6841b02b57 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:32.207568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3805d6-0381-4147-a34d-962fb6ef5836 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.250797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:32.256900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2794a50-0e8d-483f-88aa-6d2fba53c307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.257940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2794a50-0e8d-483f-88aa-6d2fba53c307 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.258226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2794a50-0e8d-483f-88aa-6d2fba53c307 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.259266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2794a50-0e8d-483f-88aa-6d2fba53c307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.274047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2794a50-0e8d-483f-88aa-6d2fba53c307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.275775 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2794a50-0e8d-483f-88aa-6d2fba53c307 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-b2794a50-0e8d-483f-88aa-6d2fba53c307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:32.307848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:32.308976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:32.311083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:32.311083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:32.311083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:32.311083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 375/749] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:32.311083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2794a50-0e8d-483f-88aa-6d2fba53c307 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:32.333366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7174472-9e7d-4ba3-aa71-ef6841b02b57 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.360845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:32.381660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddb512-b576-46cb-b0e2-65f8967ca96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.382281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddb512-b576-46cb-b0e2-65f8967ca96b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.382560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddb512-b576-46cb-b0e2-65f8967ca96b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.382836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddb512-b576-46cb-b0e2-65f8967ca96b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.422728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2794a50-0e8d-483f-88aa-6d2fba53c307 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.460669 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3e3f-8b30-4984-8527-14b6b1eea749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.461421 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3e3f-8b30-4984-8527-14b6b1eea749 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.461715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3e3f-8b30-4984-8527-14b6b1eea749 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.462000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3e3f-8b30-4984-8527-14b6b1eea749 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.470394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea3e3f-8b30-4984-8527-14b6b1eea749 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.471944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea3e3f-8b30-4984-8527-14b6b1eea749 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.475512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddb512-b576-46cb-b0e2-65f8967ca96b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.477041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddb512-b576-46cb-b0e2-65f8967ca96b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-3cea3e3f-8b30-4984-8527-14b6b1eea749 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:32.484423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:32.485383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:32.486859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:32.486859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:32.486859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:32.486859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:32.486859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:32.486859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:32.486859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:32.486859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:32.486859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 376/750] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:32.486859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3e3f-8b30-4984-8527-14b6b1eea749 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:32.536049 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:32.601317 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 375/751] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:57:32.602498 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddb512-b576-46cb-b0e2-65f8967ca96b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:32.631460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3e3f-8b30-4984-8527-14b6b1eea749 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.633691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:32.686772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af259a48-16b1-4f7a-8d24-c4ff55d4b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.687972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af259a48-16b1-4f7a-8d24-c4ff55d4b6af None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.688255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af259a48-16b1-4f7a-8d24-c4ff55d4b6af None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.688819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af259a48-16b1-4f7a-8d24-c4ff55d4b6af None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.689481 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af259a48-16b1-4f7a-8d24-c4ff55d4b6af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:32.689788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af259a48-16b1-4f7a-8d24-c4ff55d4b6af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.692317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af259a48-16b1-4f7a-8d24-c4ff55d4b6af None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.712836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 377/752] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:32.714071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af259a48-16b1-4f7a-8d24-c4ff55d4b6af None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:32.731076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddb512-b576-46cb-b0e2-65f8967ca96b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.769803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f393908-e9c5-4ca9-86a8-2dcda9de05bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.770016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f393908-e9c5-4ca9-86a8-2dcda9de05bf None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.770264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f393908-e9c5-4ca9-86a8-2dcda9de05bf None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.770520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f393908-e9c5-4ca9-86a8-2dcda9de05bf None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.771206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f393908-e9c5-4ca9-86a8-2dcda9de05bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:32.771508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f393908-e9c5-4ca9-86a8-2dcda9de05bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.773009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f393908-e9c5-4ca9-86a8-2dcda9de05bf None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.789032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 376/753] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:32.789887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f393908-e9c5-4ca9-86a8-2dcda9de05bf None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:32.801910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:32.866369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af259a48-16b1-4f7a-8d24-c4ff55d4b6af None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.913064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f393908-e9c5-4ca9-86a8-2dcda9de05bf None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.920996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6e050-9920-4f3b-892b-339c60320895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.921962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6e050-9920-4f3b-892b-339c60320895 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.922964 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6e050-9920-4f3b-892b-339c60320895 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.923506 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6e050-9920-4f3b-892b-339c60320895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.939675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6e050-9920-4f3b-892b-339c60320895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.942546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6e050-9920-4f3b-892b-339c60320895 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.949145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684114b3-6ef7-4f6c-a329-158bd1aa8591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.949966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684114b3-6ef7-4f6c-a329-158bd1aa8591 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.950311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684114b3-6ef7-4f6c-a329-158bd1aa8591 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.950590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684114b3-6ef7-4f6c-a329-158bd1aa8591 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.959500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684114b3-6ef7-4f6c-a329-158bd1aa8591 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.961039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684114b3-6ef7-4f6c-a329-158bd1aa8591 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-56b6e050-9920-4f3b-892b-339c60320895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:32.965097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:32.967107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:32.967997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:32.967997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:32.967997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:32.970435 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 378/754] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:32.971590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6e050-9920-4f3b-892b-339c60320895 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-684114b3-6ef7-4f6c-a329-158bd1aa8591 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:32.974172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:32.975150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:32.976136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:32.976136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:32.976136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:32.976136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:32.976136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:32.976136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:32.976136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:32.976136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:32.976136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:57:32.976136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:32.980804 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 377/755] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Sep 7 15:57:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:32.981990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684114b3-6ef7-4f6c-a329-158bd1aa8591 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:33.004632 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:33.063416 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:33.113020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684114b3-6ef7-4f6c-a329-158bd1aa8591 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:33.129895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6e050-9920-4f3b-892b-339c60320895 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:33.162048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fa6d7-d3d3-4e3f-b47f-d1ff148a568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:33.162782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fa6d7-d3d3-4e3f-b47f-d1ff148a568d None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:33.163065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fa6d7-d3d3-4e3f-b47f-d1ff148a568d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:33.163341 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fa6d7-d3d3-4e3f-b47f-d1ff148a568d None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:33.164255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fa6d7-d3d3-4e3f-b47f-d1ff148a568d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:33.165012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fa6d7-d3d3-4e3f-b47f-d1ff148a568d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:33.166654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fa6d7-d3d3-4e3f-b47f-d1ff148a568d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:33.173633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7b452-b704-46c3-b853-ed09ab61e133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:33.174361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7b452-b704-46c3-b853-ed09ab61e133 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:33.174737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7b452-b704-46c3-b853-ed09ab61e133 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:33.175104 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7b452-b704-46c3-b853-ed09ab61e133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:33.175951 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7b452-b704-46c3-b853-ed09ab61e133 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=d853bab10d9d4060809476bfc44d3822) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:33.176364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7b452-b704-46c3-b853-ed09ab61e133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:33.177984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7b452-b704-46c3-b853-ed09ab61e133 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:33.183270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 378/756] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:33.184704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fa6d7-d3d3-4e3f-b47f-d1ff148a568d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:33.193320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 379/757] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:32 2022] GET /identity/v3/role_assignments?user.id=d853bab10d9d4060809476bfc44d3822&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:33.194398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7b452-b704-46c3-b853-ed09ab61e133 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:33.352918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fa6d7-d3d3-4e3f-b47f-d1ff148a568d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:33.390928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:33.408965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:33.427465 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b9718-d82e-47ad-937f-e2a6d2778a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:33.428353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b9718-d82e-47ad-937f-e2a6d2778a01 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:33.428781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b9718-d82e-47ad-937f-e2a6d2778a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:33.429394 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b9718-d82e-47ad-937f-e2a6d2778a01 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:33.430686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b9718-d82e-47ad-937f-e2a6d2778a01 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:33.431145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b9718-d82e-47ad-937f-e2a6d2778a01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:33.433928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b9718-d82e-47ad-937f-e2a6d2778a01 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:33.455731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7b452-b704-46c3-b853-ed09ab61e133 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:33.470708 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 379/758] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Sep 7 15:57:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:33.477744 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b9718-d82e-47ad-937f-e2a6d2778a01 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:33.520104 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6c416-83d7-4851-8311-331f7ff7b9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:33.520844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6c416-83d7-4851-8311-331f7ff7b9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:33.521127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6c416-83d7-4851-8311-331f7ff7b9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:33.521400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6c416-83d7-4851-8311-331f7ff7b9a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:33.530687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6c416-83d7-4851-8311-331f7ff7b9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:33.532574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6c416-83d7-4851-8311-331f7ff7b9a9 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-66b6c416-83d7-4851-8311-331f7ff7b9a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:33.555447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:33.556439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:33.557375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:33.557375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:33.557375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:33.557375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:33.557375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:33.557375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:33.557375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:33.557375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:33.565968 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 380/759] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:33.571731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6c416-83d7-4851-8311-331f7ff7b9a9 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:33.654155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b9718-d82e-47ad-937f-e2a6d2778a01 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:33.706312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffc3a6-3011-4193-93f0-ffca19363755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:33.707446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffc3a6-3011-4193-93f0-ffca19363755 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:33.709209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffc3a6-3011-4193-93f0-ffca19363755 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:33.710406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffc3a6-3011-4193-93f0-ffca19363755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:33.748066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffc3a6-3011-4193-93f0-ffca19363755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:33.752808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffc3a6-3011-4193-93f0-ffca19363755 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-08ffc3a6-3011-4193-93f0-ffca19363755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:33.791101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:33.792128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:33.793146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:33.793146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:33.793146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:33.793146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 380/760] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:33.800545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffc3a6-3011-4193-93f0-ffca19363755 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:33.806242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6c416-83d7-4851-8311-331f7ff7b9a9 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:33.845144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7965e-ed40-4aeb-a3d9-64e7b73bc67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:33.846159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7965e-ed40-4aeb-a3d9-64e7b73bc67b None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:33.846711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7965e-ed40-4aeb-a3d9-64e7b73bc67b None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:33.847189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7965e-ed40-4aeb-a3d9-64e7b73bc67b None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:33.848144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7965e-ed40-4aeb-a3d9-64e7b73bc67b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:33.848661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7965e-ed40-4aeb-a3d9-64e7b73bc67b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:33.850458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7965e-ed40-4aeb-a3d9-64e7b73bc67b None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:33.860026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:33.868014 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 381/761] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:33.874001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7965e-ed40-4aeb-a3d9-64e7b73bc67b None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:33.889622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:33.972907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffc3a6-3011-4193-93f0-ffca19363755 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:33.997275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7965e-ed40-4aeb-a3d9-64e7b73bc67b None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:34.013172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99823374-9455-45b8-a668-54a00d45d128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:34.013928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99823374-9455-45b8-a668-54a00d45d128 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:34.014206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99823374-9455-45b8-a668-54a00d45d128 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:34.014473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99823374-9455-45b8-a668-54a00d45d128 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:34.015123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99823374-9455-45b8-a668-54a00d45d128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:34.015421 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99823374-9455-45b8-a668-54a00d45d128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:34.016838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99823374-9455-45b8-a668-54a00d45d128 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:34.033975 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 381/762] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:34.045812 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99823374-9455-45b8-a668-54a00d45d128 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:34.047394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99381eda-3bb9-4e7c-8197-28c58a1a90a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:34.048256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99381eda-3bb9-4e7c-8197-28c58a1a90a6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:34.048874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99381eda-3bb9-4e7c-8197-28c58a1a90a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:34.049362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99381eda-3bb9-4e7c-8197-28c58a1a90a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:34.050352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99381eda-3bb9-4e7c-8197-28c58a1a90a6 None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=c0fa7d339c134c20b471170e13bbb9de) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:34.050873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99381eda-3bb9-4e7c-8197-28c58a1a90a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:34.052541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99381eda-3bb9-4e7c-8197-28c58a1a90a6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:34.059294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 382/763] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:33 2022] GET /identity/v3/role_assignments?user.id=c0fa7d339c134c20b471170e13bbb9de&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:34.116698 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018238f-1bb7-4106-844a-c51e0c4087bb None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:34.117348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018238f-1bb7-4106-844a-c51e0c4087bb None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:34.117858 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018238f-1bb7-4106-844a-c51e0c4087bb None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:34.120036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 383/764] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:57:34.125651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa308f6-fa4e-4dd2-bbba-f0616900bdd8 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:34.126309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa308f6-fa4e-4dd2-bbba-f0616900bdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:34.126841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa308f6-fa4e-4dd2-bbba-f0616900bdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:34.166885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-aaa308f6-fa4e-4dd2-bbba-f0616900bdd8 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:34.170783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-aaa308f6-fa4e-4dd2-bbba-f0616900bdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:34.177133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:34.194703 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99823374-9455-45b8-a668-54a00d45d128 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:34.260187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3815765-fec3-4ec0-96f7-028483a76f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:34.260810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3815765-fec3-4ec0-96f7-028483a76f73 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:34.261061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3815765-fec3-4ec0-96f7-028483a76f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:34.261336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3815765-fec3-4ec0-96f7-028483a76f73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:34.270199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3815765-fec3-4ec0-96f7-028483a76f73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:34.272020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3815765-fec3-4ec0-96f7-028483a76f73 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:34.284859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-a3815765-fec3-4ec0-96f7-028483a76f73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:34.294221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:34.295278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:34.296273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:34.296273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:34.296273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:34.296273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:34.296273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:34.296273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:34.296273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:34.296273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:34.298458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 382/765] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:34.305532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3815765-fec3-4ec0-96f7-028483a76f73 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:34.307071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 384/766] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:34.481136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3815765-fec3-4ec0-96f7-028483a76f73 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:34.548700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c9252-21cc-4072-9ad4-b2764040bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:34.549693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c9252-21cc-4072-9ad4-b2764040bdef None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:34.550188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c9252-21cc-4072-9ad4-b2764040bdef None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:34.550667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c9252-21cc-4072-9ad4-b2764040bdef None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:34.551712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c9252-21cc-4072-9ad4-b2764040bdef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:34.552291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c9252-21cc-4072-9ad4-b2764040bdef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:34.553996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c9252-21cc-4072-9ad4-b2764040bdef None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:34.573315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 383/767] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:34.580823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa308f6-fa4e-4dd2-bbba-f0616900bdd8 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:34.620845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91753e-7d01-4e03-865d-38c8c1472356 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:34.622253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91753e-7d01-4e03-865d-38c8c1472356 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:34.623770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91753e-7d01-4e03-865d-38c8c1472356 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:34.626498 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 384/768] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:34.634233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58792ae1-2c23-4218-8d1c-d021bb73670e None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:34.634579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58792ae1-2c23-4218-8d1c-d021bb73670e None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:34.634827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58792ae1-2c23-4218-8d1c-d021bb73670e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:34.666297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-58792ae1-2c23-4218-8d1c-d021bb73670e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:34.667540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-58792ae1-2c23-4218-8d1c-d021bb73670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:34.702629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:34.707396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa308f6-fa4e-4dd2-bbba-f0616900bdd8 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:34.750918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e7c9f-5bac-44cb-be9b-389e48e235a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:34.751915 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e7c9f-5bac-44cb-be9b-389e48e235a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:34.752340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e7c9f-5bac-44cb-be9b-389e48e235a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:34.752655 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e7c9f-5bac-44cb-be9b-389e48e235a6 None admin] PATH_INFO: `/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/9d71c0688ea84c05af925f3fb08f35ad/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:34.756396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e7c9f-5bac-44cb-be9b-389e48e235a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=983beac5fc784756b6bdf11b07e219ac, user_id=9d71c0688ea84c05af925f3fb08f35ad, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:34.757948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e7c9f-5bac-44cb-be9b-389e48e235a6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:34.784966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 385/769] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:57:34 2022] PUT /identity/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/9d71c0688ea84c05af925f3fb08f35ad/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:34.823457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e7c9f-5bac-44cb-be9b-389e48e235a6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:34.823907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 385/770] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:34.945377 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:35.049735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e7c9f-5bac-44cb-be9b-389e48e235a6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:35.114441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4508c3-0ccb-4bd3-8afe-92a96587e144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:35.115820 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4508c3-0ccb-4bd3-8afe-92a96587e144 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:35.116462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4508c3-0ccb-4bd3-8afe-92a96587e144 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:35.117202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4508c3-0ccb-4bd3-8afe-92a96587e144 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:35.118654 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4508c3-0ccb-4bd3-8afe-92a96587e144 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:35.120916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4508c3-0ccb-4bd3-8afe-92a96587e144 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-7e4508c3-0ccb-4bd3-8afe-92a96587e144 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:35.138728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:35.140229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:57:35.141521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:35.145765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 386/771] 10.222.0.43 () {56 vars in 1129 bytes} [Wed Sep 7 15:57:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:35.154338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58792ae1-2c23-4218-8d1c-d021bb73670e None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:35.188833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4508c3-0ccb-4bd3-8afe-92a96587e144 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:35.354486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58792ae1-2c23-4218-8d1c-d021bb73670e None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:35.378676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4508c3-0ccb-4bd3-8afe-92a96587e144 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:35.406261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:35.419512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3fc1e-3b10-4548-9c1c-6d3d6e310a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:35.420150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3fc1e-3b10-4548-9c1c-6d3d6e310a5e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:35.420412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3fc1e-3b10-4548-9c1c-6d3d6e310a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:35.420703 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3fc1e-3b10-4548-9c1c-6d3d6e310a5e None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:35.421348 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3fc1e-3b10-4548-9c1c-6d3d6e310a5e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:35.421652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3fc1e-3b10-4548-9c1c-6d3d6e310a5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:35.423028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3fc1e-3b10-4548-9c1c-6d3d6e310a5e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:35.432572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 386/772] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Sep 7 15:57:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:35.436923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3fc1e-3b10-4548-9c1c-6d3d6e310a5e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:35.449449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d915-4c30-41d7-8544-72c5759aa7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:35.450838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d915-4c30-41d7-8544-72c5759aa7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:35.451113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d915-4c30-41d7-8544-72c5759aa7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:35.451392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d915-4c30-41d7-8544-72c5759aa7c6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:35.451980 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872d915-4c30-41d7-8544-72c5759aa7c6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:35.456714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872d915-4c30-41d7-8544-72c5759aa7c6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:35.462348 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-1872d915-4c30-41d7-8544-72c5759aa7c6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:35.469386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:35.470427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:57:35.471268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:35.472032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 387/773] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:35 2022] GET /identity/v3/services/network => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:35.478431 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d915-4c30-41d7-8544-72c5759aa7c6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:35.630794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d915-4c30-41d7-8544-72c5759aa7c6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:35.672555 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040a3ac-29a8-43f2-97e9-0c773f7e1b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:35.681838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040a3ac-29a8-43f2-97e9-0c773f7e1b42 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:35.682197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040a3ac-29a8-43f2-97e9-0c773f7e1b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:35.682682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040a3ac-29a8-43f2-97e9-0c773f7e1b42 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:35.683750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040a3ac-29a8-43f2-97e9-0c773f7e1b42 None admin] RBAC: Adding query filter params (name=network) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:35.684270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040a3ac-29a8-43f2-97e9-0c773f7e1b42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:35.686702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040a3ac-29a8-43f2-97e9-0c773f7e1b42 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:35.702088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 388/774] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:57:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:35.702608 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3fc1e-3b10-4548-9c1c-6d3d6e310a5e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:35.708238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040a3ac-29a8-43f2-97e9-0c773f7e1b42 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:35.766536 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364719e1-97df-4914-8977-cd9e489c2bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:35.767369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364719e1-97df-4914-8977-cd9e489c2bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:35.767730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364719e1-97df-4914-8977-cd9e489c2bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:35.768008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364719e1-97df-4914-8977-cd9e489c2bf5 None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:35.769281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364719e1-97df-4914-8977-cd9e489c2bf5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:35.769604 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364719e1-97df-4914-8977-cd9e489c2bf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:35.771521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364719e1-97df-4914-8977-cd9e489c2bf5 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:35.786219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 387/775] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Sep 7 15:57:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:35.794174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364719e1-97df-4914-8977-cd9e489c2bf5 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:35.795099 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:35.866784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040a3ac-29a8-43f2-97e9-0c773f7e1b42 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:35.922908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4ffcf-8ae2-47e3-8c7c-8309f7595712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:35.923875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4ffcf-8ae2-47e3-8c7c-8309f7595712 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:35.924165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4ffcf-8ae2-47e3-8c7c-8309f7595712 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:35.924482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4ffcf-8ae2-47e3-8c7c-8309f7595712 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:35.925368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4ffcf-8ae2-47e3-8c7c-8309f7595712 None admin] RBAC: Adding query filter params (type=network) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:35.925893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4ffcf-8ae2-47e3-8c7c-8309f7595712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:35.927886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4ffcf-8ae2-47e3-8c7c-8309f7595712 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:35.937253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 389/776] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:57:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:35.943644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4ffcf-8ae2-47e3-8c7c-8309f7595712 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:36.004583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:36.046788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364719e1-97df-4914-8977-cd9e489c2bf5 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:36.082426 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4ffcf-8ae2-47e3-8c7c-8309f7595712 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:36.099941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:36.105283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f43fd8-cb25-4efb-8374-9b3b585bda45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:36.107291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f43fd8-cb25-4efb-8374-9b3b585bda45 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.108039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f43fd8-cb25-4efb-8374-9b3b585bda45 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.108803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f43fd8-cb25-4efb-8374-9b3b585bda45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.110340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f43fd8-cb25-4efb-8374-9b3b585bda45 None admin] RBAC: Adding query filter params (interface=public, service_id=f2756a044f244ece9a863b3a64c7edba, region_id=RegionOne) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:36.111132 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f43fd8-cb25-4efb-8374-9b3b585bda45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:36.113906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f43fd8-cb25-4efb-8374-9b3b585bda45 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:36.127574 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 388/777] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Sep 7 15:57:35 2022] GET /identity/v3/endpoints?service_id=f2756a044f244ece9a863b3a64c7edba&interface=public®ion_id=RegionOne => generated 194 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:36.135872 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f43fd8-cb25-4efb-8374-9b3b585bda45 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:36.140084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c33fa-45de-447a-9772-528d5e97e648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:36.140978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c33fa-45de-447a-9772-528d5e97e648 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.141434 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c33fa-45de-447a-9772-528d5e97e648 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.142911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c33fa-45de-447a-9772-528d5e97e648 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.143083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c33fa-45de-447a-9772-528d5e97e648 None admin] RBAC: Adding query filter params (interface=public, service_id=88781ddf0d5244b5807cbd00385b1e70, region_id=RegionOne) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:36.143568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c33fa-45de-447a-9772-528d5e97e648 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:36.145991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c33fa-45de-447a-9772-528d5e97e648 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:36.166088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 390/778] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Sep 7 15:57:35 2022] GET /identity/v3/endpoints?service_id=88781ddf0d5244b5807cbd00385b1e70&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:36.172311 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c33fa-45de-447a-9772-528d5e97e648 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:36.395638 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c33fa-45de-447a-9772-528d5e97e648 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:36.414882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f43fd8-cb25-4efb-8374-9b3b585bda45 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:36.435305 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6815f-9991-4446-969d-51632a4bab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:36.435938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6815f-9991-4446-969d-51632a4bab21 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.436222 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6815f-9991-4446-969d-51632a4bab21 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.436499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6815f-9991-4446-969d-51632a4bab21 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.437184 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6815f-9991-4446-969d-51632a4bab21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:36.438591 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6815f-9991-4446-969d-51632a4bab21 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:36.445081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 391/779] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Sep 7 15:57:36 2022] GET /identity/v3/services => generated 772 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:36.446575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca196669-118a-436c-93db-17a243239f54 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.446870 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca196669-118a-436c-93db-17a243239f54 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.447155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca196669-118a-436c-93db-17a243239f54 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.448958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 392/780] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:36.457630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46341-c93d-41f6-9ef5-6f20918dbe28 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.457927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46341-c93d-41f6-9ef5-6f20918dbe28 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.458241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46341-c93d-41f6-9ef5-6f20918dbe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.458802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce880d-d9ca-4185-b2b7-754cb9629bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:36.459616 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce880d-d9ca-4185-b2b7-754cb9629bab None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.460174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce880d-d9ca-4185-b2b7-754cb9629bab None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.460629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce880d-d9ca-4185-b2b7-754cb9629bab None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.461514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce880d-d9ca-4185-b2b7-754cb9629bab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:36.463106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce880d-d9ca-4185-b2b7-754cb9629bab None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:36.469929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 389/781] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Sep 7 15:57:36 2022] GET /identity/v3/services => generated 772 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:36.484842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-0ae46341-c93d-41f6-9ef5-6f20918dbe28 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:36.486815 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0ae46341-c93d-41f6-9ef5-6f20918dbe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:36.543176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:36.650634 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 393/782] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:37.122954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce880d-d9ca-4185-b2b7-754cb9629bab None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:37.127377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:37.290381 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce880d-d9ca-4185-b2b7-754cb9629bab None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:37.337314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea06e0-f354-4fcb-92d0-bb92e23c0625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:37.338351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea06e0-f354-4fcb-92d0-bb92e23c0625 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:37.338868 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea06e0-f354-4fcb-92d0-bb92e23c0625 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:37.339356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea06e0-f354-4fcb-92d0-bb92e23c0625 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:37.355765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea06e0-f354-4fcb-92d0-bb92e23c0625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-48ea06e0-f354-4fcb-92d0-bb92e23c0625 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:37.361460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:37.362424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:37.363274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:37.363274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:37.363274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:37.363274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:37.363274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:37.363274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:37.363274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:37.363274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:37.363274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:37.363274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:37.363274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:57:37.363274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:37.370202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 390/783] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:57:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:37.377040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae46341-c93d-41f6-9ef5-6f20918dbe28 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:37.542223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae46341-c93d-41f6-9ef5-6f20918dbe28 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:37.589951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333142-202a-47c3-89c5-de7bbccd6522 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:37.590972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333142-202a-47c3-89c5-de7bbccd6522 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:37.591590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333142-202a-47c3-89c5-de7bbccd6522 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:37.597875 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 391/784] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:37.607966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cb5eb-112e-4955-a72b-15546fe9a458 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:37.608602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cb5eb-112e-4955-a72b-15546fe9a458 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:37.609131 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cb5eb-112e-4955-a72b-15546fe9a458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:37.630020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178afac-b5c2-45e7-bd90-5e50176c41ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:37.631275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178afac-b5c2-45e7-bd90-5e50176c41ad None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:37.631809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178afac-b5c2-45e7-bd90-5e50176c41ad None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:37.632463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178afac-b5c2-45e7-bd90-5e50176c41ad None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:37.633635 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178afac-b5c2-45e7-bd90-5e50176c41ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:37.634351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178afac-b5c2-45e7-bd90-5e50176c41ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:37.636476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178afac-b5c2-45e7-bd90-5e50176c41ad None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:37.650265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-959cb5eb-112e-4955-a72b-15546fe9a458 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:37.651859 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-959cb5eb-112e-4955-a72b-15546fe9a458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:37.656661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 394/785] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:57:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:37.662916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178afac-b5c2-45e7-bd90-5e50176c41ad None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:37.712140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:37.777222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:37.800352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 392/786] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:37.856416 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178afac-b5c2-45e7-bd90-5e50176c41ad None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:37.918175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9feca65-d940-466f-bb40-901ec453cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:37.919552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feca65-d940-466f-bb40-901ec453cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:37.920042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feca65-d940-466f-bb40-901ec453cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:37.920327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feca65-d940-466f-bb40-901ec453cfc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:37.932794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9feca65-d940-466f-bb40-901ec453cfc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:37.935057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9feca65-d940-466f-bb40-901ec453cfc2 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-f9feca65-d940-466f-bb40-901ec453cfc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:37.954639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:37.955682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:37.956578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:37.956578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:37.956578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:37.956578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 395/787] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:37.963230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cb5eb-112e-4955-a72b-15546fe9a458 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:38.032954 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afafcc-45de-40dd-9b43-a49cb4999f1c None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:38.033340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afafcc-45de-40dd-9b43-a49cb4999f1c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:38.033624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afafcc-45de-40dd-9b43-a49cb4999f1c None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:38.035602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 396/788] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:38.049186 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49be0f-0cd2-401f-9e12-712e92745c0a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:38.049797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49be0f-0cd2-401f-9e12-712e92745c0a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:38.050319 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49be0f-0cd2-401f-9e12-712e92745c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:38.088366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-0c49be0f-0cd2-401f-9e12-712e92745c0a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:38.088366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0c49be0f-0cd2-401f-9e12-712e92745c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:38.128319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cb5eb-112e-4955-a72b-15546fe9a458 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:38.178661 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f461f-131e-4923-9840-60d2bfc80fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:38.179309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f461f-131e-4923-9840-60d2bfc80fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:38.179592 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f461f-131e-4923-9840-60d2bfc80fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:38.179906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f461f-131e-4923-9840-60d2bfc80fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:38.180662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f461f-131e-4923-9840-60d2bfc80fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:38.181051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f461f-131e-4923-9840-60d2bfc80fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:38.182555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f461f-131e-4923-9840-60d2bfc80fb2 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:38.196804 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 393/789] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:38.209074 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f461f-131e-4923-9840-60d2bfc80fb2 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:38.281813 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:38.287464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 397/790] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:38.288649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49be0f-0cd2-401f-9e12-712e92745c0a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:38.323542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:38.333336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f461f-131e-4923-9840-60d2bfc80fb2 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:38.371096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8336dc-fd63-4215-b1a3-4c2ae5b943fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:38.372173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8336dc-fd63-4215-b1a3-4c2ae5b943fb None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:38.372461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8336dc-fd63-4215-b1a3-4c2ae5b943fb None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:38.372743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8336dc-fd63-4215-b1a3-4c2ae5b943fb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:38.385667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8336dc-fd63-4215-b1a3-4c2ae5b943fb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:38.388325 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8336dc-fd63-4215-b1a3-4c2ae5b943fb None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-5e8336dc-fd63-4215-b1a3-4c2ae5b943fb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:38.401342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:38.403219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:38.405038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:38.405038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:38.405038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:38.405038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:38.405038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:38.405038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:38.405038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:38.405038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:38.405038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:57:38.405038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:38.405926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 394/791] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:57:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:38.411788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8336dc-fd63-4215-b1a3-4c2ae5b943fb None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:38.544422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8336dc-fd63-4215-b1a3-4c2ae5b943fb None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:38.554240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49be0f-0cd2-401f-9e12-712e92745c0a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:38.560087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:38.587644 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52f8a-5427-422b-803a-3cf256cbb4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:38.588741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52f8a-5427-422b-803a-3cf256cbb4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:38.589312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52f8a-5427-422b-803a-3cf256cbb4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:38.589860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52f8a-5427-422b-803a-3cf256cbb4e3 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:38.590930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d52f8a-5427-422b-803a-3cf256cbb4e3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:38.591542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d52f8a-5427-422b-803a-3cf256cbb4e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:38.593761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d52f8a-5427-422b-803a-3cf256cbb4e3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:38.620032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 395/792] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Sep 7 15:57:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:38.626609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52f8a-5427-422b-803a-3cf256cbb4e3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:38.653882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ce839-49fb-4b76-b556-58fdc544049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:38.654788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ce839-49fb-4b76-b556-58fdc544049d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:38.655074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ce839-49fb-4b76-b556-58fdc544049d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:38.655375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ce839-49fb-4b76-b556-58fdc544049d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:38.678475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ce839-49fb-4b76-b556-58fdc544049d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-ab5ce839-49fb-4b76-b556-58fdc544049d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:38.683317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:38.685066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:38.685932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:38.685932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:38.685932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:38.685932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:38.685932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:38.685932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:38.685932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:38.685932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:38.685932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:38.685932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:38.685932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:38.685932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:38.693497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 398/793] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:38.699752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ce839-49fb-4b76-b556-58fdc544049d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:38.787858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52f8a-5427-422b-803a-3cf256cbb4e3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:38.843962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbb62d-40d9-4d64-90d5-09998000d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:38.845446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbb62d-40d9-4d64-90d5-09998000d1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:38.846242 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbb62d-40d9-4d64-90d5-09998000d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:38.846992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbb62d-40d9-4d64-90d5-09998000d1c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:38.851972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:38.862690 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbb62d-40d9-4d64-90d5-09998000d1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:38.864567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbb62d-40d9-4d64-90d5-09998000d1c9 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-80cbb62d-40d9-4d64-90d5-09998000d1c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:38.882597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:38.883811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:38.884950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:38.884950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:38.884950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:38.886857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 396/794] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:38.888750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbb62d-40d9-4d64-90d5-09998000d1c9 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:38.889326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ce839-49fb-4b76-b556-58fdc544049d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:38.921998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:38.929285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52091b-b704-454b-b05b-0baf4cf0e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:38.930051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52091b-b704-454b-b05b-0baf4cf0e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:38.930342 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52091b-b704-454b-b05b-0baf4cf0e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:38.930719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52091b-b704-454b-b05b-0baf4cf0e6e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:38.931459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52091b-b704-454b-b05b-0baf4cf0e6e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:38.931777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52091b-b704-454b-b05b-0baf4cf0e6e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:38.933477 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52091b-b704-454b-b05b-0baf4cf0e6e6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:38.953091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 399/795] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:38.954481 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52091b-b704-454b-b05b-0baf4cf0e6e6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:39.012318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbb62d-40d9-4d64-90d5-09998000d1c9 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:39.054376 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c823488-54f1-4171-a179-b62f64a68c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:39.055276 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c823488-54f1-4171-a179-b62f64a68c7e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:39.055758 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c823488-54f1-4171-a179-b62f64a68c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:39.056339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c823488-54f1-4171-a179-b62f64a68c7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:39.070219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c823488-54f1-4171-a179-b62f64a68c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-2c823488-54f1-4171-a179-b62f64a68c7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:39.076075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:39.077185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:39.078545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 397/796] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:57:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:39.080226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c823488-54f1-4171-a179-b62f64a68c7e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:39.097943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52091b-b704-454b-b05b-0baf4cf0e6e6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:39.133126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:39.140415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5421a70-4e79-4251-a26c-ba270af4e73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:39.141196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5421a70-4e79-4251-a26c-ba270af4e73f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:39.144714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5421a70-4e79-4251-a26c-ba270af4e73f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:39.144714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5421a70-4e79-4251-a26c-ba270af4e73f None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:39.144714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5421a70-4e79-4251-a26c-ba270af4e73f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:39.144714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5421a70-4e79-4251-a26c-ba270af4e73f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:39.144714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5421a70-4e79-4251-a26c-ba270af4e73f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:39.160040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 400/797] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:39.160954 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5421a70-4e79-4251-a26c-ba270af4e73f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:39.218662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:39.255411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c823488-54f1-4171-a179-b62f64a68c7e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:39.310837 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5421a70-4e79-4251-a26c-ba270af4e73f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:39.314975 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be4a5b-24c7-4334-8a07-9618c1f303b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:39.315908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be4a5b-24c7-4334-8a07-9618c1f303b7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:39.316354 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be4a5b-24c7-4334-8a07-9618c1f303b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:39.316885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be4a5b-24c7-4334-8a07-9618c1f303b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:39.330742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be4a5b-24c7-4334-8a07-9618c1f303b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:39.333403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be4a5b-24c7-4334-8a07-9618c1f303b7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:39.354966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23346cb-ac32-42d7-ae7c-18fba8cc48b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:39.356362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23346cb-ac32-42d7-ae7c-18fba8cc48b3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:39.357046 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23346cb-ac32-42d7-ae7c-18fba8cc48b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:39.357769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23346cb-ac32-42d7-ae7c-18fba8cc48b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:39.358800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23346cb-ac32-42d7-ae7c-18fba8cc48b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-f2be4a5b-24c7-4334-8a07-9618c1f303b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:39.359339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:39.360327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:39.361267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:39.361267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:39.361267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:39.361528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23346cb-ac32-42d7-ae7c-18fba8cc48b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:39.363223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23346cb-ac32-42d7-ae7c-18fba8cc48b3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:39.367472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 398/798] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:39.368907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be4a5b-24c7-4334-8a07-9618c1f303b7 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:39.380270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 401/799] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:39.381617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23346cb-ac32-42d7-ae7c-18fba8cc48b3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:39.471213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:39.532007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be4a5b-24c7-4334-8a07-9618c1f303b7 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:39.546531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23346cb-ac32-42d7-ae7c-18fba8cc48b3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:39.588007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff96097-42db-4486-8e67-b08c3cf184eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:39.588973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff96097-42db-4486-8e67-b08c3cf184eb None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:39.589403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff96097-42db-4486-8e67-b08c3cf184eb None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:39.589692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff96097-42db-4486-8e67-b08c3cf184eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:39.593775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:39.600033 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff96097-42db-4486-8e67-b08c3cf184eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:39.601571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff96097-42db-4486-8e67-b08c3cf184eb None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:39.605523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00967122-4ba6-4678-99e1-8e720f3c6151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:39.606762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00967122-4ba6-4678-99e1-8e720f3c6151 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:39.607266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00967122-4ba6-4678-99e1-8e720f3c6151 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:39.607682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00967122-4ba6-4678-99e1-8e720f3c6151 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:39.608619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00967122-4ba6-4678-99e1-8e720f3c6151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:39.609100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00967122-4ba6-4678-99e1-8e720f3c6151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:39.611343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00967122-4ba6-4678-99e1-8e720f3c6151 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-5ff96097-42db-4486-8e67-b08c3cf184eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:39.615047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:39.616254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:39.617339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:39.617339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:39.617339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:39.617339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:39.617339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:39.617339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:39.617339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:39.617339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:39.617339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 399/800] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:39.617339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff96097-42db-4486-8e67-b08c3cf184eb None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:39.637362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 402/801] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:39.638663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd59677-5f1b-4237-b594-c7b816f82c37 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:39.638996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd59677-5f1b-4237-b594-c7b816f82c37 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:39.639321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd59677-5f1b-4237-b594-c7b816f82c37 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:39.641333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 403/802] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:39.642177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd59677-5f1b-4237-b594-c7b816f82c37 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:39.799596 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff96097-42db-4486-8e67-b08c3cf184eb None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:39.844025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd59677-5f1b-4237-b594-c7b816f82c37 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:39.855742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf83fd5-9a10-470f-b628-aec280074789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:39.856834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83fd5-9a10-470f-b628-aec280074789 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:39.857484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83fd5-9a10-470f-b628-aec280074789 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:39.857906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83fd5-9a10-470f-b628-aec280074789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:39.860225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:39.876700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf83fd5-9a10-470f-b628-aec280074789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:39.879034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf83fd5-9a10-470f-b628-aec280074789 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:39.883320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa610678-4f3d-4269-826d-f9f37b265bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:39.883940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa610678-4f3d-4269-826d-f9f37b265bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:39.884250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa610678-4f3d-4269-826d-f9f37b265bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:39.884521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa610678-4f3d-4269-826d-f9f37b265bb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:39.885259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa610678-4f3d-4269-826d-f9f37b265bb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:39.885565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa610678-4f3d-4269-826d-f9f37b265bb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:39.887161 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa610678-4f3d-4269-826d-f9f37b265bb3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:39.902880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 404/803] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-ebf83fd5-9a10-470f-b628-aec280074789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:39.903089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:39.903991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:39.904946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:39.904946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:39.904946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:39.905147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa610678-4f3d-4269-826d-f9f37b265bb3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:39.905228 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 400/804] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:39.906014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47096ca6-d724-4db4-9f53-acaa4390b2d4 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:39.906505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47096ca6-d724-4db4-9f53-acaa4390b2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:39.906830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47096ca6-d724-4db4-9f53-acaa4390b2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:39.927920 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-47096ca6-d724-4db4-9f53-acaa4390b2d4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:39.929248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-47096ca6-d724-4db4-9f53-acaa4390b2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:40.005903 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:40.041938 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 401/805] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:40.043091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5c632-3d25-4a91-8c55-7183631d1370 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.044073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5c632-3d25-4a91-8c55-7183631d1370 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.044362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5c632-3d25-4a91-8c55-7183631d1370 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.045921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 402/806] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:40.046626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5c632-3d25-4a91-8c55-7183631d1370 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.051587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa610678-4f3d-4269-826d-f9f37b265bb3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.116602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86cd4c-2fab-4682-98d2-b9d2fc96d524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.119302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86cd4c-2fab-4682-98d2-b9d2fc96d524 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.119834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86cd4c-2fab-4682-98d2-b9d2fc96d524 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.120252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86cd4c-2fab-4682-98d2-b9d2fc96d524 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.129691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86cd4c-2fab-4682-98d2-b9d2fc96d524 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.131174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86cd4c-2fab-4682-98d2-b9d2fc96d524 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-cc86cd4c-2fab-4682-98d2-b9d2fc96d524 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:40.146545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:40.147588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:40.148601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:40.148601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:40.148601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:40.148601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:40.148601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:40.148601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:40.148601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:40.148601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:40.148601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:57:40.148601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:40.148601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 405/807] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Sep 7 15:57:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:40.148601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86cd4c-2fab-4682-98d2-b9d2fc96d524 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.191176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:40.210127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5c632-3d25-4a91-8c55-7183631d1370 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.261521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68922f9e-a78d-452a-a143-92113a01844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.262838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68922f9e-a78d-452a-a143-92113a01844c None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.263101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68922f9e-a78d-452a-a143-92113a01844c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.263366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68922f9e-a78d-452a-a143-92113a01844c None admin] PATH_INFO: `/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/d853bab10d9d4060809476bfc44d3822/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.265432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68922f9e-a78d-452a-a143-92113a01844c None admin] RBAC: Authorizing `identity:create_grant(project_id=983beac5fc784756b6bdf11b07e219ac, user_id=d853bab10d9d4060809476bfc44d3822, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.267136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68922f9e-a78d-452a-a143-92113a01844c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.282250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86cd4c-2fab-4682-98d2-b9d2fc96d524 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.291830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 403/808] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:57:40 2022] PUT /identity/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/d853bab10d9d4060809476bfc44d3822/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:40.291830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744d035-a015-40fb-a9c9-47470046b003 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.291830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744d035-a015-40fb-a9c9-47470046b003 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.291830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744d035-a015-40fb-a9c9-47470046b003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.311601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7744d035-a015-40fb-a9c9-47470046b003 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:40.313807 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7744d035-a015-40fb-a9c9-47470046b003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:40.349084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69534c-1f4c-47f8-99c2-7277ccb67b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.349811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69534c-1f4c-47f8-99c2-7277ccb67b05 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.350361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69534c-1f4c-47f8-99c2-7277ccb67b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.350906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69534c-1f4c-47f8-99c2-7277ccb67b05 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.351864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69534c-1f4c-47f8-99c2-7277ccb67b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:40.352267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69534c-1f4c-47f8-99c2-7277ccb67b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.354544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69534c-1f4c-47f8-99c2-7277ccb67b05 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.373248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 406/809] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:40.374536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69534c-1f4c-47f8-99c2-7277ccb67b05 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.380787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:40.456717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 404/810] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:40.456717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744d035-a015-40fb-a9c9-47470046b003 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.546302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:40.555690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69534c-1f4c-47f8-99c2-7277ccb67b05 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.606921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b95800-3909-4675-bb84-b7cb9b31dc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.607669 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b95800-3909-4675-bb84-b7cb9b31dc3f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.608023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b95800-3909-4675-bb84-b7cb9b31dc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.608320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b95800-3909-4675-bb84-b7cb9b31dc3f None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.610063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b95800-3909-4675-bb84-b7cb9b31dc3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:40.610194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b95800-3909-4675-bb84-b7cb9b31dc3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.612437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b95800-3909-4675-bb84-b7cb9b31dc3f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.637894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 407/811] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Sep 7 15:57:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:40.644327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b95800-3909-4675-bb84-b7cb9b31dc3f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.648417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744d035-a015-40fb-a9c9-47470046b003 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.704836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020a2fa-3f6a-48da-a208-4f9c4d40b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.706432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020a2fa-3f6a-48da-a208-4f9c4d40b592 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.707167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020a2fa-3f6a-48da-a208-4f9c4d40b592 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.707924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020a2fa-3f6a-48da-a208-4f9c4d40b592 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.709227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020a2fa-3f6a-48da-a208-4f9c4d40b592 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.711882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020a2fa-3f6a-48da-a208-4f9c4d40b592 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-0020a2fa-3f6a-48da-a208-4f9c4d40b592 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:40.728151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:40.730177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:57:40.733531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:40.737692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 405/812] 10.222.0.43 () {56 vars in 1129 bytes} [Wed Sep 7 15:57:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:40.738909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020a2fa-3f6a-48da-a208-4f9c4d40b592 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.763063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b95800-3909-4675-bb84-b7cb9b31dc3f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.792455 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:40.805152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d9c07-695d-4575-aacb-2e02926bc51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.806085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d9c07-695d-4575-aacb-2e02926bc51f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.806511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d9c07-695d-4575-aacb-2e02926bc51f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.806929 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d9c07-695d-4575-aacb-2e02926bc51f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.816336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d9c07-695d-4575-aacb-2e02926bc51f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.818171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d9c07-695d-4575-aacb-2e02926bc51f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-408d9c07-695d-4575-aacb-2e02926bc51f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:40.831860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:40.833401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:40.834525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:40.834525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:40.834525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:40.834525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:40.834525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:40.834525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:40.834525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:40.834525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:40.834525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:57:40.834525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:40.836909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 408/813] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Sep 7 15:57:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:40.837939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d9c07-695d-4575-aacb-2e02926bc51f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.856777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:40.921326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020a2fa-3f6a-48da-a208-4f9c4d40b592 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.962577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d9c07-695d-4575-aacb-2e02926bc51f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.974478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb9dfc-0199-46dc-93b3-6ebbb8d853f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.975743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb9dfc-0199-46dc-93b3-6ebbb8d853f8 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.976154 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb9dfc-0199-46dc-93b3-6ebbb8d853f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.976494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb9dfc-0199-46dc-93b3-6ebbb8d853f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.998815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb9dfc-0199-46dc-93b3-6ebbb8d853f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.000500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb9dfc-0199-46dc-93b3-6ebbb8d853f8 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-0cdb9dfc-0199-46dc-93b3-6ebbb8d853f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:41.029149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:41.030212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:41.031151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:41.031151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:41.031151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:41.031851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f96b30-0a7d-45ef-aba3-90789698b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.031851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f96b30-0a7d-45ef-aba3-90789698b61a None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.031851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f96b30-0a7d-45ef-aba3-90789698b61a None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.031851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f96b30-0a7d-45ef-aba3-90789698b61a None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.032164 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f96b30-0a7d-45ef-aba3-90789698b61a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:41.032164 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f96b30-0a7d-45ef-aba3-90789698b61a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.032749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f96b30-0a7d-45ef-aba3-90789698b61a None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.034514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 406/814] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:41.035712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb9dfc-0199-46dc-93b3-6ebbb8d853f8 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.049477 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 409/815] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Sep 7 15:57:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:41.050970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f96b30-0a7d-45ef-aba3-90789698b61a None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.173197 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:41.178920 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:41.212751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb9dfc-0199-46dc-93b3-6ebbb8d853f8 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.220586 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f96b30-0a7d-45ef-aba3-90789698b61a None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.279113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60749496-5afe-49c9-805e-408f70e49ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.280074 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60749496-5afe-49c9-805e-408f70e49ddf None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.280510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60749496-5afe-49c9-805e-408f70e49ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.280967 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60749496-5afe-49c9-805e-408f70e49ddf None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.281912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60749496-5afe-49c9-805e-408f70e49ddf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:41.282376 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60749496-5afe-49c9-805e-408f70e49ddf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.284261 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60749496-5afe-49c9-805e-408f70e49ddf None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.290352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57a279-6e7b-43f0-9632-38b256512620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.291414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57a279-6e7b-43f0-9632-38b256512620 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.291788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57a279-6e7b-43f0-9632-38b256512620 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.292155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57a279-6e7b-43f0-9632-38b256512620 None admin] PATH_INFO: `/v3/services/network` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.293350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57a279-6e7b-43f0-9632-38b256512620 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.296005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57a279-6e7b-43f0-9632-38b256512620 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.316667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 407/816] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Sep 7 15:57:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-9e57a279-6e7b-43f0-9632-38b256512620 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:41.316886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:41.317830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:57:41.318672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:41.319407 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60749496-5afe-49c9-805e-408f70e49ddf None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.319483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 410/817] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:41 2022] GET /identity/v3/services/network => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:41.319483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57a279-6e7b-43f0-9632-38b256512620 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.481870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60749496-5afe-49c9-805e-408f70e49ddf None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.483588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57a279-6e7b-43f0-9632-38b256512620 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.523401 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f1b3-bf26-446b-8405-809a784f2593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.524032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f1b3-bf26-446b-8405-809a784f2593 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.524363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f1b3-bf26-446b-8405-809a784f2593 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.524669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f1b3-bf26-446b-8405-809a784f2593 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.525401 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194f1b3-bf26-446b-8405-809a784f2593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:41.525715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194f1b3-bf26-446b-8405-809a784f2593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.527130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194f1b3-bf26-446b-8405-809a784f2593 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.538321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:41.544737 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 408/818] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:41.545720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f1b3-bf26-446b-8405-809a784f2593 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.554910 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6fd5-5100-47dc-a7b6-55d67a7a35a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.555664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6fd5-5100-47dc-a7b6-55d67a7a35a1 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.555948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6fd5-5100-47dc-a7b6-55d67a7a35a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.556221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6fd5-5100-47dc-a7b6-55d67a7a35a1 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.556900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a6fd5-5100-47dc-a7b6-55d67a7a35a1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:41.557202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a6fd5-5100-47dc-a7b6-55d67a7a35a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.558588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a6fd5-5100-47dc-a7b6-55d67a7a35a1 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.568956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 411/819] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Sep 7 15:57:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:41.570756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6fd5-5100-47dc-a7b6-55d67a7a35a1 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.576946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:41.709976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f1b3-bf26-446b-8405-809a784f2593 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.711327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6fd5-5100-47dc-a7b6-55d67a7a35a1 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.772950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f093e41-fdb2-46e2-b942-ec6f5919263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.773458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f093e41-fdb2-46e2-b942-ec6f5919263d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.773790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f093e41-fdb2-46e2-b942-ec6f5919263d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.774066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f093e41-fdb2-46e2-b942-ec6f5919263d None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.774753 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f093e41-fdb2-46e2-b942-ec6f5919263d None admin] RBAC: Adding query filter params (name=network) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:41.775059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f093e41-fdb2-46e2-b942-ec6f5919263d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.776460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f093e41-fdb2-46e2-b942-ec6f5919263d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.780210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae923cb2-cb6b-4f3f-b20e-6f3e301c5f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.781158 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae923cb2-cb6b-4f3f-b20e-6f3e301c5f3e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.781577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae923cb2-cb6b-4f3f-b20e-6f3e301c5f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.781985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae923cb2-cb6b-4f3f-b20e-6f3e301c5f3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.782676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 412/820] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:57:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:41.788028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f093e41-fdb2-46e2-b942-ec6f5919263d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.882557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:41.894156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:41.896091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae923cb2-cb6b-4f3f-b20e-6f3e301c5f3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.898635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae923cb2-cb6b-4f3f-b20e-6f3e301c5f3e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.933548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f093e41-fdb2-46e2-b942-ec6f5919263d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.988491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c7907-7459-46ac-95c8-fdc908400b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.989204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c7907-7459-46ac-95c8-fdc908400b28 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.989484 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c7907-7459-46ac-95c8-fdc908400b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.992724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c7907-7459-46ac-95c8-fdc908400b28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.003466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c7907-7459-46ac-95c8-fdc908400b28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:42.005186 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c7907-7459-46ac-95c8-fdc908400b28 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-445c7907-7459-46ac-95c8-fdc908400b28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:42.028582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:42.030126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:42.031360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:42.031360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:42.031360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:42.031360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:42.031360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:42.031360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:42.031360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:42.031360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:42.033808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 413/821] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:42.033808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c7907-7459-46ac-95c8-fdc908400b28 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:42.071250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 409/822] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:57:42.071250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae923cb2-cb6b-4f3f-b20e-6f3e301c5f3e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:42.207364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c7907-7459-46ac-95c8-fdc908400b28 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:42.216588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:42.221657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae923cb2-cb6b-4f3f-b20e-6f3e301c5f3e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:42.253829 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:42.273760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece2f3-9ce0-4f63-9308-bf1529a47c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:42.274636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece2f3-9ce0-4f63-9308-bf1529a47c91 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.275345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece2f3-9ce0-4f63-9308-bf1529a47c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.275849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece2f3-9ce0-4f63-9308-bf1529a47c91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.276992 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece2f3-9ce0-4f63-9308-bf1529a47c91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:42.279696 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece2f3-9ce0-4f63-9308-bf1529a47c91 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:42.290842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025c79c-580c-40a1-bccd-0a089a061eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:42.291740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025c79c-580c-40a1-bccd-0a089a061eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.292159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025c79c-580c-40a1-bccd-0a089a061eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.292576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025c79c-580c-40a1-bccd-0a089a061eb2 None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.293651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025c79c-580c-40a1-bccd-0a089a061eb2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:42.294116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025c79c-580c-40a1-bccd-0a089a061eb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:42.296408 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025c79c-580c-40a1-bccd-0a089a061eb2 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:42.309469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 414/823] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:42.310526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 410/824] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:57:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:42.311023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece2f3-9ce0-4f63-9308-bf1529a47c91 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:42.311587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025c79c-580c-40a1-bccd-0a089a061eb2 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:42.470431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025c79c-580c-40a1-bccd-0a089a061eb2 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:42.489546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece2f3-9ce0-4f63-9308-bf1529a47c91 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:42.516799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed57c4-2018-4355-943f-956289706976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:42.517663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed57c4-2018-4355-943f-956289706976 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.517878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed57c4-2018-4355-943f-956289706976 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.518230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed57c4-2018-4355-943f-956289706976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.530891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed57c4-2018-4355-943f-956289706976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:42.532291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed57c4-2018-4355-943f-956289706976 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:42.537460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d77abc-3d4f-464d-823b-bc8498a1fbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:42.538133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d77abc-3d4f-464d-823b-bc8498a1fbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.538622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d77abc-3d4f-464d-823b-bc8498a1fbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.538993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d77abc-3d4f-464d-823b-bc8498a1fbb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.539769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d77abc-3d4f-464d-823b-bc8498a1fbb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:42.540078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d77abc-3d4f-464d-823b-bc8498a1fbb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:42.542039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d77abc-3d4f-464d-823b-bc8498a1fbb9 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-5fed57c4-2018-4355-943f-956289706976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:42.549171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:42.550185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:42.551113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:42.551113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:42.551113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:42.551113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 411/825] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:42.551353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed57c4-2018-4355-943f-956289706976 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:42.568728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 415/826] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:42.569850 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d77abc-3d4f-464d-823b-bc8498a1fbb9 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:42.572734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:42.644132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:42.718463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed57c4-2018-4355-943f-956289706976 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:42.743625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d77abc-3d4f-464d-823b-bc8498a1fbb9 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:42.764335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274a9c1-097b-4e04-a3d6-b23dfdc57f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:42.765562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274a9c1-097b-4e04-a3d6-b23dfdc57f79 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.766021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274a9c1-097b-4e04-a3d6-b23dfdc57f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.766574 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274a9c1-097b-4e04-a3d6-b23dfdc57f79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.767972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274a9c1-097b-4e04-a3d6-b23dfdc57f79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:42.770873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274a9c1-097b-4e04-a3d6-b23dfdc57f79 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:42.810418 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 412/827] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:42.812614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274a9c1-097b-4e04-a3d6-b23dfdc57f79 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:42.823106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325130b5-4e7b-4457-ab40-fcf446ecc8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:42.824135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325130b5-4e7b-4457-ab40-fcf446ecc8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.825255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325130b5-4e7b-4457-ab40-fcf446ecc8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.825720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325130b5-4e7b-4457-ab40-fcf446ecc8c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.826511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325130b5-4e7b-4457-ab40-fcf446ecc8c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:42.827050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325130b5-4e7b-4457-ab40-fcf446ecc8c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:42.829307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325130b5-4e7b-4457-ab40-fcf446ecc8c4 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:42.867453 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 416/828] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:42.869014 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6ebe8-f582-4623-978e-7c9b4f4026cd None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.869313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6ebe8-f582-4623-978e-7c9b4f4026cd None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.869578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6ebe8-f582-4623-978e-7c9b4f4026cd None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.876248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 417/829] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:42.877456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6ebe8-f582-4623-978e-7c9b4f4026cd None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:42.945097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:42.989585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274a9c1-097b-4e04-a3d6-b23dfdc57f79 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.049414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57c734-f132-47a8-917b-12ca5e38922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.050414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57c734-f132-47a8-917b-12ca5e38922e None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.051123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57c734-f132-47a8-917b-12ca5e38922e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.051666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57c734-f132-47a8-917b-12ca5e38922e None admin] PATH_INFO: `/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/c0fa7d339c134c20b471170e13bbb9de/roles/aa755d19c52f4e299b98898217cbc688` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.068106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:43.081535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6ebe8-f582-4623-978e-7c9b4f4026cd None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.083549 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57c734-f132-47a8-917b-12ca5e38922e None admin] RBAC: Authorizing `identity:create_grant(project_id=983beac5fc784756b6bdf11b07e219ac, user_id=c0fa7d339c134c20b471170e13bbb9de, role_id=aa755d19c52f4e299b98898217cbc688)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:43.085308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57c734-f132-47a8-917b-12ca5e38922e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:43.105212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 413/830] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:57:42 2022] PUT /identity/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/c0fa7d339c134c20b471170e13bbb9de/roles/aa755d19c52f4e299b98898217cbc688 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:43.106437 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2975c86-23a7-478e-b1ea-9b6c3ed5e752 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.108653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2975c86-23a7-478e-b1ea-9b6c3ed5e752 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.108653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2975c86-23a7-478e-b1ea-9b6c3ed5e752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.131291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-c2975c86-23a7-478e-b1ea-9b6c3ed5e752 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:43.132587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c2975c86-23a7-478e-b1ea-9b6c3ed5e752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:43.133509 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea827434-a43b-4ace-9840-8eae742bd888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.134159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea827434-a43b-4ace-9840-8eae742bd888 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.134437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea827434-a43b-4ace-9840-8eae742bd888 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.134708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea827434-a43b-4ace-9840-8eae742bd888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.143925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea827434-a43b-4ace-9840-8eae742bd888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:43.145483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea827434-a43b-4ace-9840-8eae742bd888 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-ea827434-a43b-4ace-9840-8eae742bd888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:43.159626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:43.160756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:43.161792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:43.161792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:43.161792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:43.161792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:43.161792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:43.161792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:43.161792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:43.161792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:43.161792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 418/831] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:43.167962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea827434-a43b-4ace-9840-8eae742bd888 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:43.244636 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 414/832] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:43.328282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea827434-a43b-4ace-9840-8eae742bd888 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.382960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f41a7-157c-4271-9c63-8513b27277e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.383343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f41a7-157c-4271-9c63-8513b27277e3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.383665 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f41a7-157c-4271-9c63-8513b27277e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.384242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f41a7-157c-4271-9c63-8513b27277e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.384947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f41a7-157c-4271-9c63-8513b27277e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:43.385184 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f41a7-157c-4271-9c63-8513b27277e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:43.386990 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f41a7-157c-4271-9c63-8513b27277e3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:43.405656 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 419/833] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:43.414005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2975c86-23a7-478e-b1ea-9b6c3ed5e752 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:43.496123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:43.563395 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2975c86-23a7-478e-b1ea-9b6c3ed5e752 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.604583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc8123-8c76-442b-81d1-73301b6973c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.605692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc8123-8c76-442b-81d1-73301b6973c6 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.606660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc8123-8c76-442b-81d1-73301b6973c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.607133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc8123-8c76-442b-81d1-73301b6973c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.608282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc8123-8c76-442b-81d1-73301b6973c6 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=9d71c0688ea84c05af925f3fb08f35ad) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:43.608944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc8123-8c76-442b-81d1-73301b6973c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:43.610901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc8123-8c76-442b-81d1-73301b6973c6 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:43.618734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 415/834] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:43 2022] GET /identity/v3/role_assignments?user.id=9d71c0688ea84c05af925f3fb08f35ad&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:43.669031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f41a7-157c-4271-9c63-8513b27277e3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:43.700587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:43.832311 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f41a7-157c-4271-9c63-8513b27277e3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.876053 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75081492-a1bd-4471-9361-02cc91c7b020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.876720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75081492-a1bd-4471-9361-02cc91c7b020 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.877034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75081492-a1bd-4471-9361-02cc91c7b020 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.877333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75081492-a1bd-4471-9361-02cc91c7b020 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.891811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75081492-a1bd-4471-9361-02cc91c7b020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-75081492-a1bd-4471-9361-02cc91c7b020 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:43.897281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:43.898199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:43.899040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 420/835] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:43.905947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc8123-8c76-442b-81d1-73301b6973c6 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:44.037475 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc8123-8c76-442b-81d1-73301b6973c6 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:44.061978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:44.099129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21c5cc-9c75-4875-88d4-79d20a6f9110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:44.099749 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21c5cc-9c75-4875-88d4-79d20a6f9110 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:44.100024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21c5cc-9c75-4875-88d4-79d20a6f9110 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:44.100293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21c5cc-9c75-4875-88d4-79d20a6f9110 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:44.100992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21c5cc-9c75-4875-88d4-79d20a6f9110 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:44.101289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21c5cc-9c75-4875-88d4-79d20a6f9110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:44.102640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21c5cc-9c75-4875-88d4-79d20a6f9110 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:44.113516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 416/836] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:44.122060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75081492-a1bd-4471-9361-02cc91c7b020 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:44.236732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:44.270137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75081492-a1bd-4471-9361-02cc91c7b020 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:44.308208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61ec2-4b50-4234-b312-4c35e535515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:44.309495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61ec2-4b50-4234-b312-4c35e535515f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:44.309918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61ec2-4b50-4234-b312-4c35e535515f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:44.310287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61ec2-4b50-4234-b312-4c35e535515f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:44.322860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e61ec2-4b50-4234-b312-4c35e535515f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:44.324427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e61ec2-4b50-4234-b312-4c35e535515f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-55e61ec2-4b50-4234-b312-4c35e535515f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:44.341644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:44.344004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:44.346132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:44.346132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:44.346132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:44.346132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 421/837] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:44.350229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21c5cc-9c75-4875-88d4-79d20a6f9110 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:44.475634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21c5cc-9c75-4875-88d4-79d20a6f9110 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:44.513624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9cb1-1a49-4a52-808a-0837e3a0a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:44.514254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9cb1-1a49-4a52-808a-0837e3a0a47c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:44.514524 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9cb1-1a49-4a52-808a-0837e3a0a47c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:44.514799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9cb1-1a49-4a52-808a-0837e3a0a47c None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:44.515446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a9cb1-1a49-4a52-808a-0837e3a0a47c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:44.515750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a9cb1-1a49-4a52-808a-0837e3a0a47c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:44.517158 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a9cb1-1a49-4a52-808a-0837e3a0a47c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:44.530959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 417/838] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:44.538440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61ec2-4b50-4234-b312-4c35e535515f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:44.654427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61ec2-4b50-4234-b312-4c35e535515f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:44.689657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:44.702018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0d0c8-8077-4ed3-a56f-eef6dfcba08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:44.702848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0d0c8-8077-4ed3-a56f-eef6dfcba08b None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:44.703210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0d0c8-8077-4ed3-a56f-eef6dfcba08b None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:44.703537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0d0c8-8077-4ed3-a56f-eef6dfcba08b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:44.712534 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0d0c8-8077-4ed3-a56f-eef6dfcba08b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:44.714230 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0d0c8-8077-4ed3-a56f-eef6dfcba08b None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-fbb0d0c8-8077-4ed3-a56f-eef6dfcba08b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:44.727314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:44.729279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:44.731047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:44.731047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:44.731047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:44.731047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:44.731047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:44.731047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:44.731047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:44.731047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:44.731047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:57:44.731047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:44.731047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 422/839] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:57:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:44.738271 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9cb1-1a49-4a52-808a-0837e3a0a47c None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:44.803266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:44.887984 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9cb1-1a49-4a52-808a-0837e3a0a47c None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:44.927709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed9c31-bb97-4091-8056-c3f54f179ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:44.928327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed9c31-bb97-4091-8056-c3f54f179ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:44.928606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed9c31-bb97-4091-8056-c3f54f179ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:44.929010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed9c31-bb97-4091-8056-c3f54f179ac1 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:44.929647 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed9c31-bb97-4091-8056-c3f54f179ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:44.929959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed9c31-bb97-4091-8056-c3f54f179ac1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:44.931392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed9c31-bb97-4091-8056-c3f54f179ac1 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:44.960065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 418/840] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Sep 7 15:57:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:44.970289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0d0c8-8077-4ed3-a56f-eef6dfcba08b None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:44.975338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9350a-e8e9-48d2-bb91-2aba871b7aea None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:44.975338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9350a-e8e9-48d2-bb91-2aba871b7aea None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:44.975338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9350a-e8e9-48d2-bb91-2aba871b7aea None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:44.975338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 419/841] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:57:44.984943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834015d-b05b-4b06-8002-1ecc9e7af4a5 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:44.984943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834015d-b05b-4b06-8002-1ecc9e7af4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:44.984943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834015d-b05b-4b06-8002-1ecc9e7af4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.007881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f834015d-b05b-4b06-8002-1ecc9e7af4a5 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:45.009526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f834015d-b05b-4b06-8002-1ecc9e7af4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:45.124883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0d0c8-8077-4ed3-a56f-eef6dfcba08b None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:45.132628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 420/842] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:57:45.176021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbee30-89e5-4d76-9e10-14bbadddfee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:45.176650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbee30-89e5-4d76-9e10-14bbadddfee8 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.176958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbee30-89e5-4d76-9e10-14bbadddfee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.177236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbee30-89e5-4d76-9e10-14bbadddfee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.253140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:45.277021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbee30-89e5-4d76-9e10-14bbadddfee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:45.279518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbee30-89e5-4d76-9e10-14bbadddfee8 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:45.399953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 423/843] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:57:45.405698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834015d-b05b-4b06-8002-1ecc9e7af4a5 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.438032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:45.438219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbee30-89e5-4d76-9e10-14bbadddfee8 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.532222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834015d-b05b-4b06-8002-1ecc9e7af4a5 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:45.558122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:45.573193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbee30-89e5-4d76-9e10-14bbadddfee8 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:45.594937 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54632983-401c-4072-8db4-0aeb77b0d700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:45.595590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54632983-401c-4072-8db4-0aeb77b0d700 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.595873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54632983-401c-4072-8db4-0aeb77b0d700 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.596148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54632983-401c-4072-8db4-0aeb77b0d700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.613523 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54632983-401c-4072-8db4-0aeb77b0d700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:45.615558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54632983-401c-4072-8db4-0aeb77b0d700 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:45.616748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e336c97-f22d-4b90-b028-12922c60399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:45.617772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e336c97-f22d-4b90-b028-12922c60399f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.618344 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e336c97-f22d-4b90-b028-12922c60399f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.618813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e336c97-f22d-4b90-b028-12922c60399f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.619600 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e336c97-f22d-4b90-b028-12922c60399f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:45.621295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e336c97-f22d-4b90-b028-12922c60399f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-7e336c97-f22d-4b90-b028-12922c60399f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:45.631208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:45.632259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:57:45.633132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-54632983-401c-4072-8db4-0aeb77b0d700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:45.633879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:45.634750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:45.635646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:45.635646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:45.635646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:45.642768 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 421/845] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:45.642925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 424/845] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:57:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:45.643028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54632983-401c-4072-8db4-0aeb77b0d700 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.645939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e336c97-f22d-4b90-b028-12922c60399f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.759450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:45.772499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e336c97-f22d-4b90-b028-12922c60399f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:45.791828 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54632983-401c-4072-8db4-0aeb77b0d700 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:45.828488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d55a3a-7f95-4fe4-a6d4-f137c866edd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:45.829166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d55a3a-7f95-4fe4-a6d4-f137c866edd0 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.829452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d55a3a-7f95-4fe4-a6d4-f137c866edd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.829728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d55a3a-7f95-4fe4-a6d4-f137c866edd0 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.830410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d55a3a-7f95-4fe4-a6d4-f137c866edd0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:45.830719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d55a3a-7f95-4fe4-a6d4-f137c866edd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:45.832926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d55a3a-7f95-4fe4-a6d4-f137c866edd0 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:45.844800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 425/846] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:57:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:45.846579 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d55a3a-7f95-4fe4-a6d4-f137c866edd0 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.849067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5527e-aae5-4490-9972-5106cb87a318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:45.850126 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5527e-aae5-4490-9972-5106cb87a318 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.850364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5527e-aae5-4490-9972-5106cb87a318 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.850816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5527e-aae5-4490-9972-5106cb87a318 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.852440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5527e-aae5-4490-9972-5106cb87a318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:45.852440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5527e-aae5-4490-9972-5106cb87a318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:45.854373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5527e-aae5-4490-9972-5106cb87a318 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:45.868901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:45.880020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 422/847] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:45.881322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5527e-aae5-4490-9972-5106cb87a318 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.964719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d55a3a-7f95-4fe4-a6d4-f137c866edd0 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:46.005164 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6f449-f3fc-4134-be18-e7cb0b91dafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:46.005768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f449-f3fc-4134-be18-e7cb0b91dafa None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:46.006052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f449-f3fc-4134-be18-e7cb0b91dafa None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:46.006328 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f449-f3fc-4134-be18-e7cb0b91dafa None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:46.006962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6f449-f3fc-4134-be18-e7cb0b91dafa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:46.007264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6f449-f3fc-4134-be18-e7cb0b91dafa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:46.009405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6f449-f3fc-4134-be18-e7cb0b91dafa None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:46.014962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 426/848] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:57:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:46.016564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107120a-5917-4b0d-ae54-72acf7dcf47d None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:46.017088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107120a-5917-4b0d-ae54-72acf7dcf47d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:46.017567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107120a-5917-4b0d-ae54-72acf7dcf47d None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:46.019831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 427/849] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:46.032735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51083f2-02d6-4436-9af8-f5c7c3c6d630 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:46.032735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51083f2-02d6-4436-9af8-f5c7c3c6d630 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:46.032735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51083f2-02d6-4436-9af8-f5c7c3c6d630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:46.039187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5527e-aae5-4490-9972-5106cb87a318 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:46.069238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e51083f2-02d6-4436-9af8-f5c7c3c6d630 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:46.071582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e51083f2-02d6-4436-9af8-f5c7c3c6d630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:46.078806 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b0a18-de6d-4738-8102-b9ddc14d9278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:46.079554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b0a18-de6d-4738-8102-b9ddc14d9278 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:46.079905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b0a18-de6d-4738-8102-b9ddc14d9278 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:46.080301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b0a18-de6d-4738-8102-b9ddc14d9278 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:46.088837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b0a18-de6d-4738-8102-b9ddc14d9278 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:46.091323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b0a18-de6d-4738-8102-b9ddc14d9278 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-eb3b0a18-de6d-4738-8102-b9ddc14d9278 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:46.104565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:46.107006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:46.109887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:46.109887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:46.109887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:46.109887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:46.109887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:46.109887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:46.109887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:46.109887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:46.109887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:46.109887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 423/850] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:46.118056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b0a18-de6d-4738-8102-b9ddc14d9278 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:46.200974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 428/851] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:57:46.221010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87583d6-b948-4068-8a77-564efc3d8468 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:46.221324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87583d6-b948-4068-8a77-564efc3d8468 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:46.221588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87583d6-b948-4068-8a77-564efc3d8468 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:46.227180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 429/852] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:57:46.228488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c767c-2b16-486b-a653-d5ea79b683a2 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:46.228801 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c767c-2b16-486b-a653-d5ea79b683a2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:46.229088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c767c-2b16-486b-a653-d5ea79b683a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:46.250966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-1a8c767c-2b16-486b-a653-d5ea79b683a2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:46.252723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1a8c767c-2b16-486b-a653-d5ea79b683a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:46.256945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:46.291037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b0a18-de6d-4738-8102-b9ddc14d9278 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:46.340717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f97dd0-4183-4c0f-86c6-72644dee0571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:46.342039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f97dd0-4183-4c0f-86c6-72644dee0571 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:46.342561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f97dd0-4183-4c0f-86c6-72644dee0571 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:46.343246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f97dd0-4183-4c0f-86c6-72644dee0571 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:46.344594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f97dd0-4183-4c0f-86c6-72644dee0571 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:46.345178 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f97dd0-4183-4c0f-86c6-72644dee0571 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:46.347457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f97dd0-4183-4c0f-86c6-72644dee0571 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:46.356720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 430/853] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:46.367376 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 424/854] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:46.373782 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c767c-2b16-486b-a653-d5ea79b683a2 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:46.491082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f97dd0-4183-4c0f-86c6-72644dee0571 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:46.497219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c767c-2b16-486b-a653-d5ea79b683a2 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:46.559437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf3400-6252-43bf-ae72-9913fa7de8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:46.560056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:46.560808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf3400-6252-43bf-ae72-9913fa7de8ca None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:46.561294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf3400-6252-43bf-ae72-9913fa7de8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:46.561879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf3400-6252-43bf-ae72-9913fa7de8ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:46.563444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf3400-6252-43bf-ae72-9913fa7de8ca None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=d853bab10d9d4060809476bfc44d3822) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:46.564591 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf3400-6252-43bf-ae72-9913fa7de8ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:46.567873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf3400-6252-43bf-ae72-9913fa7de8ca None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:46.580957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 431/855] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:46 2022] GET /identity/v3/role_assignments?user.id=d853bab10d9d4060809476bfc44d3822&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:46.622611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f97dd0-4183-4c0f-86c6-72644dee0571 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:46.670545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf3400-6252-43bf-ae72-9913fa7de8ca None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:46.674933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:46.689972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7c650-d48f-463d-992f-92ba3fb573ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:46.690965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7c650-d48f-463d-992f-92ba3fb573ae None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:46.691255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7c650-d48f-463d-992f-92ba3fb573ae None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:46.691612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7c650-d48f-463d-992f-92ba3fb573ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:46.712069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7c650-d48f-463d-992f-92ba3fb573ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-69e7c650-d48f-463d-992f-92ba3fb573ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:46.720119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:46.721329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:46.722189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 425/856] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 15:57:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:46.729720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7c650-d48f-463d-992f-92ba3fb573ae None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:46.809708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf3400-6252-43bf-ae72-9913fa7de8ca None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:46.855374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e424c-b13d-4b38-80d2-7517543db5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:46.856093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e424c-b13d-4b38-80d2-7517543db5ea None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:46.856373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e424c-b13d-4b38-80d2-7517543db5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:46.856782 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e424c-b13d-4b38-80d2-7517543db5ea None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:46.857388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e424c-b13d-4b38-80d2-7517543db5ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:46.858774 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e424c-b13d-4b38-80d2-7517543db5ea None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-ec8e424c-b13d-4b38-80d2-7517543db5ea None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:46.870493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:46.872266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:57:46.873352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:46.874094 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7c650-d48f-463d-992f-92ba3fb573ae None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:46.874168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 432/857] 10.222.0.43 () {56 vars in 1132 bytes} [Wed Sep 7 15:57:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:46.886240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e424c-b13d-4b38-80d2-7517543db5ea None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:46.894832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:46.914139 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaa205-9de1-4631-a8aa-c01e5b9393bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:46.914960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaa205-9de1-4631-a8aa-c01e5b9393bd None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:46.915300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaa205-9de1-4631-a8aa-c01e5b9393bd None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:46.915639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaa205-9de1-4631-a8aa-c01e5b9393bd None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:46.916448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaa205-9de1-4631-a8aa-c01e5b9393bd None admin] RBAC: Adding query filter params (name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:46.916768 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaa205-9de1-4631-a8aa-c01e5b9393bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:46.918232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaa205-9de1-4631-a8aa-c01e5b9393bd None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:46.927807 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 426/858] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 15:57:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:46.933523 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaa205-9de1-4631-a8aa-c01e5b9393bd None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:46.974781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:47.013364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e424c-b13d-4b38-80d2-7517543db5ea None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:47.048055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaa205-9de1-4631-a8aa-c01e5b9393bd None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:47.056355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08389a-7ef3-4f19-8170-2e90d41a233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:47.057228 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08389a-7ef3-4f19-8170-2e90d41a233a None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:47.057652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08389a-7ef3-4f19-8170-2e90d41a233a None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:47.058499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08389a-7ef3-4f19-8170-2e90d41a233a None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:47.060904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08389a-7ef3-4f19-8170-2e90d41a233a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:47.061512 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08389a-7ef3-4f19-8170-2e90d41a233a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:47.064235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08389a-7ef3-4f19-8170-2e90d41a233a None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:47.080475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 433/859] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Sep 7 15:57:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:47.082872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08389a-7ef3-4f19-8170-2e90d41a233a None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:47.095616 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4a79e-986e-4f86-9ae8-a30cf7eb375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:47.095974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a79e-986e-4f86-9ae8-a30cf7eb375e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:47.096253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a79e-986e-4f86-9ae8-a30cf7eb375e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:47.096525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a79e-986e-4f86-9ae8-a30cf7eb375e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:47.109106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4a79e-986e-4f86-9ae8-a30cf7eb375e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:47.110543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4a79e-986e-4f86-9ae8-a30cf7eb375e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-22f4a79e-986e-4f86-9ae8-a30cf7eb375e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:47.127311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:47.128314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:47.129304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:47.129304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:47.129304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:47.132999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 427/860] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:47.134225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4a79e-986e-4f86-9ae8-a30cf7eb375e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:47.169396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:47.221281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08389a-7ef3-4f19-8170-2e90d41a233a None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:47.261248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:47.266192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4a79e-986e-4f86-9ae8-a30cf7eb375e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:47.274800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c50c4e-7c28-40c1-abf5-ea6051a0e497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:47.276176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c50c4e-7c28-40c1-abf5-ea6051a0e497 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:47.276603 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c50c4e-7c28-40c1-abf5-ea6051a0e497 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:47.277052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c50c4e-7c28-40c1-abf5-ea6051a0e497 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:47.278875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c50c4e-7c28-40c1-abf5-ea6051a0e497 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:47.279449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c50c4e-7c28-40c1-abf5-ea6051a0e497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:47.281578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c50c4e-7c28-40c1-abf5-ea6051a0e497 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:47.293757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 434/861] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Sep 7 15:57:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:47.311939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2894c25-22df-426d-a9ad-f1ec8d2a616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:47.312703 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2894c25-22df-426d-a9ad-f1ec8d2a616e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:47.313170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2894c25-22df-426d-a9ad-f1ec8d2a616e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:47.313559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2894c25-22df-426d-a9ad-f1ec8d2a616e None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:47.314322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2894c25-22df-426d-a9ad-f1ec8d2a616e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:47.314814 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2894c25-22df-426d-a9ad-f1ec8d2a616e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:47.316393 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2894c25-22df-426d-a9ad-f1ec8d2a616e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:47.331514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 428/862] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:47.337385 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c50c4e-7c28-40c1-abf5-ea6051a0e497 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:47.458293 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c50c4e-7c28-40c1-abf5-ea6051a0e497 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:47.498113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe05b-c70f-43fd-8998-5c4be328f317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:47.498756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe05b-c70f-43fd-8998-5c4be328f317 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:47.499037 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe05b-c70f-43fd-8998-5c4be328f317 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:47.499309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe05b-c70f-43fd-8998-5c4be328f317 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:47.508282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe05b-c70f-43fd-8998-5c4be328f317 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:47.509765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe05b-c70f-43fd-8998-5c4be328f317 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-feabe05b-c70f-43fd-8998-5c4be328f317 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:47.523106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:47.524105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:47.525140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:47.525140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:47.525140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:47.525140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:47.525140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:47.525140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:47.525140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:47.525140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:47.525140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:57:47.525140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:47.525140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 435/863] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Sep 7 15:57:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:47.533139 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2894c25-22df-426d-a9ad-f1ec8d2a616e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:47.638138 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:47.647437 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2894c25-22df-426d-a9ad-f1ec8d2a616e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:47.685046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ca44-1825-447c-a46d-1db06ca07b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:47.685609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ca44-1825-447c-a46d-1db06ca07b2d None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:47.685884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ca44-1825-447c-a46d-1db06ca07b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:47.686213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ca44-1825-447c-a46d-1db06ca07b2d None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:47.686946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30ca44-1825-447c-a46d-1db06ca07b2d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:47.687249 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30ca44-1825-447c-a46d-1db06ca07b2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:47.688671 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30ca44-1825-447c-a46d-1db06ca07b2d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:47.708570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 429/864] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Sep 7 15:57:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:47.714175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe05b-c70f-43fd-8998-5c4be328f317 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:47.780566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:47.829027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe05b-c70f-43fd-8998-5c4be328f317 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:47.866521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0a6af-23a3-42b1-b5cc-7432781baeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:47.867538 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0a6af-23a3-42b1-b5cc-7432781baeb1 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:47.868042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0a6af-23a3-42b1-b5cc-7432781baeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:47.868597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0a6af-23a3-42b1-b5cc-7432781baeb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:47.945942 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0a6af-23a3-42b1-b5cc-7432781baeb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:47.947791 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0a6af-23a3-42b1-b5cc-7432781baeb1 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:48.013285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:48.065261 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ca44-1825-447c-a46d-1db06ca07b2d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:48.068347 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 436/865] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:57:48.174924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ca44-1825-447c-a46d-1db06ca07b2d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:48.214065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70220937-53ca-4567-81b8-02eafffb256f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:48.214624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70220937-53ca-4567-81b8-02eafffb256f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:48.215432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70220937-53ca-4567-81b8-02eafffb256f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:48.215706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70220937-53ca-4567-81b8-02eafffb256f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:48.227941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70220937-53ca-4567-81b8-02eafffb256f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:48.229420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70220937-53ca-4567-81b8-02eafffb256f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-70220937-53ca-4567-81b8-02eafffb256f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:48.247098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:48.248125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:48.249873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:48.249873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:48.249873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:48.249873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 430/866] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:48.253852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0a6af-23a3-42b1-b5cc-7432781baeb1 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:48.335486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e11d0-c465-4fc3-b143-4de9d76a503a None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:48.336124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e11d0-c465-4fc3-b143-4de9d76a503a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:48.336469 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e11d0-c465-4fc3-b143-4de9d76a503a None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:48.339267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 431/867] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:57:48.343591 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086b182-eab8-4752-8724-8b535d6561d7 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:48.343942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086b182-eab8-4752-8724-8b535d6561d7 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:48.344295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086b182-eab8-4752-8724-8b535d6561d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:48.350841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:48.364864 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-6086b182-eab8-4752-8724-8b535d6561d7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:48.366173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6086b182-eab8-4752-8724-8b535d6561d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:48.367763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0a6af-23a3-42b1-b5cc-7432781baeb1 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:48.419083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8739b-0477-4529-8976-7ea448f37903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:48.419889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8739b-0477-4529-8976-7ea448f37903 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:48.420178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8739b-0477-4529-8976-7ea448f37903 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:48.420457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8739b-0477-4529-8976-7ea448f37903 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:48.421148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8739b-0477-4529-8976-7ea448f37903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:48.421456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8739b-0477-4529-8976-7ea448f37903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:48.423409 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8739b-0477-4529-8976-7ea448f37903 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:48.440202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 437/868] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:48.444969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8739b-0477-4529-8976-7ea448f37903 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:48.460184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 432/869] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:57:48.469619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:48.562096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8739b-0477-4529-8976-7ea448f37903 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:48.599856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b12cc-c3bf-4c70-9b17-eb534a8fb4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:48.600768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b12cc-c3bf-4c70-9b17-eb534a8fb4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:48.601231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b12cc-c3bf-4c70-9b17-eb534a8fb4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:48.601658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b12cc-c3bf-4c70-9b17-eb534a8fb4b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:48.609375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b12cc-c3bf-4c70-9b17-eb534a8fb4b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:48.611022 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b12cc-c3bf-4c70-9b17-eb534a8fb4b3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-555b12cc-c3bf-4c70-9b17-eb534a8fb4b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:48.623023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:48.624153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:48.625304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:48.625304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:48.625304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:48.625304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:48.625304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:48.625304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:48.625304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:48.625304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:48.627319 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 438/870] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:48.633426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086b182-eab8-4752-8724-8b535d6561d7 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:48.745267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b12cc-c3bf-4c70-9b17-eb534a8fb4b3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:48.748577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086b182-eab8-4752-8724-8b535d6561d7 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:48.781840 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:48.790081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a4ef9-bde2-48c4-9bbf-5fd3a84a21dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:48.790588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a4ef9-bde2-48c4-9bbf-5fd3a84a21dd None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:48.790863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a4ef9-bde2-48c4-9bbf-5fd3a84a21dd None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:48.791136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a4ef9-bde2-48c4-9bbf-5fd3a84a21dd None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:48.791860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a4ef9-bde2-48c4-9bbf-5fd3a84a21dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:48.792166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a4ef9-bde2-48c4-9bbf-5fd3a84a21dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:48.794400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a4ef9-bde2-48c4-9bbf-5fd3a84a21dd None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:48.812032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 433/871] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:48.813051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a4ef9-bde2-48c4-9bbf-5fd3a84a21dd None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:48.853081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:48.875847 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b12cc-c3bf-4c70-9b17-eb534a8fb4b3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:48.915206 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57d3e5-e2c9-419b-9ef2-4041caabe538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:48.916232 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57d3e5-e2c9-419b-9ef2-4041caabe538 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:48.916893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57d3e5-e2c9-419b-9ef2-4041caabe538 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:48.917460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57d3e5-e2c9-419b-9ef2-4041caabe538 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:48.918594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57d3e5-e2c9-419b-9ef2-4041caabe538 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:48.920386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57d3e5-e2c9-419b-9ef2-4041caabe538 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:48.926884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a4ef9-bde2-48c4-9bbf-5fd3a84a21dd None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:48.949069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 439/872] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:57:48 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:57:48.974815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dec6b-3f7a-4dfd-b0c3-b03f5b8b1ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:48.975437 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dec6b-3f7a-4dfd-b0c3-b03f5b8b1ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:48.975715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dec6b-3f7a-4dfd-b0c3-b03f5b8b1ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:48.975983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dec6b-3f7a-4dfd-b0c3-b03f5b8b1ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:48.976741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dec6b-3f7a-4dfd-b0c3-b03f5b8b1ab7 None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=c0fa7d339c134c20b471170e13bbb9de) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:48.977054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dec6b-3f7a-4dfd-b0c3-b03f5b8b1ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:48.978600 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dec6b-3f7a-4dfd-b0c3-b03f5b8b1ab7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:48.979848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89f62b-72a6-4d0a-88ce-8ae3f3337333 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:48.980603 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89f62b-72a6-4d0a-88ce-8ae3f3337333 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:48.981413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89f62b-72a6-4d0a-88ce-8ae3f3337333 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:48.982880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 440/873] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:48.989241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e993f-b90f-45d5-815f-f960ee158f55 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:48.989852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e993f-b90f-45d5-815f-f960ee158f55 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:48.990423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e993f-b90f-45d5-815f-f960ee158f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:48.994429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 434/874] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:48 2022] GET /identity/v3/role_assignments?user.id=c0fa7d339c134c20b471170e13bbb9de&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:49.019166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-175e993f-b90f-45d5-815f-f960ee158f55 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:49.021027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-175e993f-b90f-45d5-815f-f960ee158f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:49.114282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 441/875] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:48 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:57:49.406896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dec6b-3f7a-4dfd-b0c3-b03f5b8b1ab7 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:49.468427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:49.523791 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dec6b-3f7a-4dfd-b0c3-b03f5b8b1ab7 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:49.572818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08683907-6469-4289-88d7-d4611bee4fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:49.573758 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08683907-6469-4289-88d7-d4611bee4fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:49.575140 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08683907-6469-4289-88d7-d4611bee4fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:49.575779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08683907-6469-4289-88d7-d4611bee4fd7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:49.576635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08683907-6469-4289-88d7-d4611bee4fd7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:49.578824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08683907-6469-4289-88d7-d4611bee4fd7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-08683907-6469-4289-88d7-d4611bee4fd7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:49.589878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:49.591784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:49.593241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 435/876] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Sep 7 15:57:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:49.598064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e993f-b90f-45d5-815f-f960ee158f55 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:49.678287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:49.704655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6858-df22-4534-a935-5b4e6e79d575 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:49.705021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6858-df22-4534-a935-5b4e6e79d575 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:49.705244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6858-df22-4534-a935-5b4e6e79d575 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:49.708738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 436/877] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:49.715326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643cbb7-4449-4fc4-8675-1ed76848e0b0 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:49.716301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643cbb7-4449-4fc4-8675-1ed76848e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:49.716301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643cbb7-4449-4fc4-8675-1ed76848e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:49.725146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e993f-b90f-45d5-815f-f960ee158f55 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:49.735987 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7643cbb7-4449-4fc4-8675-1ed76848e0b0 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:49.737323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7643cbb7-4449-4fc4-8675-1ed76848e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:49.763723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcce48-aad2-44c3-b238-7fba5cdfcdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:49.764443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcce48-aad2-44c3-b238-7fba5cdfcdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:49.764761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcce48-aad2-44c3-b238-7fba5cdfcdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:49.765040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcce48-aad2-44c3-b238-7fba5cdfcdc5 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:49.765783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcce48-aad2-44c3-b238-7fba5cdfcdc5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:49.766090 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcce48-aad2-44c3-b238-7fba5cdfcdc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:49.767585 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcce48-aad2-44c3-b238-7fba5cdfcdc5 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:49.773400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 442/878] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Sep 7 15:57:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:49.780625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcce48-aad2-44c3-b238-7fba5cdfcdc5 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:49.820710 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 437/879] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:49 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:57:49.908407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcce48-aad2-44c3-b238-7fba5cdfcdc5 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:49.940807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:49.945074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7e9c7-71a2-4531-8aa6-c5cfeef63ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:49.945993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7e9c7-71a2-4531-8aa6-c5cfeef63ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:49.946644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7e9c7-71a2-4531-8aa6-c5cfeef63ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:49.946913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7e9c7-71a2-4531-8aa6-c5cfeef63ac5 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:49.947553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7e9c7-71a2-4531-8aa6-c5cfeef63ac5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:49.947856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7e9c7-71a2-4531-8aa6-c5cfeef63ac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:49.950072 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7e9c7-71a2-4531-8aa6-c5cfeef63ac5 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:49.955751 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 443/880] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Sep 7 15:57:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:50.102805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643cbb7-4449-4fc4-8675-1ed76848e0b0 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:50.179985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:50.252116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643cbb7-4449-4fc4-8675-1ed76848e0b0 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:50.290695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32005a-c445-45b3-95e3-791adf529e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:50.291316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32005a-c445-45b3-95e3-791adf529e58 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:50.291599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32005a-c445-45b3-95e3-791adf529e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:50.291874 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32005a-c445-45b3-95e3-791adf529e58 None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:50.292541 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32005a-c445-45b3-95e3-791adf529e58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:50.294071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32005a-c445-45b3-95e3-791adf529e58 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:50.316892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 438/881] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:57:50 2022] POST /identity/v3/services => generated 269 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:51.356727 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e4adb-337a-4d97-b4d6-2a58cfdbd512 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:51.357240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e4adb-337a-4d97-b4d6-2a58cfdbd512 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:51.357240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e4adb-337a-4d97-b4d6-2a58cfdbd512 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:51.358730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 444/882] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:51.365119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697a065-e727-4084-afb5-51b65dab5142 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:51.365640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697a065-e727-4084-afb5-51b65dab5142 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:51.365715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697a065-e727-4084-afb5-51b65dab5142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:51.386191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-1697a065-e727-4084-afb5-51b65dab5142 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:51.387958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1697a065-e727-4084-afb5-51b65dab5142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:51.472884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 439/883] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:51.489718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fa4a3-d719-4f47-bae0-58ed09219abb None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:51.489991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fa4a3-d719-4f47-bae0-58ed09219abb None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:51.490269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fa4a3-d719-4f47-bae0-58ed09219abb None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:51.491862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 445/884] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:51.497789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b97c4-0b68-4ebc-891c-4942a3381555 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:51.498075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b97c4-0b68-4ebc-891c-4942a3381555 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:51.498352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b97c4-0b68-4ebc-891c-4942a3381555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:51.517509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-285b97c4-0b68-4ebc-891c-4942a3381555 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:51.518934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-285b97c4-0b68-4ebc-891c-4942a3381555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:51.544599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:51.588889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 440/885] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:51.747288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fa4a3-d719-4f47-bae0-58ed09219abb None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:51.856236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fa4a3-d719-4f47-bae0-58ed09219abb None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:51.892218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448c095-e161-46c2-b391-a2710314a5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:51.892587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b97c4-0b68-4ebc-891c-4942a3381555 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:51.892885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448c095-e161-46c2-b391-a2710314a5fe None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:51.893162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448c095-e161-46c2-b391-a2710314a5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:51.893438 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448c095-e161-46c2-b391-a2710314a5fe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:51.894275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448c095-e161-46c2-b391-a2710314a5fe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:51.895722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448c095-e161-46c2-b391-a2710314a5fe None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-c448c095-e161-46c2-b391-a2710314a5fe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:51.905996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:51.907030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:51.907899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 446/886] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:57:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:51.914473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448c095-e161-46c2-b391-a2710314a5fe None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:51.992041 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:52.044472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448c095-e161-46c2-b391-a2710314a5fe None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:52.044787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b97c4-0b68-4ebc-891c-4942a3381555 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:52.093275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9845a-b123-4898-85fb-88dc5d3fa226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:52.093693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a441eac-1aae-426d-9b51-dca3efe76b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:52.094499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a441eac-1aae-426d-9b51-dca3efe76b2b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:52.094785 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9845a-b123-4898-85fb-88dc5d3fa226 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:52.095077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a441eac-1aae-426d-9b51-dca3efe76b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:52.095487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a441eac-1aae-426d-9b51-dca3efe76b2b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:52.095688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9845a-b123-4898-85fb-88dc5d3fa226 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:52.096201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9845a-b123-4898-85fb-88dc5d3fa226 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:52.097559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9845a-b123-4898-85fb-88dc5d3fa226 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:52.098618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9845a-b123-4898-85fb-88dc5d3fa226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:52.101833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9845a-b123-4898-85fb-88dc5d3fa226 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:52.108823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a441eac-1aae-426d-9b51-dca3efe76b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:52.113903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 447/887] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:57:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:52.115511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9845a-b123-4898-85fb-88dc5d3fa226 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-7a441eac-1aae-426d-9b51-dca3efe76b2b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:52.118061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:52.118998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:52.120193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:52.120193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:52.120193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:52.120193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:52.120193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:52.120193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:52.120193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:52.120193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:52.120193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:52.120193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:52.120193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:57:52.120193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:52.124764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 441/888] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Sep 7 15:57:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:52.127970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a441eac-1aae-426d-9b51-dca3efe76b2b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:52.165067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:52.247069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9845a-b123-4898-85fb-88dc5d3fa226 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:52.280833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:52.292643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a441eac-1aae-426d-9b51-dca3efe76b2b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:52.297182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d6797-bf1b-4e05-bd48-45edc813a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:52.298128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d6797-bf1b-4e05-bd48-45edc813a347 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:52.298616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d6797-bf1b-4e05-bd48-45edc813a347 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:52.299145 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d6797-bf1b-4e05-bd48-45edc813a347 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:52.300032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d6797-bf1b-4e05-bd48-45edc813a347 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:52.300561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d6797-bf1b-4e05-bd48-45edc813a347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:52.302272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d6797-bf1b-4e05-bd48-45edc813a347 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:52.312819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 448/889] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:57:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:52.315331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d6797-bf1b-4e05-bd48-45edc813a347 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:52.337674 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872ce02-a0c0-4e39-9a3b-db73883e0b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:52.338684 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872ce02-a0c0-4e39-9a3b-db73883e0b96 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:52.338979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872ce02-a0c0-4e39-9a3b-db73883e0b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:52.339254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872ce02-a0c0-4e39-9a3b-db73883e0b96 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:52.340807 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872ce02-a0c0-4e39-9a3b-db73883e0b96 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:52.341557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872ce02-a0c0-4e39-9a3b-db73883e0b96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:52.342946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872ce02-a0c0-4e39-9a3b-db73883e0b96 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:52.356863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 442/890] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Sep 7 15:57:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:52.358273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f2957-1a08-481f-be88-730c8f0b4663 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:52.358559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f2957-1a08-481f-be88-730c8f0b4663 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:52.358861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f2957-1a08-481f-be88-730c8f0b4663 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:52.360304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 443/891] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:52.361951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f2957-1a08-481f-be88-730c8f0b4663 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:52.443581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d6797-bf1b-4e05-bd48-45edc813a347 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:52.463226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:52.483479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f2957-1a08-481f-be88-730c8f0b4663 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:52.486906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134149b-b033-4b7f-8e13-86f39fff73af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:52.487905 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134149b-b033-4b7f-8e13-86f39fff73af None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:52.488331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134149b-b033-4b7f-8e13-86f39fff73af None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:52.488807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134149b-b033-4b7f-8e13-86f39fff73af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:52.489721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134149b-b033-4b7f-8e13-86f39fff73af None admin] RBAC: Adding query filter params (interface=public, service_id=db184fe248ea4142b0a17385f7e94e09, region_id=RegionOne) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:52.490032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134149b-b033-4b7f-8e13-86f39fff73af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:52.491799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134149b-b033-4b7f-8e13-86f39fff73af None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:52.500863 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 449/892] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Sep 7 15:57:52 2022] GET /identity/v3/endpoints?service_id=db184fe248ea4142b0a17385f7e94e09&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:52.503515 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57570a-1c44-41a2-a6db-a4b88b4f22eb None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:52.503811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57570a-1c44-41a2-a6db-a4b88b4f22eb None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:52.504095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57570a-1c44-41a2-a6db-a4b88b4f22eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:52.521855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf34b09-41dc-4bcf-9904-bc968660971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:52.522508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf34b09-41dc-4bcf-9904-bc968660971d None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:52.522790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf34b09-41dc-4bcf-9904-bc968660971d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:52.523065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf34b09-41dc-4bcf-9904-bc968660971d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:52.523970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-3a57570a-1c44-41a2-a6db-a4b88b4f22eb None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:52.525236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3a57570a-1c44-41a2-a6db-a4b88b4f22eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:52.535885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf34b09-41dc-4bcf-9904-bc968660971d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:52.537013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf34b09-41dc-4bcf-9904-bc968660971d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-faf34b09-41dc-4bcf-9904-bc968660971d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:52.554005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:52.555052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:52.555965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:52.555965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:52.555965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:52.555965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 444/893] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:52.555965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf34b09-41dc-4bcf-9904-bc968660971d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:52.590298 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:52.618211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 450/894] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:52.619550 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57570a-1c44-41a2-a6db-a4b88b4f22eb None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:52.697709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf34b09-41dc-4bcf-9904-bc968660971d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:52.745362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc48d3f-c97f-40b7-8392-24e608db558a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:52.746769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc48d3f-c97f-40b7-8392-24e608db558a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:52.747241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc48d3f-c97f-40b7-8392-24e608db558a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:52.747798 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc48d3f-c97f-40b7-8392-24e608db558a None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:52.748336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc48d3f-c97f-40b7-8392-24e608db558a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:52.750127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc48d3f-c97f-40b7-8392-24e608db558a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:52.752511 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:52.756965 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57570a-1c44-41a2-a6db-a4b88b4f22eb None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:52.758408 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 445/895] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Sep 7 15:57:52 2022] GET /identity/v3/services => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:52.759500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed2034-f3ce-4af9-9d56-ab0eee291aa5 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:52.759791 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed2034-f3ce-4af9-9d56-ab0eee291aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:52.760068 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed2034-f3ce-4af9-9d56-ab0eee291aa5 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:52.767112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 446/896] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:52.774245 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3836ced-f217-420a-84f7-845c12790664 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:52.774879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3836ced-f217-420a-84f7-845c12790664 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:52.775385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3836ced-f217-420a-84f7-845c12790664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:52.797324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-e3836ced-f217-420a-84f7-845c12790664 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:52.798917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e3836ced-f217-420a-84f7-845c12790664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:52.808286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b2b3d-4166-409c-a0fd-c6abf923a591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:52.809508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2b3d-4166-409c-a0fd-c6abf923a591 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:52.809750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2b3d-4166-409c-a0fd-c6abf923a591 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:52.810765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2b3d-4166-409c-a0fd-c6abf923a591 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:52.810906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b2b3d-4166-409c-a0fd-c6abf923a591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:52.811225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b2b3d-4166-409c-a0fd-c6abf923a591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:52.812647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b2b3d-4166-409c-a0fd-c6abf923a591 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:52.832771 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 451/897] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:52.834179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b2b3d-4166-409c-a0fd-c6abf923a591 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:52.885439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:52.892297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 447/898] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:52.898440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3836ced-f217-420a-84f7-845c12790664 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:52.958214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b2b3d-4166-409c-a0fd-c6abf923a591 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:53.007801 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fa188-b33c-4297-9a0c-34e6d594e55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:53.008714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fa188-b33c-4297-9a0c-34e6d594e55c None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:53.009012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fa188-b33c-4297-9a0c-34e6d594e55c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:53.009339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fa188-b33c-4297-9a0c-34e6d594e55c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:53.030460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fa188-b33c-4297-9a0c-34e6d594e55c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:53.033715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fa188-b33c-4297-9a0c-34e6d594e55c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:53.038442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3836ced-f217-420a-84f7-845c12790664 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-c72fa188-b33c-4297-9a0c-34e6d594e55c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:53.049350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:53.050324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:53.051473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:53.051473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:53.051473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:53.051473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:53.051473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:53.051473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:53.051473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:53.051473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:53.051473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:57:53.051473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:53.055129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 452/899] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Sep 7 15:57:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:53.060857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fa188-b33c-4297-9a0c-34e6d594e55c None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:53.080540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:53.088909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ca62d-c310-4c62-b1bb-48840a377a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:53.091056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ca62d-c310-4c62-b1bb-48840a377a0f None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:53.091501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ca62d-c310-4c62-b1bb-48840a377a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:53.092058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ca62d-c310-4c62-b1bb-48840a377a0f None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:53.093194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ca62d-c310-4c62-b1bb-48840a377a0f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:53.095501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ca62d-c310-4c62-b1bb-48840a377a0f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:53.124763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 448/900] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:57:52 2022] POST /identity/v3/services => generated 241 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:57:53.200067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ca62d-c310-4c62-b1bb-48840a377a0f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:53.250720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:53.256359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fa188-b33c-4297-9a0c-34e6d594e55c None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:53.318348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306baf6-e40f-4ae5-b8e0-ae2dc42c35d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:53.319248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306baf6-e40f-4ae5-b8e0-ae2dc42c35d3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:53.319762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306baf6-e40f-4ae5-b8e0-ae2dc42c35d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:53.320183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306baf6-e40f-4ae5-b8e0-ae2dc42c35d3 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:53.321601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306baf6-e40f-4ae5-b8e0-ae2dc42c35d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:53.322148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306baf6-e40f-4ae5-b8e0-ae2dc42c35d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:53.324604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306baf6-e40f-4ae5-b8e0-ae2dc42c35d3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:53.350124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 453/901] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Sep 7 15:57:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:53.356095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306baf6-e40f-4ae5-b8e0-ae2dc42c35d3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:53.383328 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ca62d-c310-4c62-b1bb-48840a377a0f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:53.438222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1472f-3f42-4144-b21e-a6c2cf7e33cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:53.439275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1472f-3f42-4144-b21e-a6c2cf7e33cc None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:53.439275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1472f-3f42-4144-b21e-a6c2cf7e33cc None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:53.439275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1472f-3f42-4144-b21e-a6c2cf7e33cc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:53.439275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1472f-3f42-4144-b21e-a6c2cf7e33cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:53.441921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1472f-3f42-4144-b21e-a6c2cf7e33cc None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-60b1472f-3f42-4144-b21e-a6c2cf7e33cc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:53.452487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:53.453505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:53.454398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 449/902] 10.222.0.43 () {56 vars in 1132 bytes} [Wed Sep 7 15:57:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:53.459831 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1472f-3f42-4144-b21e-a6c2cf7e33cc None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:53.496791 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306baf6-e40f-4ae5-b8e0-ae2dc42c35d3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:53.524972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:53.554637 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5b5ae-e7a7-42a5-a72c-bd1cc6cd1f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:53.555716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5b5ae-e7a7-42a5-a72c-bd1cc6cd1f0f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:53.556857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5b5ae-e7a7-42a5-a72c-bd1cc6cd1f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:53.557401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5b5ae-e7a7-42a5-a72c-bd1cc6cd1f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:53.585271 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1472f-3f42-4144-b21e-a6c2cf7e33cc None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:53.592797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:53.629959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d569-4869-4bbd-bd74-d8c7df489d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:53.631297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d569-4869-4bbd-bd74-d8c7df489d9f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:53.631783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d569-4869-4bbd-bd74-d8c7df489d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:53.632244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312d569-4869-4bbd-bd74-d8c7df489d9f None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:53.633122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312d569-4869-4bbd-bd74-d8c7df489d9f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:53.633607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312d569-4869-4bbd-bd74-d8c7df489d9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:53.636007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312d569-4869-4bbd-bd74-d8c7df489d9f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:53.649185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 450/903] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Sep 7 15:57:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:53.650276 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d569-4869-4bbd-bd74-d8c7df489d9f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:53.658088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5b5ae-e7a7-42a5-a72c-bd1cc6cd1f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:53.658901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5b5ae-e7a7-42a5-a72c-bd1cc6cd1f0f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:53.772729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 454/904] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:57:53 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 15:57:53.778354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5b5ae-e7a7-42a5-a72c-bd1cc6cd1f0f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:53.779503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312d569-4869-4bbd-bd74-d8c7df489d9f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:53.800783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:53.831079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42f7d1-de23-464a-80dd-bbbf14ccccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:53.832943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f7d1-de23-464a-80dd-bbbf14ccccec None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:53.833422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f7d1-de23-464a-80dd-bbbf14ccccec None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:53.833892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f7d1-de23-464a-80dd-bbbf14ccccec None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:53.835149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42f7d1-de23-464a-80dd-bbbf14ccccec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:53.835651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42f7d1-de23-464a-80dd-bbbf14ccccec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:53.837926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42f7d1-de23-464a-80dd-bbbf14ccccec None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:53.846474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 451/905] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Sep 7 15:57:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:53.852656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42f7d1-de23-464a-80dd-bbbf14ccccec None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:53.853580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:53.928178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5b5ae-e7a7-42a5-a72c-bd1cc6cd1f0f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:53.973953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5c206-42b3-4a77-b3f2-b65d5841130d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:53.974614 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5c206-42b3-4a77-b3f2-b65d5841130d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:53.974892 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5c206-42b3-4a77-b3f2-b65d5841130d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:53.975165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5c206-42b3-4a77-b3f2-b65d5841130d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:53.986513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5c206-42b3-4a77-b3f2-b65d5841130d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:53.987969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5c206-42b3-4a77-b3f2-b65d5841130d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-46b5c206-42b3-4a77-b3f2-b65d5841130d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:54.003995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:54.005349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:54.006253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:54.006253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:54.006253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:54.008159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42f7d1-de23-464a-80dd-bbbf14ccccec None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:54.009894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 455/906] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:54.010769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5c206-42b3-4a77-b3f2-b65d5841130d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:54.059461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378b61-e7a4-4d9f-bddb-d34fd3901302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:54.060219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378b61-e7a4-4d9f-bddb-d34fd3901302 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:54.060594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378b61-e7a4-4d9f-bddb-d34fd3901302 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:54.061028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378b61-e7a4-4d9f-bddb-d34fd3901302 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:54.061830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1378b61-e7a4-4d9f-bddb-d34fd3901302 None admin] RBAC: Adding query filter params (interface=public, service_id=d21b99c17fc64076808b23d86a3dbaef, region_id=RegionOne) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:54.062233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1378b61-e7a4-4d9f-bddb-d34fd3901302 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:54.063887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1378b61-e7a4-4d9f-bddb-d34fd3901302 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:54.075227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 452/907] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Sep 7 15:57:53 2022] GET /identity/v3/endpoints?service_id=d21b99c17fc64076808b23d86a3dbaef&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:54.076316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378b61-e7a4-4d9f-bddb-d34fd3901302 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:54.127788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:54.147362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5c206-42b3-4a77-b3f2-b65d5841130d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:54.158234 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:54.193827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378b61-e7a4-4d9f-bddb-d34fd3901302 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:54.200266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed69b5-ab7e-464c-953c-4512b4c942db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:54.201274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed69b5-ab7e-464c-953c-4512b4c942db None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:54.201903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed69b5-ab7e-464c-953c-4512b4c942db None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:54.202321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed69b5-ab7e-464c-953c-4512b4c942db None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:54.203123 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed69b5-ab7e-464c-953c-4512b4c942db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:54.203572 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed69b5-ab7e-464c-953c-4512b4c942db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:54.205680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed69b5-ab7e-464c-953c-4512b4c942db None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:54.222483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 456/908] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:54.228313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed69b5-ab7e-464c-953c-4512b4c942db None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:54.242375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1a8d4-fc8b-4e51-baaf-6318e8b8c4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:54.243701 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1a8d4-fc8b-4e51-baaf-6318e8b8c4eb None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:54.244184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1a8d4-fc8b-4e51-baaf-6318e8b8c4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:54.245037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1a8d4-fc8b-4e51-baaf-6318e8b8c4eb None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:54.245884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1a8d4-fc8b-4e51-baaf-6318e8b8c4eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:54.248267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1a8d4-fc8b-4e51-baaf-6318e8b8c4eb None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:54.256289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 453/909] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Sep 7 15:57:54 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:54.353354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed69b5-ab7e-464c-953c-4512b4c942db None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:54.392601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd83ce-8b6f-40ef-a471-6132909a356e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:54.393203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd83ce-8b6f-40ef-a471-6132909a356e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:54.393482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd83ce-8b6f-40ef-a471-6132909a356e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:54.394005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd83ce-8b6f-40ef-a471-6132909a356e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:54.402790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd83ce-8b6f-40ef-a471-6132909a356e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:54.404737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd83ce-8b6f-40ef-a471-6132909a356e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-a3dd83ce-8b6f-40ef-a471-6132909a356e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:54.419449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:54.420403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:54.421463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:54.421463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:54.421463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:54.421463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:54.421463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:54.421463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:54.421463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:54.421463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:54.421463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 457/910] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:54.426623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1a8d4-fc8b-4e51-baaf-6318e8b8c4eb None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:54.536573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1a8d4-fc8b-4e51-baaf-6318e8b8c4eb None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:54.548878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:54.575173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fd03b-dd03-4795-aecf-e0861e59f4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:54.575790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fd03b-dd03-4795-aecf-e0861e59f4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:54.576069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fd03b-dd03-4795-aecf-e0861e59f4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:54.576340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fd03b-dd03-4795-aecf-e0861e59f4e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:54.577076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fd03b-dd03-4795-aecf-e0861e59f4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:54.577379 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fd03b-dd03-4795-aecf-e0861e59f4e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:54.578811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fd03b-dd03-4795-aecf-e0861e59f4e8 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:54.591545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 454/911] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:54.597256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd83ce-8b6f-40ef-a471-6132909a356e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:54.626622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:54.710277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd83ce-8b6f-40ef-a471-6132909a356e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:54.766378 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fa010-c047-452b-8ecf-630decfe8eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:54.767364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fa010-c047-452b-8ecf-630decfe8eee None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:54.767824 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fa010-c047-452b-8ecf-630decfe8eee None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:54.768272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fa010-c047-452b-8ecf-630decfe8eee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:54.769839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fa010-c047-452b-8ecf-630decfe8eee None admin] RBAC: Adding query filter params (role.id=b57f3b4978524f40ad698b68b0f919fd, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=c0fa7d339c134c20b471170e13bbb9de) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:54.770355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fa010-c047-452b-8ecf-630decfe8eee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:54.772882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fa010-c047-452b-8ecf-630decfe8eee None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:54.783932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 458/912] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:57:54 2022] GET /identity/v3/role_assignments?user.id=c0fa7d339c134c20b471170e13bbb9de&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=b57f3b4978524f40ad698b68b0f919fd => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:55.134201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4b549-ca0b-4124-a977-364d231be802 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:55.134879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4b549-ca0b-4124-a977-364d231be802 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:55.135363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4b549-ca0b-4124-a977-364d231be802 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:55.137305 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 455/913] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:55.143064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa7181-e58f-48c4-926d-6d79bda9780a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:55.143598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa7181-e58f-48c4-926d-6d79bda9780a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:55.144354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa7181-e58f-48c4-926d-6d79bda9780a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:55.167542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-48aa7181-e58f-48c4-926d-6d79bda9780a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:55.169848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-48aa7181-e58f-48c4-926d-6d79bda9780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:55.251066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 459/914] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:55.526413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4b549-ca0b-4124-a977-364d231be802 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:55.643425 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4b549-ca0b-4124-a977-364d231be802 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:55.680104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6787b-8af7-4763-a345-81afbba5be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:55.680771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6787b-8af7-4763-a345-81afbba5be2e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:55.681053 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6787b-8af7-4763-a345-81afbba5be2e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:55.681321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6787b-8af7-4763-a345-81afbba5be2e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:55.681902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6787b-8af7-4763-a345-81afbba5be2e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:55.683754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6787b-8af7-4763-a345-81afbba5be2e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:55.689991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8855c-1437-48c9-84c8-e53585779c81 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:55.690473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8855c-1437-48c9-84c8-e53585779c81 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:55.690547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8855c-1437-48c9-84c8-e53585779c81 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-4ad6787b-8af7-4763-a345-81afbba5be2e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:55.693300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:55.694256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:55.695123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 456/916] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:57:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:55.695904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 460/916] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:55.698275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2cdcb-154f-4be5-8ff0-ccfc1ecfa718 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:55.698555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2cdcb-154f-4be5-8ff0-ccfc1ecfa718 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:55.698832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2cdcb-154f-4be5-8ff0-ccfc1ecfa718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:55.703541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8855c-1437-48c9-84c8-e53585779c81 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:55.719811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-43e2cdcb-154f-4be5-8ff0-ccfc1ecfa718 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:55.721058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-43e2cdcb-154f-4be5-8ff0-ccfc1ecfa718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:55.730644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:55.751738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:55.796808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 457/917] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:55.838279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8855c-1437-48c9-84c8-e53585779c81 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:55.876854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc925c5a-486f-47bc-bc28-360e96dd347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:55.878193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc925c5a-486f-47bc-bc28-360e96dd347b None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:55.878921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc925c5a-486f-47bc-bc28-360e96dd347b None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:55.879558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc925c5a-486f-47bc-bc28-360e96dd347b None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:55.880781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc925c5a-486f-47bc-bc28-360e96dd347b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:55.881471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc925c5a-486f-47bc-bc28-360e96dd347b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:55.884004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc925c5a-486f-47bc-bc28-360e96dd347b None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:55.893307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 461/918] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:57:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:55.903256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2cdcb-154f-4be5-8ff0-ccfc1ecfa718 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:56.024471 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2cdcb-154f-4be5-8ff0-ccfc1ecfa718 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:56.062557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558788-8a3e-461f-b2fa-eefbd89f1e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:56.063107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558788-8a3e-461f-b2fa-eefbd89f1e90 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:56.063386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558788-8a3e-461f-b2fa-eefbd89f1e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:56.063663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb558788-8a3e-461f-b2fa-eefbd89f1e90 None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:56.064302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb558788-8a3e-461f-b2fa-eefbd89f1e90 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:56.064604 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb558788-8a3e-461f-b2fa-eefbd89f1e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:56.066234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb558788-8a3e-461f-b2fa-eefbd89f1e90 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:56.072104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 458/919] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Sep 7 15:57:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:56.078417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc925c5a-486f-47bc-bc28-360e96dd347b None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:56.083221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558788-8a3e-461f-b2fa-eefbd89f1e90 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:56.117015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:56.208556 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:56.216556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb558788-8a3e-461f-b2fa-eefbd89f1e90 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:56.227955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc925c5a-486f-47bc-bc28-360e96dd347b None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:56.260470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae744e5-d1c2-4048-8480-4aa43cf064ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:56.261725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae744e5-d1c2-4048-8480-4aa43cf064ae None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:56.262325 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae744e5-d1c2-4048-8480-4aa43cf064ae None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:56.262973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae744e5-d1c2-4048-8480-4aa43cf064ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:56.263897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae744e5-d1c2-4048-8480-4aa43cf064ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:56.265921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae744e5-d1c2-4048-8480-4aa43cf064ae None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:56.271694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff584c6c-0ac5-480d-b0e8-5723163c12e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:56.272312 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff584c6c-0ac5-480d-b0e8-5723163c12e2 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:56.272592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff584c6c-0ac5-480d-b0e8-5723163c12e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:56.272895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff584c6c-0ac5-480d-b0e8-5723163c12e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:56.273588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff584c6c-0ac5-480d-b0e8-5723163c12e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:56.274952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff584c6c-0ac5-480d-b0e8-5723163c12e2 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-8ae744e5-d1c2-4048-8480-4aa43cf064ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:56.279163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:56.280189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:57:56.281097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:56.283696 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 459/920] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Sep 7 15:57:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:56.290354 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae744e5-d1c2-4048-8480-4aa43cf064ae None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:56.312855 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 462/921] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:56.411418 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:56.423930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae744e5-d1c2-4048-8480-4aa43cf064ae None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:56.474356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f69733-cfb8-4c3d-94b2-53edae90c417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:56.474976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f69733-cfb8-4c3d-94b2-53edae90c417 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:56.475253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f69733-cfb8-4c3d-94b2-53edae90c417 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:56.475526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f69733-cfb8-4c3d-94b2-53edae90c417 None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:56.476169 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f69733-cfb8-4c3d-94b2-53edae90c417 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:56.476470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f69733-cfb8-4c3d-94b2-53edae90c417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:56.477894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f69733-cfb8-4c3d-94b2-53edae90c417 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:56.488938 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 460/922] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Sep 7 15:57:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:56.490526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff584c6c-0ac5-480d-b0e8-5723163c12e2 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:56.608162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff584c6c-0ac5-480d-b0e8-5723163c12e2 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:56.633508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073a4f6-9421-4a0f-a127-a2a6088cde69 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:56.633838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073a4f6-9421-4a0f-a127-a2a6088cde69 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:56.634052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073a4f6-9421-4a0f-a127-a2a6088cde69 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:56.635634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 461/923] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:56.641700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8a36f-4136-4d60-8f94-4ad4c0c4303a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:56.641987 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8a36f-4136-4d60-8f94-4ad4c0c4303a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:56.642262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8a36f-4136-4d60-8f94-4ad4c0c4303a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:56.645883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d29e7-a56c-46c1-b7d5-aee203180b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:56.646497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d29e7-a56c-46c1-b7d5-aee203180b76 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:56.646777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d29e7-a56c-46c1-b7d5-aee203180b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:56.647052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d29e7-a56c-46c1-b7d5-aee203180b76 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:56.647695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d29e7-a56c-46c1-b7d5-aee203180b76 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:56.648003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d29e7-a56c-46c1-b7d5-aee203180b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:56.649765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d29e7-a56c-46c1-b7d5-aee203180b76 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:56.660850 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 463/924] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Sep 7 15:57:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:56.663399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d29e7-a56c-46c1-b7d5-aee203180b76 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:56.669813 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-eeb8a36f-4136-4d60-8f94-4ad4c0c4303a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:56.671002 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-eeb8a36f-4136-4d60-8f94-4ad4c0c4303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:56.685129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:56.754904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 462/925] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:56.784213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d29e7-a56c-46c1-b7d5-aee203180b76 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:56.822261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3f1a7-f44d-469e-932c-f0509c37a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:56.822875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3f1a7-f44d-469e-932c-f0509c37a356 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:56.823152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3f1a7-f44d-469e-932c-f0509c37a356 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:56.823424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3f1a7-f44d-469e-932c-f0509c37a356 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:56.825356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3f1a7-f44d-469e-932c-f0509c37a356 None admin] RBAC: Adding query filter params (interface=public, service_id=cd1c3e78a85c4585b0117479d9da0437, region_id=RegionOne) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:56.825676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3f1a7-f44d-469e-932c-f0509c37a356 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:56.827106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3f1a7-f44d-469e-932c-f0509c37a356 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:56.833020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 464/926] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Sep 7 15:57:56 2022] GET /identity/v3/endpoints?service_id=cd1c3e78a85c4585b0117479d9da0437&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:56.841882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8a36f-4136-4d60-8f94-4ad4c0c4303a None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:56.936006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:56.958940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8a36f-4136-4d60-8f94-4ad4c0c4303a None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:57.000134 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bad1be-3a5b-447d-b7ce-46750c3ae6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:57.000793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad1be-3a5b-447d-b7ce-46750c3ae6cc None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:57.001133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad1be-3a5b-447d-b7ce-46750c3ae6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:57.001416 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad1be-3a5b-447d-b7ce-46750c3ae6cc None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:57.002028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bad1be-3a5b-447d-b7ce-46750c3ae6cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:57.003730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bad1be-3a5b-447d-b7ce-46750c3ae6cc None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:57.015355 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 463/927] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Sep 7 15:57:56 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:57.044069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3f1a7-f44d-469e-932c-f0509c37a356 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:57.086863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2473b26-60ee-4b83-84ba-150878a57e78 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:57.087217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2473b26-60ee-4b83-84ba-150878a57e78 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:57.087412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2473b26-60ee-4b83-84ba-150878a57e78 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:57.089140 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 464/928] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:57.094787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08eb77-cea4-4ca0-a734-01f468d0e5f7 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:57.095111 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08eb77-cea4-4ca0-a734-01f468d0e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:57.095341 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08eb77-cea4-4ca0-a734-01f468d0e5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:57.115134 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7b08eb77-cea4-4ca0-a734-01f468d0e5f7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:57.116420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7b08eb77-cea4-4ca0-a734-01f468d0e5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:57.153475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:57.161443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3f1a7-f44d-469e-932c-f0509c37a356 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:57.209737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bdcc2-7886-425c-ab9c-350b744c68f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:57.210473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bdcc2-7886-425c-ab9c-350b744c68f4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:57.210855 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bdcc2-7886-425c-ab9c-350b744c68f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:57.211235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bdcc2-7886-425c-ab9c-350b744c68f4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:57.211938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bdcc2-7886-425c-ab9c-350b744c68f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:57.212949 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 465/929] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:57:57.217354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bdcc2-7886-425c-ab9c-350b744c68f4 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-a83bdcc2-7886-425c-ab9c-350b744c68f4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:57.226991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:57.227988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:57.229526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 465/930] 10.222.0.43 () {56 vars in 1132 bytes} [Wed Sep 7 15:57:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:57.234543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08eb77-cea4-4ca0-a734-01f468d0e5f7 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:57.322623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:57.354897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08eb77-cea4-4ca0-a734-01f468d0e5f7 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:57.394740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f425c24-21d2-45d3-9a29-6b72d9660715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:57.395621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f425c24-21d2-45d3-9a29-6b72d9660715 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:57.396043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f425c24-21d2-45d3-9a29-6b72d9660715 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:57.396464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f425c24-21d2-45d3-9a29-6b72d9660715 None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:57.397766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f425c24-21d2-45d3-9a29-6b72d9660715 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:57.398213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f425c24-21d2-45d3-9a29-6b72d9660715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:57.399716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f425c24-21d2-45d3-9a29-6b72d9660715 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:57.406043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 466/931] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Sep 7 15:57:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:57.412472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bdcc2-7886-425c-ab9c-350b744c68f4 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:57.520404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f425c24-21d2-45d3-9a29-6b72d9660715 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:57.525794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bdcc2-7886-425c-ab9c-350b744c68f4 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:57.558763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:57.563503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbadeb-1193-4daf-8dc6-f82c0330938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:57.564128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbadeb-1193-4daf-8dc6-f82c0330938e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:57.564411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbadeb-1193-4daf-8dc6-f82c0330938e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:57.564716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbadeb-1193-4daf-8dc6-f82c0330938e None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:57.565369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbadeb-1193-4daf-8dc6-f82c0330938e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:57.565676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbadeb-1193-4daf-8dc6-f82c0330938e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:57.567075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbadeb-1193-4daf-8dc6-f82c0330938e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:57.578061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 466/932] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Sep 7 15:57:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:57.579142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbadeb-1193-4daf-8dc6-f82c0330938e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:57.660654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f425c24-21d2-45d3-9a29-6b72d9660715 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:57.695765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbadeb-1193-4daf-8dc6-f82c0330938e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:57.708415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed06625-0f17-4d1d-923a-0e77ccfa1f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:57.709122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed06625-0f17-4d1d-923a-0e77ccfa1f15 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:57.709360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed06625-0f17-4d1d-923a-0e77ccfa1f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:57.709636 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed06625-0f17-4d1d-923a-0e77ccfa1f15 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:57.720183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:57.725201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed06625-0f17-4d1d-923a-0e77ccfa1f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-3ed06625-0f17-4d1d-923a-0e77ccfa1f15 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:57:57.733630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:57.734699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:57.740642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 467/933] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Sep 7 15:57:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:57:57.741570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed06625-0f17-4d1d-923a-0e77ccfa1f15 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:57.748194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee5a71-f0db-4038-859c-8cb9ac063a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:57.749197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee5a71-f0db-4038-859c-8cb9ac063a3c None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:57.749693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee5a71-f0db-4038-859c-8cb9ac063a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:57.750281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee5a71-f0db-4038-859c-8cb9ac063a3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:57.751160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee5a71-f0db-4038-859c-8cb9ac063a3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:57.752783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee5a71-f0db-4038-859c-8cb9ac063a3c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:57.780272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 467/934] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:57.876054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed06625-0f17-4d1d-923a-0e77ccfa1f15 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:57.921974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b59905-cdf9-406d-8512-62882ef9178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:57.923108 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b59905-cdf9-406d-8512-62882ef9178c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:57.923582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b59905-cdf9-406d-8512-62882ef9178c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:57.924048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b59905-cdf9-406d-8512-62882ef9178c None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:57.924973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b59905-cdf9-406d-8512-62882ef9178c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:57.925605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b59905-cdf9-406d-8512-62882ef9178c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:57.927345 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b59905-cdf9-406d-8512-62882ef9178c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:57.938029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 468/935] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Sep 7 15:57:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:57.944055 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee5a71-f0db-4038-859c-8cb9ac063a3c None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:58.018249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:58.073736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee5a71-f0db-4038-859c-8cb9ac063a3c None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:58.114602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46f13d-7bc7-4b30-919c-5ff3cce0b56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:58.115243 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46f13d-7bc7-4b30-919c-5ff3cce0b56d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:58.115537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46f13d-7bc7-4b30-919c-5ff3cce0b56d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:58.115790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46f13d-7bc7-4b30-919c-5ff3cce0b56d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:58.128545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46f13d-7bc7-4b30-919c-5ff3cce0b56d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:58.130113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46f13d-7bc7-4b30-919c-5ff3cce0b56d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-bd46f13d-7bc7-4b30-919c-5ff3cce0b56d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:58.147067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:58.149039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:58.150578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:58.150578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:58.150578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:58.150578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 468/936] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:58.161808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b59905-cdf9-406d-8512-62882ef9178c None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:58.274954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:58.349005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b59905-cdf9-406d-8512-62882ef9178c None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:58.397819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151abb42-d09c-41b6-8d12-d08d5c959a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:58.398429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151abb42-d09c-41b6-8d12-d08d5c959a74 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:58.398705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151abb42-d09c-41b6-8d12-d08d5c959a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:58.398976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151abb42-d09c-41b6-8d12-d08d5c959a74 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:58.399613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151abb42-d09c-41b6-8d12-d08d5c959a74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:58.399913 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151abb42-d09c-41b6-8d12-d08d5c959a74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:58.401303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151abb42-d09c-41b6-8d12-d08d5c959a74 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:58.414973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 469/937] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:58.421809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46f13d-7bc7-4b30-919c-5ff3cce0b56d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:58.547891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46f13d-7bc7-4b30-919c-5ff3cce0b56d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:58.552728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:58.588835 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c68d7-f748-4f21-bad4-2f7e4ba406c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:58.589613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c68d7-f748-4f21-bad4-2f7e4ba406c1 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:58.589880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c68d7-f748-4f21-bad4-2f7e4ba406c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:58.590138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c68d7-f748-4f21-bad4-2f7e4ba406c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:58.601224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c68d7-f748-4f21-bad4-2f7e4ba406c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:58.602699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c68d7-f748-4f21-bad4-2f7e4ba406c1 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-d09c68d7-f748-4f21-bad4-2f7e4ba406c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:57:58.624194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:58.625999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:58.627561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:58.627561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:58.627561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:57:58.627561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:57:58.627561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:57:58.627561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:57:58.627561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:57:58.627561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:57:58.627561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:57:58.627561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:58.630844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 469/938] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Sep 7 15:57:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:58.636901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151abb42-d09c-41b6-8d12-d08d5c959a74 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:58.745424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151abb42-d09c-41b6-8d12-d08d5c959a74 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:58.764934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:58.783859 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7327e-88a8-49e5-b37c-226c2046711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:58.784477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7327e-88a8-49e5-b37c-226c2046711e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:58.784788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7327e-88a8-49e5-b37c-226c2046711e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:58.785062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7327e-88a8-49e5-b37c-226c2046711e None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:58.785805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7327e-88a8-49e5-b37c-226c2046711e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:58.786112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7327e-88a8-49e5-b37c-226c2046711e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:58.787560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7327e-88a8-49e5-b37c-226c2046711e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:58.806832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 470/939] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Sep 7 15:57:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:58.816722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c68d7-f748-4f21-bad4-2f7e4ba406c1 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:58.986788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58189ae8-1919-426d-ade8-c213150a7d0a None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:58.987123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58189ae8-1919-426d-ade8-c213150a7d0a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:58.987438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58189ae8-1919-426d-ade8-c213150a7d0a None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:58.990299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 471/940] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:58.994585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e784d3-f3e9-412f-9104-9fb01a1e7c0c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:58.994875 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e784d3-f3e9-412f-9104-9fb01a1e7c0c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:58.995157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e784d3-f3e9-412f-9104-9fb01a1e7c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:59.011813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c68d7-f748-4f21-bad4-2f7e4ba406c1 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:59.019832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-44e784d3-f3e9-412f-9104-9fb01a1e7c0c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:59.021127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-44e784d3-f3e9-412f-9104-9fb01a1e7c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:59.064758 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5803841-0cea-45f8-9fb1-a88dce750f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:59.065658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5803841-0cea-45f8-9fb1-a88dce750f35 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:59.066044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5803841-0cea-45f8-9fb1-a88dce750f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:59.066425 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5803841-0cea-45f8-9fb1-a88dce750f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:59.079957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5803841-0cea-45f8-9fb1-a88dce750f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:59.081711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5803841-0cea-45f8-9fb1-a88dce750f35 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-a5803841-0cea-45f8-9fb1-a88dce750f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:57:59.098914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:59.101087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:57:59.102957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:57:59.102957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:57:59.102957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:59.104784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 470/941] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:59.109770 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5803841-0cea-45f8-9fb1-a88dce750f35 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:59.137283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:59.150335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 472/942] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:57:59.238930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5803841-0cea-45f8-9fb1-a88dce750f35 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:59.276045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a6ec-81ad-4b6f-a8f3-d534abf871d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:59.277425 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a6ec-81ad-4b6f-a8f3-d534abf871d3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:59.277935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a6ec-81ad-4b6f-a8f3-d534abf871d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:59.278403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a6ec-81ad-4b6f-a8f3-d534abf871d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:59.279502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a6ec-81ad-4b6f-a8f3-d534abf871d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:59.280023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a6ec-81ad-4b6f-a8f3-d534abf871d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:59.281635 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a6ec-81ad-4b6f-a8f3-d534abf871d3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:59.295664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 471/943] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:59.302143 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e784d3-f3e9-412f-9104-9fb01a1e7c0c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:59.429988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e784d3-f3e9-412f-9104-9fb01a1e7c0c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:59.440291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:59.475450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5a79d-414e-4b61-8545-be17fadaa969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:59.476096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5a79d-414e-4b61-8545-be17fadaa969 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:59.476380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5a79d-414e-4b61-8545-be17fadaa969 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:59.476656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5a79d-414e-4b61-8545-be17fadaa969 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:59.484102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a6ec-81ad-4b6f-a8f3-d534abf871d3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:59.484988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5a79d-414e-4b61-8545-be17fadaa969 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:59.486513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5a79d-414e-4b61-8545-be17fadaa969 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-e6c5a79d-414e-4b61-8545-be17fadaa969 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:59.501124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:59.502088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:59.502977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:59.502977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:59.502977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:59.502977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:59.502977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:59.502977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:59.502977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:59.502977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:57:59.507391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 473/944] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:59.508658 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5a79d-414e-4b61-8545-be17fadaa969 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:59.585783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:59.614123 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a6ec-81ad-4b6f-a8f3-d534abf871d3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:59.621863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5a79d-414e-4b61-8545-be17fadaa969 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:59.663485 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac22b0a-ee65-4b26-a47a-a3e36736cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:59.664100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22b0a-ee65-4b26-a47a-a3e36736cf00 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:59.664377 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22b0a-ee65-4b26-a47a-a3e36736cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:59.664650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22b0a-ee65-4b26-a47a-a3e36736cf00 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:59.665336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac22b0a-ee65-4b26-a47a-a3e36736cf00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:59.666872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac22b0a-ee65-4b26-a47a-a3e36736cf00 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:59.670174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: WARNING keystone.server.flask.common [None req-6ac22b0a-ee65-4b26-a47a-a3e36736cf00 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 07 15:57:59.690729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.sql.core [None req-6ac22b0a-ee65-4b26-a47a-a3e36736cf00 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 15:57:59.690729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 15:57:59.690729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [parameters: {'id': '07b5242de2a646bcb5b539c9e669b290', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 15:57:59.690729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81620) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 15:57:59.697183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778bb81-b901-4b73-aca2-76af6c1fa404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:59.697802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778bb81-b901-4b73-aca2-76af6c1fa404 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:59.698079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778bb81-b901-4b73-aca2-76af6c1fa404 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:59.698346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778bb81-b901-4b73-aca2-76af6c1fa404 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:59.699785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778bb81-b901-4b73-aca2-76af6c1fa404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:59.700321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778bb81-b901-4b73-aca2-76af6c1fa404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:59.701886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778bb81-b901-4b73-aca2-76af6c1fa404 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-6ac22b0a-ee65-4b26-a47a-a3e36736cf00 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 07b5242de2a646bcb5b539c9e669b290.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 07b5242de2a646bcb5b539c9e669b290. Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application conn.query(q) Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 15:57:59.702296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result.read() Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 07 15:57:59.703061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application next(self.gen) Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application yield resource Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application next(self.gen) Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise self.value Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application session.commit() Sep 07 15:57:59.704932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.session.flush() Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application compat.raise_( Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 15:57:59.705898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 15:57:59.706823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application conn.query(q) Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result.read() Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 15:57:59.707610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [parameters: {'id': '07b5242de2a646bcb5b539c9e669b290', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:59.711581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:59.713647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:59.718266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:59.718266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 07 15:57:59.718266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 07 15:57:59.718266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:59.718266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:59.718266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 07 15:57:59.718266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 07 15:57:59.718266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 07b5242de2a646bcb5b539c9e669b290. Sep 07 15:57:59.718266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:59.718266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 472/945] 10.222.0.43 () {60 vars in 1140 bytes} [Wed Sep 7 15:57:59 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:59.718266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067adf20-7c42-4489-b5b8-a3c6d3f2be0c None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:59.718266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067adf20-7c42-4489-b5b8-a3c6d3f2be0c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:59.720631 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067adf20-7c42-4489-b5b8-a3c6d3f2be0c None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:59.720631 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 473/946] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:57:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:57:59.720631 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067adf20-7c42-4489-b5b8-a3c6d3f2be0c None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:59.731638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 474/947] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:57:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:59.731638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7511-113b-45ac-98a5-1b4b5574472c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:59.731638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7511-113b-45ac-98a5-1b4b5574472c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:59.731638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7511-113b-45ac-98a5-1b4b5574472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:59.747316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-e64e7511-113b-45ac-98a5-1b4b5574472c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:59.748505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e64e7511-113b-45ac-98a5-1b4b5574472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:59.772233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:59.837282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 475/948] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:57:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:57:59.837282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e7511-113b-45ac-98a5-1b4b5574472c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:59.856767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067adf20-7c42-4489-b5b8-a3c6d3f2be0c None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:59.894220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:59.902233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29c79c-d35e-4e80-a45b-728970fea4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:59.902826 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29c79c-d35e-4e80-a45b-728970fea4da None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:59.903204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29c79c-d35e-4e80-a45b-728970fea4da None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:59.903690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29c79c-d35e-4e80-a45b-728970fea4da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:59.914177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29c79c-d35e-4e80-a45b-728970fea4da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:59.916280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29c79c-d35e-4e80-a45b-728970fea4da None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-8f29c79c-d35e-4e80-a45b-728970fea4da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:57:59.930340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:57:59.931310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:57:59.932193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:57:59.932193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:57:59.932193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:57:59.932193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:57:59.932193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:57:59.932193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:57:59.932193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:57:59.932193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:57:59.934443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 474/949] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:57:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:57:59.941556 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29c79c-d35e-4e80-a45b-728970fea4da None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:59.983137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e7511-113b-45ac-98a5-1b4b5574472c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:00.036509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d36c8-d0fb-465f-8e51-e51db532ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:00.037400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d36c8-d0fb-465f-8e51-e51db532ca2c None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:00.037719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d36c8-d0fb-465f-8e51-e51db532ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:00.038059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d36c8-d0fb-465f-8e51-e51db532ca2c None admin] PATH_INFO: `/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/c0fa7d339c134c20b471170e13bbb9de/roles/b57f3b4978524f40ad698b68b0f919fd` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:00.041240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d36c8-d0fb-465f-8e51-e51db532ca2c None admin] RBAC: Authorizing `identity:create_grant(project_id=983beac5fc784756b6bdf11b07e219ac, user_id=c0fa7d339c134c20b471170e13bbb9de, role_id=b57f3b4978524f40ad698b68b0f919fd)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:00.043351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d36c8-d0fb-465f-8e51-e51db532ca2c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:00.066346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 476/950] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:57:59 2022] PUT /identity/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/c0fa7d339c134c20b471170e13bbb9de/roles/b57f3b4978524f40ad698b68b0f919fd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:00.155913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29c79c-d35e-4e80-a45b-728970fea4da None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:00.158819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d36c8-d0fb-465f-8e51-e51db532ca2c None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:00.188037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:00.224072 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2f731-6616-46c7-ade4-998179639bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:00.225117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2f731-6616-46c7-ade4-998179639bac None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:00.225585 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2f731-6616-46c7-ade4-998179639bac None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:00.226034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2f731-6616-46c7-ade4-998179639bac None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:00.226930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2f731-6616-46c7-ade4-998179639bac None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:00.227429 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2f731-6616-46c7-ade4-998179639bac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:00.229453 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2f731-6616-46c7-ade4-998179639bac None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:00.256994 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 475/951] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:57:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:00.333302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d36c8-d0fb-465f-8e51-e51db532ca2c None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:00.399952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382082dc-07d4-4758-ba31-bfad9539db93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:00.401066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382082dc-07d4-4758-ba31-bfad9539db93 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:00.401656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382082dc-07d4-4758-ba31-bfad9539db93 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:00.402207 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382082dc-07d4-4758-ba31-bfad9539db93 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:00.403066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382082dc-07d4-4758-ba31-bfad9539db93 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:00.404899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382082dc-07d4-4758-ba31-bfad9539db93 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-382082dc-07d4-4758-ba31-bfad9539db93 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:00.416512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:00.418085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:58:00.419144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:00.422663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 477/952] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Sep 7 15:58:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:00.429528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2f731-6616-46c7-ade4-998179639bac None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:00.522268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:00.585643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e222cae-5949-4ada-8bbf-7f38dc3befbf None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:00.585950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e222cae-5949-4ada-8bbf-7f38dc3befbf None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:00.586128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e222cae-5949-4ada-8bbf-7f38dc3befbf None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:00.587507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 478/953] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:58:00.594535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c05559-5fd5-4318-a494-bbe039672251 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:00.594980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c05559-5fd5-4318-a494-bbe039672251 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:00.595353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c05559-5fd5-4318-a494-bbe039672251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:00.596394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2f731-6616-46c7-ade4-998179639bac None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:00.623495 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-e7c05559-5fd5-4318-a494-bbe039672251 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:00.625573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e7c05559-5fd5-4318-a494-bbe039672251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:00.644506 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a35e03-b167-4a64-9a06-11a99d87fa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:00.645456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a35e03-b167-4a64-9a06-11a99d87fa7b None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:00.645883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a35e03-b167-4a64-9a06-11a99d87fa7b None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:00.646293 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a35e03-b167-4a64-9a06-11a99d87fa7b None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:00.647266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a35e03-b167-4a64-9a06-11a99d87fa7b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:00.647728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a35e03-b167-4a64-9a06-11a99d87fa7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:00.650035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a35e03-b167-4a64-9a06-11a99d87fa7b None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:00.660913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 476/954] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Sep 7 15:58:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:00.666149 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a35e03-b167-4a64-9a06-11a99d87fa7b None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:00.752719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 479/955] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:58:00.797918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a35e03-b167-4a64-9a06-11a99d87fa7b None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:00.817930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:00.841701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b36b21-936a-4b36-b72b-b101755214f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:00.842312 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b36b21-936a-4b36-b72b-b101755214f6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:00.842602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b36b21-936a-4b36-b72b-b101755214f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:00.842879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b36b21-936a-4b36-b72b-b101755214f6 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:00.843592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b36b21-936a-4b36-b72b-b101755214f6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:00.843944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b36b21-936a-4b36-b72b-b101755214f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:00.845400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b36b21-936a-4b36-b72b-b101755214f6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:00.852603 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 477/956] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Sep 7 15:58:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:00.859420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c05559-5fd5-4318-a494-bbe039672251 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:00.874065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:00.996902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c05559-5fd5-4318-a494-bbe039672251 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:01.051063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4158d25-22e1-4d1e-905e-67db53ae1fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:01.051685 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4158d25-22e1-4d1e-905e-67db53ae1fb3 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:01.051964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4158d25-22e1-4d1e-905e-67db53ae1fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:01.052237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4158d25-22e1-4d1e-905e-67db53ae1fb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:01.052969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4158d25-22e1-4d1e-905e-67db53ae1fb3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:01.054635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4158d25-22e1-4d1e-905e-67db53ae1fb3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:01.077931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b36b21-936a-4b36-b72b-b101755214f6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:01.108866 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 480/957] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 15:58:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:58:01.237260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b36b21-936a-4b36-b72b-b101755214f6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:01.289799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbffb4-8020-4cca-a639-72f4fe4cde84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:01.290896 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbffb4-8020-4cca-a639-72f4fe4cde84 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:01.291446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbffb4-8020-4cca-a639-72f4fe4cde84 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:01.291867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbffb4-8020-4cca-a639-72f4fe4cde84 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:01.293323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbffb4-8020-4cca-a639-72f4fe4cde84 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:01.295683 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbffb4-8020-4cca-a639-72f4fe4cde84 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-e3bbffb4-8020-4cca-a639-72f4fe4cde84 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:01.306522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:01.307845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:58:01.309448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:01.311933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 478/958] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:58:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:01.322389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4158d25-22e1-4d1e-905e-67db53ae1fb3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:01.418388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:01.470728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4158d25-22e1-4d1e-905e-67db53ae1fb3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:01.507417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42573b-fb5d-4db9-917d-1b71e9ab87b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:01.508034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42573b-fb5d-4db9-917d-1b71e9ab87b9 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:01.508311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42573b-fb5d-4db9-917d-1b71e9ab87b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:01.508583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42573b-fb5d-4db9-917d-1b71e9ab87b9 None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:01.509243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42573b-fb5d-4db9-917d-1b71e9ab87b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:01.509539 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42573b-fb5d-4db9-917d-1b71e9ab87b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:01.510896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42573b-fb5d-4db9-917d-1b71e9ab87b9 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:01.520972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 481/959] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:58:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:01.522810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbffb4-8020-4cca-a639-72f4fe4cde84 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:01.570394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:01.641459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbffb4-8020-4cca-a639-72f4fe4cde84 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:01.680536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cc9c8-0b28-4460-90c3-6e11cbb8ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:01.681399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cc9c8-0b28-4460-90c3-6e11cbb8ed7c None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:01.681852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cc9c8-0b28-4460-90c3-6e11cbb8ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:01.682273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cc9c8-0b28-4460-90c3-6e11cbb8ed7c None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:01.683570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cc9c8-0b28-4460-90c3-6e11cbb8ed7c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:01.684023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cc9c8-0b28-4460-90c3-6e11cbb8ed7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:01.685611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cc9c8-0b28-4460-90c3-6e11cbb8ed7c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:01.691534 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 479/960] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:58:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:02.454313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29324b0-d995-4daf-919a-923db65cd693 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:02.454839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29324b0-d995-4daf-919a-923db65cd693 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:02.454839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29324b0-d995-4daf-919a-923db65cd693 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:02.456484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 482/961] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:02.462177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae42bf7-bad0-42a8-b620-489c9b7af6d2 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:02.462644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae42bf7-bad0-42a8-b620-489c9b7af6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:02.462738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae42bf7-bad0-42a8-b620-489c9b7af6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:02.483172 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-1ae42bf7-bad0-42a8-b620-489c9b7af6d2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:02.484733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1ae42bf7-bad0-42a8-b620-489c9b7af6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:02.561652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 480/962] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:02.836711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29324b0-d995-4daf-919a-923db65cd693 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:02.905741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29031cd1-1dcb-4169-a57d-33dc2a93fcea None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:02.906388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29031cd1-1dcb-4169-a57d-33dc2a93fcea None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:02.906863 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29031cd1-1dcb-4169-a57d-33dc2a93fcea None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:02.908676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 481/963] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:02.914134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540ee96-f4de-4676-952e-641f007b6486 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:02.914422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540ee96-f4de-4676-952e-641f007b6486 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:02.914704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540ee96-f4de-4676-952e-641f007b6486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:02.934960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-3540ee96-f4de-4676-952e-641f007b6486 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:02.936166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3540ee96-f4de-4676-952e-641f007b6486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:02.954675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29324b0-d995-4daf-919a-923db65cd693 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:02.967272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:02.994605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:03.002067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f984db-0cef-43ec-a5f9-4c112176c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:03.003107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f984db-0cef-43ec-a5f9-4c112176c17c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.003648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f984db-0cef-43ec-a5f9-4c112176c17c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.004125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f984db-0cef-43ec-a5f9-4c112176c17c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.019958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f984db-0cef-43ec-a5f9-4c112176c17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:58:03.022237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 482/964] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-57f984db-0cef-43ec-a5f9-4c112176c17c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:58:03.025921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:03.027374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:03.028296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:03.028296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:03.028296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:03.028296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:03.028296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:58:03.028296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:58:03.028296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:58:03.028296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:58:03.028296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:58:03.028296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:58:03.028296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:58:03.028296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:03.031646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 483/965] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Sep 7 15:58:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:03.037223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540ee96-f4de-4676-952e-641f007b6486 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:03.151122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540ee96-f4de-4676-952e-641f007b6486 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:03.189139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436ae43-5bdc-4db6-a126-f0cbf41eb725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:03.190131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436ae43-5bdc-4db6-a126-f0cbf41eb725 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.190618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436ae43-5bdc-4db6-a126-f0cbf41eb725 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.191094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436ae43-5bdc-4db6-a126-f0cbf41eb725 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.191970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436ae43-5bdc-4db6-a126-f0cbf41eb725 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:03.192490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436ae43-5bdc-4db6-a126-f0cbf41eb725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:03.194165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436ae43-5bdc-4db6-a126-f0cbf41eb725 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:03.203778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 483/966] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Sep 7 15:58:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:03.209243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f984db-0cef-43ec-a5f9-4c112176c17c None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:03.316979 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436ae43-5bdc-4db6-a126-f0cbf41eb725 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:03.318735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f984db-0cef-43ec-a5f9-4c112176c17c None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:03.352226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:03.360306 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ae71f-624a-4079-bb19-69f8ae8a8feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:03.360981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ae71f-624a-4079-bb19-69f8ae8a8feb None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.361265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ae71f-624a-4079-bb19-69f8ae8a8feb None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.361539 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ae71f-624a-4079-bb19-69f8ae8a8feb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.375250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ae71f-624a-4079-bb19-69f8ae8a8feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:03.376734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ae71f-624a-4079-bb19-69f8ae8a8feb None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-733ae71f-624a-4079-bb19-69f8ae8a8feb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:58:03.392651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:03.393990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:58:03.395503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:58:03.395503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:03.395503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:03.395503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 484/967] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:03.400237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ae71f-624a-4079-bb19-69f8ae8a8feb None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:03.456012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:03.463466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436ae43-5bdc-4db6-a126-f0cbf41eb725 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:03.515005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbe6ab-057e-4324-aa05-489fac833611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:03.515658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbe6ab-057e-4324-aa05-489fac833611 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.515912 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbe6ab-057e-4324-aa05-489fac833611 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.516208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbe6ab-057e-4324-aa05-489fac833611 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.516999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbe6ab-057e-4324-aa05-489fac833611 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:03.518505 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbe6ab-057e-4324-aa05-489fac833611 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:03.525404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ae71f-624a-4079-bb19-69f8ae8a8feb None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:03.535102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.sql.core [None req-b3dbe6ab-057e-4324-aa05-489fac833611 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 15:58:03.535102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 15:58:03.535102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [parameters: {'user_id': '3573a43e1bc44a24a19df695b4b431dc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 15:58:03.535102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81620) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-b3dbe6ab-057e-4324-aa05-489fac833611 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application conn.query(q) Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result.read() Sep 07 15:58:03.542314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 15:58:03.544520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application next(self.gen) Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application yield resource Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application next(self.gen) Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise self.value Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application session.commit() Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 15:58:03.545663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.session.flush() Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application compat.raise_( Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 15:58:03.546582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 15:58:03.547498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application conn.query(q) Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application result.read() Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 15:58:03.548370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [parameters: {'user_id': '3573a43e1bc44a24a19df695b4b431dc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:03.551188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 07 15:58:03.553750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 07 15:58:03.556610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 07 15:58:03.556610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 07 15:58:03.556610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 15:58:03.556610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 15:58:03.556610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 15:58:03.556610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:03.556610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 484/968] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Sep 7 15:58:03 2022] POST /identity/v3/users => generated 160 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:58:03.556610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0988af-b89a-417c-99b3-599967350017 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.556610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0988af-b89a-417c-99b3-599967350017 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.556610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0988af-b89a-417c-99b3-599967350017 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.559818 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 485/969] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:03.559818 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0988af-b89a-417c-99b3-599967350017 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:03.572860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c4404-e90e-40cd-8b13-551f923a970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:03.573485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c4404-e90e-40cd-8b13-551f923a970e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.573857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c4404-e90e-40cd-8b13-551f923a970e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.574177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c4404-e90e-40cd-8b13-551f923a970e None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.574799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c4404-e90e-40cd-8b13-551f923a970e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:03.575201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c4404-e90e-40cd-8b13-551f923a970e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:03.576466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c4404-e90e-40cd-8b13-551f923a970e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:03.595059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 485/970] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:03.596470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63991-2be9-496f-8f7e-8384e82bf84a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.596783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63991-2be9-496f-8f7e-8384e82bf84a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.597063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63991-2be9-496f-8f7e-8384e82bf84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.615906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-68f63991-2be9-496f-8f7e-8384e82bf84a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:03.617149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-68f63991-2be9-496f-8f7e-8384e82bf84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:03.654879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:03.672892 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0988af-b89a-417c-99b3-599967350017 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:03.690624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 486/971] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:03.691472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f63991-2be9-496f-8f7e-8384e82bf84a None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:03.717189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afb337-70fa-43c0-a328-6868a3dd83aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:03.718110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afb337-70fa-43c0-a328-6868a3dd83aa None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.718609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afb337-70fa-43c0-a328-6868a3dd83aa None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.719064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afb337-70fa-43c0-a328-6868a3dd83aa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.727117 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:03.728745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afb337-70fa-43c0-a328-6868a3dd83aa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:03.731390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afb337-70fa-43c0-a328-6868a3dd83aa None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-f2afb337-70fa-43c0-a328-6868a3dd83aa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:58:03.745318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:03.746468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:03.747430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:03.747430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:03.747430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:58:03.747430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:58:03.747430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:58:03.747430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:58:03.747430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:58:03.747430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:58:03.747430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:58:03.747430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:03.749941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 486/972] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:58:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:03.755318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afb337-70fa-43c0-a328-6868a3dd83aa None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:03.817772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f63991-2be9-496f-8f7e-8384e82bf84a None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:03.865301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec990d-9e40-4b93-a4f0-b81cb8e00a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:03.866326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec990d-9e40-4b93-a4f0-b81cb8e00a7d None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.866770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec990d-9e40-4b93-a4f0-b81cb8e00a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.867203 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec990d-9e40-4b93-a4f0-b81cb8e00a7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.877923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec990d-9e40-4b93-a4f0-b81cb8e00a7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:03.879951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec990d-9e40-4b93-a4f0-b81cb8e00a7d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-f5ec990d-9e40-4b93-a4f0-b81cb8e00a7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:58:03.897338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:03.898481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:03.899450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:03.899450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:03.899450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:58:03.899450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:58:03.899450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:58:03.899450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:58:03.899450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:58:03.899450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:58:03.899450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:58:03.899450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:03.899450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 487/973] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Sep 7 15:58:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:03.902618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afb337-70fa-43c0-a328-6868a3dd83aa None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:03.906000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec990d-9e40-4b93-a4f0-b81cb8e00a7d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:03.945093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68942744-0b62-42bd-98cf-5aecf8437f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:03.946061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942744-0b62-42bd-98cf-5aecf8437f48 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.946536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942744-0b62-42bd-98cf-5aecf8437f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.946993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942744-0b62-42bd-98cf-5aecf8437f48 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.947897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68942744-0b62-42bd-98cf-5aecf8437f48 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:03.948380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68942744-0b62-42bd-98cf-5aecf8437f48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:03.951088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68942744-0b62-42bd-98cf-5aecf8437f48 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:03.990201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 487/974] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Sep 7 15:58:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:03.991342 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68942744-0b62-42bd-98cf-5aecf8437f48 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:04.004981 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:04.033279 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:04.044471 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec990d-9e40-4b93-a4f0-b81cb8e00a7d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:04.084188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b8853-b850-42a6-bc8a-9487c15e8af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:04.084882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b8853-b850-42a6-bc8a-9487c15e8af1 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:04.085161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b8853-b850-42a6-bc8a-9487c15e8af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:04.085432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b8853-b850-42a6-bc8a-9487c15e8af1 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:04.086188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b8853-b850-42a6-bc8a-9487c15e8af1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:04.086493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b8853-b850-42a6-bc8a-9487c15e8af1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:04.087963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b8853-b850-42a6-bc8a-9487c15e8af1 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:04.109873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 488/975] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Sep 7 15:58:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:04.111682 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190d8da-dca8-42a4-8d0f-d44cc5cc6c17 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:04.112189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190d8da-dca8-42a4-8d0f-d44cc5cc6c17 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:04.112720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190d8da-dca8-42a4-8d0f-d44cc5cc6c17 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:04.114808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 489/976] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:04.115606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190d8da-dca8-42a4-8d0f-d44cc5cc6c17 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:04.142750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68942744-0b62-42bd-98cf-5aecf8437f48 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:04.187624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa610ecc-eefa-47a8-baf4-3276639c09d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:04.188337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa610ecc-eefa-47a8-baf4-3276639c09d5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:04.188651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa610ecc-eefa-47a8-baf4-3276639c09d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:04.189012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa610ecc-eefa-47a8-baf4-3276639c09d5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:04.189622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa610ecc-eefa-47a8-baf4-3276639c09d5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:04.191001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa610ecc-eefa-47a8-baf4-3276639c09d5 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-aa610ecc-eefa-47a8-baf4-3276639c09d5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:04.204798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:04.205918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:58:04.206784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:04.208621 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 488/977] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Sep 7 15:58:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:04.210907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577516fd-1c9d-4891-ad74-7b9e8850e9fa None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:04.211497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577516fd-1c9d-4891-ad74-7b9e8850e9fa None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:04.211773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577516fd-1c9d-4891-ad74-7b9e8850e9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:04.235038 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-577516fd-1c9d-4891-ad74-7b9e8850e9fa None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:04.236600 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-577516fd-1c9d-4891-ad74-7b9e8850e9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:04.253530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190d8da-dca8-42a4-8d0f-d44cc5cc6c17 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:04.303624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e3e0c-9000-4449-a468-a150ef8d688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:04.304487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e3e0c-9000-4449-a468-a150ef8d688c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:04.304953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e3e0c-9000-4449-a468-a150ef8d688c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:04.305372 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e3e0c-9000-4449-a468-a150ef8d688c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:04.329345 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:04.332158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:04.338124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 489/978] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:04.338958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577516fd-1c9d-4891-ad74-7b9e8850e9fa None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:04.396427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e3e0c-9000-4449-a468-a150ef8d688c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:04.400236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e3e0c-9000-4449-a468-a150ef8d688c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:04.476020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577516fd-1c9d-4891-ad74-7b9e8850e9fa None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:04.516862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f4d4f-f80e-4688-b815-b94d2a55a072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:04.517389 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f4d4f-f80e-4688-b815-b94d2a55a072 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:04.517667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f4d4f-f80e-4688-b815-b94d2a55a072 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:04.517985 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f4d4f-f80e-4688-b815-b94d2a55a072 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:04.518558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f4d4f-f80e-4688-b815-b94d2a55a072 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:04.519259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f4d4f-f80e-4688-b815-b94d2a55a072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:04.520471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f4d4f-f80e-4688-b815-b94d2a55a072 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:04.525454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 490/979] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Sep 7 15:58:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:04.531607 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f4d4f-f80e-4688-b815-b94d2a55a072 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:04.538436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 490/980] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:58:04 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:58:04.539426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e3e0c-9000-4449-a468-a150ef8d688c None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:04.593278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:04.603506 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:04.646363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f4d4f-f80e-4688-b815-b94d2a55a072 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:04.650481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e3e0c-9000-4449-a468-a150ef8d688c None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:04.681490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfabf84-fa1c-4d88-b589-63362cad1454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:04.682096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfabf84-fa1c-4d88-b589-63362cad1454 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:04.682373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfabf84-fa1c-4d88-b589-63362cad1454 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:04.682643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfabf84-fa1c-4d88-b589-63362cad1454 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:04.683804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfabf84-fa1c-4d88-b589-63362cad1454 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:04.684110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfabf84-fa1c-4d88-b589-63362cad1454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:04.685503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfabf84-fa1c-4d88-b589-63362cad1454 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:04.686363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e37954-9881-4f3e-8238-b6afe427d8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:04.687032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e37954-9881-4f3e-8238-b6afe427d8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:04.687323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e37954-9881-4f3e-8238-b6afe427d8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:04.687594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e37954-9881-4f3e-8238-b6afe427d8c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:04.690494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 491/981] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Sep 7 15:58:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:04.691261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfabf84-fa1c-4d88-b589-63362cad1454 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:04.700109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e37954-9881-4f3e-8238-b6afe427d8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:04.701629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e37954-9881-4f3e-8238-b6afe427d8c7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-d8e37954-9881-4f3e-8238-b6afe427d8c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:58:04.716633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:04.717660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:58:04.719209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:58:04.719209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:04.719209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:04.719209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 491/982] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:58:04.719209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e37954-9881-4f3e-8238-b6afe427d8c7 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:04.806058 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfabf84-fa1c-4d88-b589-63362cad1454 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:04.824536 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e37954-9881-4f3e-8238-b6afe427d8c7 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:04.826271 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:04.833269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:04.841079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde3191-12db-41f6-bc86-10e57792040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:04.841687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde3191-12db-41f6-bc86-10e57792040f None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:04.841963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde3191-12db-41f6-bc86-10e57792040f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:04.842231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde3191-12db-41f6-bc86-10e57792040f None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:04.842886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde3191-12db-41f6-bc86-10e57792040f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:04.844249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde3191-12db-41f6-bc86-10e57792040f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:04.859374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 492/983] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:58:04 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:58:04.860205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde3191-12db-41f6-bc86-10e57792040f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:04.874787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f30ef-c99a-4cf3-a25c-f8e28b43e7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:04.875423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f30ef-c99a-4cf3-a25c-f8e28b43e7bd None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:04.875706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f30ef-c99a-4cf3-a25c-f8e28b43e7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:04.875982 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f30ef-c99a-4cf3-a25c-f8e28b43e7bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:04.876765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f30ef-c99a-4cf3-a25c-f8e28b43e7bd None admin] RBAC: Adding query filter params (interface=admin, service_id=cd1c3e78a85c4585b0117479d9da0437, region_id=RegionOne) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:04.877116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f30ef-c99a-4cf3-a25c-f8e28b43e7bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:04.878502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f30ef-c99a-4cf3-a25c-f8e28b43e7bd None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:04.888885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 492/984] 10.222.0.43 () {56 vars in 1249 bytes} [Wed Sep 7 15:58:04 2022] GET /identity/v3/endpoints?service_id=cd1c3e78a85c4585b0117479d9da0437&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:04.891071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f30ef-c99a-4cf3-a25c-f8e28b43e7bd None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:04.999206 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde3191-12db-41f6-bc86-10e57792040f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:05.018391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f30ef-c99a-4cf3-a25c-f8e28b43e7bd None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:05.047268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c423116-141f-43ae-9cca-89e69e42a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:05.047805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c423116-141f-43ae-9cca-89e69e42a9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:05.048978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c423116-141f-43ae-9cca-89e69e42a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:05.048978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c423116-141f-43ae-9cca-89e69e42a9f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:05.049361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c423116-141f-43ae-9cca-89e69e42a9f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:05.049671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c423116-141f-43ae-9cca-89e69e42a9f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:05.051055 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c423116-141f-43ae-9cca-89e69e42a9f6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:05.057135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56082b-e1f6-4898-ab6a-b9669fb59ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:05.057689 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56082b-e1f6-4898-ab6a-b9669fb59ada None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:05.058444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56082b-e1f6-4898-ab6a-b9669fb59ada None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:05.058773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56082b-e1f6-4898-ab6a-b9669fb59ada None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:05.059473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56082b-e1f6-4898-ab6a-b9669fb59ada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:05.060959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56082b-e1f6-4898-ab6a-b9669fb59ada None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:05.066997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 493/985] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:05.067879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 493/986] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Sep 7 15:58:04 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:58:05.072825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c423116-141f-43ae-9cca-89e69e42a9f6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:05.131204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:05.197173 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c423116-141f-43ae-9cca-89e69e42a9f6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:05.237323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2a1a8-cd88-44ea-baa9-5afa69f03d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:05.237970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2a1a8-cd88-44ea-baa9-5afa69f03d6c None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:05.238251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2a1a8-cd88-44ea-baa9-5afa69f03d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:05.238523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2a1a8-cd88-44ea-baa9-5afa69f03d6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:05.247705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2a1a8-cd88-44ea-baa9-5afa69f03d6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:05.249772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2a1a8-cd88-44ea-baa9-5afa69f03d6c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-3aa2a1a8-cd88-44ea-baa9-5afa69f03d6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:58:05.262795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:05.263772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:05.264723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:58:05.264723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:58:05.264723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:58:05.264723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:58:05.264723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:58:05.264723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:58:05.264723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:58:05.264723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:05.264723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 494/987] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:05.270107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56082b-e1f6-4898-ab6a-b9669fb59ada None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:05.310333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:05.395781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56082b-e1f6-4898-ab6a-b9669fb59ada None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:05.434413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24067da1-fbf5-4382-b4dd-6a62d47c229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:05.435035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24067da1-fbf5-4382-b4dd-6a62d47c229a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:05.435316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24067da1-fbf5-4382-b4dd-6a62d47c229a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:05.435591 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24067da1-fbf5-4382-b4dd-6a62d47c229a None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:05.436287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24067da1-fbf5-4382-b4dd-6a62d47c229a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:05.436591 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24067da1-fbf5-4382-b4dd-6a62d47c229a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:05.438057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24067da1-fbf5-4382-b4dd-6a62d47c229a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:05.451403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 494/988] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:58:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:05.457687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2a1a8-cd88-44ea-baa9-5afa69f03d6c None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:05.563845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2a1a8-cd88-44ea-baa9-5afa69f03d6c None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:05.573014 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:05.601187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc17f3-87f0-4310-9081-bcccdcbfa442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:05.601799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc17f3-87f0-4310-9081-bcccdcbfa442 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:05.602078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc17f3-87f0-4310-9081-bcccdcbfa442 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:05.602350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc17f3-87f0-4310-9081-bcccdcbfa442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:05.603075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc17f3-87f0-4310-9081-bcccdcbfa442 None admin] RBAC: Adding query filter params (role.id=b57f3b4978524f40ad698b68b0f919fd, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=c0fa7d339c134c20b471170e13bbb9de) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:05.603381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc17f3-87f0-4310-9081-bcccdcbfa442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:05.607394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc17f3-87f0-4310-9081-bcccdcbfa442 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:05.612383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 495/989] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:58:05 2022] GET /identity/v3/role_assignments?user.id=c0fa7d339c134c20b471170e13bbb9de&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=b57f3b4978524f40ad698b68b0f919fd => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:07.140437 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea74ea-12ea-48c0-b626-10a05082add2 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:07.141035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea74ea-12ea-48c0-b626-10a05082add2 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:07.141035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea74ea-12ea-48c0-b626-10a05082add2 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:07.142427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 495/990] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:07.148510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17e1b-3342-4330-86e5-481b43fc6b83 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:07.149078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17e1b-3342-4330-86e5-481b43fc6b83 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:07.149078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17e1b-3342-4330-86e5-481b43fc6b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:07.168238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-eea17e1b-3342-4330-86e5-481b43fc6b83 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:07.169475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-eea17e1b-3342-4330-86e5-481b43fc6b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:07.247113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 496/991] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:58:07.549549 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea74ea-12ea-48c0-b626-10a05082add2 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:07.615536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f390d-0c9b-4b1d-a4ba-229a3f0c18a9 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:07.616594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f390d-0c9b-4b1d-a4ba-229a3f0c18a9 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:07.617000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f390d-0c9b-4b1d-a4ba-229a3f0c18a9 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:07.619438 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 497/992] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:07.626122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b56fbb-beda-4135-adde-0542b9ccda66 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:07.626493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b56fbb-beda-4135-adde-0542b9ccda66 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:07.627126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b56fbb-beda-4135-adde-0542b9ccda66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:07.648624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-70b56fbb-beda-4135-adde-0542b9ccda66 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:07.651159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-70b56fbb-beda-4135-adde-0542b9ccda66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:07.675157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:07.699840 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea74ea-12ea-48c0-b626-10a05082add2 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:07.744978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 498/993] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:58:07.747782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5c982-d7c4-4799-a8ae-1c42d90f99aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:07.748970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5c982-d7c4-4799-a8ae-1c42d90f99aa None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:07.749450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5c982-d7c4-4799-a8ae-1c42d90f99aa None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:07.749927 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5c982-d7c4-4799-a8ae-1c42d90f99aa None admin] PATH_INFO: `/v3/services/compute` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:07.750943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5c982-d7c4-4799-a8ae-1c42d90f99aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:07.752411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5c982-d7c4-4799-a8ae-1c42d90f99aa None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-25a5c982-d7c4-4799-a8ae-1c42d90f99aa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:07.763442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:07.769137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:07.770160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 496/994] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:58:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:07.773969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b56fbb-beda-4135-adde-0542b9ccda66 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:07.810950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:07.883130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e9f04-96a8-45a8-83c8-dcd6012c35ae None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:07.883494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e9f04-96a8-45a8-83c8-dcd6012c35ae None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:07.883850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e9f04-96a8-45a8-83c8-dcd6012c35ae None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:07.885696 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 497/995] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:58:07.896095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46abb57-8293-4c82-a2d3-5623e3d2166b None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:07.896095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46abb57-8293-4c82-a2d3-5623e3d2166b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:07.896095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46abb57-8293-4c82-a2d3-5623e3d2166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:07.901455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b56fbb-beda-4135-adde-0542b9ccda66 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:07.913121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-d46abb57-8293-4c82-a2d3-5623e3d2166b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:07.914335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d46abb57-8293-4c82-a2d3-5623e3d2166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:07.954040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720967f-bd62-4a3d-af9f-a8f68c544939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:07.954660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720967f-bd62-4a3d-af9f-a8f68c544939 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:07.954941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720967f-bd62-4a3d-af9f-a8f68c544939 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:07.955211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720967f-bd62-4a3d-af9f-a8f68c544939 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:07.955851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720967f-bd62-4a3d-af9f-a8f68c544939 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:07.956226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720967f-bd62-4a3d-af9f-a8f68c544939 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:07.957668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720967f-bd62-4a3d-af9f-a8f68c544939 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:07.963435 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 499/996] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:58:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:07.969545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720967f-bd62-4a3d-af9f-a8f68c544939 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:08.015149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 498/997] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:58:08.045088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46abb57-8293-4c82-a2d3-5623e3d2166b None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:08.120148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:08.131355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720967f-bd62-4a3d-af9f-a8f68c544939 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:08.161792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:08.192072 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442dc50-9d6d-411b-857f-c5bfbee4c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:08.193180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442dc50-9d6d-411b-857f-c5bfbee4c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:08.193662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442dc50-9d6d-411b-857f-c5bfbee4c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:08.194135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442dc50-9d6d-411b-857f-c5bfbee4c2b2 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:08.195222 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442dc50-9d6d-411b-857f-c5bfbee4c2b2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:08.195745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442dc50-9d6d-411b-857f-c5bfbee4c2b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:08.198275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442dc50-9d6d-411b-857f-c5bfbee4c2b2 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:08.199830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46abb57-8293-4c82-a2d3-5623e3d2166b None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:08.207684 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 500/998] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:58:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:08.213918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442dc50-9d6d-411b-857f-c5bfbee4c2b2 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:08.255217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e585d-4317-4c2d-8634-3abf19583ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:08.257148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e585d-4317-4c2d-8634-3abf19583ebb None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:08.257614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e585d-4317-4c2d-8634-3abf19583ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:08.258047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e585d-4317-4c2d-8634-3abf19583ebb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:08.258797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e585d-4317-4c2d-8634-3abf19583ebb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:08.260330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e585d-4317-4c2d-8634-3abf19583ebb None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-b74e585d-4317-4c2d-8634-3abf19583ebb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:08.273821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:08.275095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:58:08.276162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:08.280722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 499/999] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Sep 7 15:58:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:58:08.285180 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e585d-4317-4c2d-8634-3abf19583ebb None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:08.331673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442dc50-9d6d-411b-857f-c5bfbee4c2b2 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:08.369370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d5ff4-4155-4367-abbd-c7cd1185756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:08.369993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d5ff4-4155-4367-abbd-c7cd1185756f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:08.370378 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d5ff4-4155-4367-abbd-c7cd1185756f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:08.371318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d5ff4-4155-4367-abbd-c7cd1185756f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:08.372036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d5ff4-4155-4367-abbd-c7cd1185756f None admin] RBAC: Adding query filter params (interface=public, service_id=ae6ef58016424b08b3a67dee19b14000, region_id=RegionOne) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:08.372350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d5ff4-4155-4367-abbd-c7cd1185756f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:08.373779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d5ff4-4155-4367-abbd-c7cd1185756f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:08.378972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 501/1000] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Sep 7 15:58:08 2022] GET /identity/v3/endpoints?service_id=ae6ef58016424b08b3a67dee19b14000&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:08.379895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d5ff4-4155-4367-abbd-c7cd1185756f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:08.396169 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e585d-4317-4c2d-8634-3abf19583ebb None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:08.406934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:08.433116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462a552-03ad-4d34-b42a-001341166960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:08.433735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462a552-03ad-4d34-b42a-001341166960 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:08.434308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462a552-03ad-4d34-b42a-001341166960 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:08.434585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462a552-03ad-4d34-b42a-001341166960 None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:08.435233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462a552-03ad-4d34-b42a-001341166960 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:08.435524 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462a552-03ad-4d34-b42a-001341166960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:08.436919 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462a552-03ad-4d34-b42a-001341166960 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:08.441730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 500/1001] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Sep 7 15:58:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:08.442524 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462a552-03ad-4d34-b42a-001341166960 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:08.453724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:08.502486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d5ff4-4155-4367-abbd-c7cd1185756f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:08.537918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97069f-660d-459f-87b5-70777d60a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:08.538562 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97069f-660d-459f-87b5-70777d60a998 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:08.538852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97069f-660d-459f-87b5-70777d60a998 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:08.539128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97069f-660d-459f-87b5-70777d60a998 None admin] PATH_INFO: `/v3/services/image` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:08.539721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97069f-660d-459f-87b5-70777d60a998 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:08.541136 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97069f-660d-459f-87b5-70777d60a998 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-6d97069f-660d-459f-87b5-70777d60a998 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:08.550950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:08.552411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:58:08.553645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:08.554388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462a552-03ad-4d34-b42a-001341166960 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:08.554464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 502/1002] 10.222.0.43 () {56 vars in 1105 bytes} [Wed Sep 7 15:58:08 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:08.554464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97069f-660d-459f-87b5-70777d60a998 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:08.591713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbdf05-6b68-4c29-85fc-0a8c7b9c2dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:08.592237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbdf05-6b68-4c29-85fc-0a8c7b9c2dcb None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:08.592513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbdf05-6b68-4c29-85fc-0a8c7b9c2dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:08.592848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbdf05-6b68-4c29-85fc-0a8c7b9c2dcb None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:08.593626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbdf05-6b68-4c29-85fc-0a8c7b9c2dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:08.594993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbdf05-6b68-4c29-85fc-0a8c7b9c2dcb None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:08.601825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 501/1003] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Sep 7 15:58:08 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:58:08.602823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbdf05-6b68-4c29-85fc-0a8c7b9c2dcb None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:08.655187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:08.672289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97069f-660d-459f-87b5-70777d60a998 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:08.699085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:08.716167 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeac6f5-9afa-4a1a-9a92-f6750f09dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:08.716844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeac6f5-9afa-4a1a-9a92-f6750f09dd0b None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:08.717132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeac6f5-9afa-4a1a-9a92-f6750f09dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:08.717412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeac6f5-9afa-4a1a-9a92-f6750f09dd0b None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:08.718211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeac6f5-9afa-4a1a-9a92-f6750f09dd0b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:08.718413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeac6f5-9afa-4a1a-9a92-f6750f09dd0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:08.719780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeac6f5-9afa-4a1a-9a92-f6750f09dd0b None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:08.725587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 503/1004] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Sep 7 15:58:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:08.732227 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeac6f5-9afa-4a1a-9a92-f6750f09dd0b None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:08.739503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbdf05-6b68-4c29-85fc-0a8c7b9c2dcb None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:08.781338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372b501-1a69-4078-9bd1-37b4978e869c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:08.781971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372b501-1a69-4078-9bd1-37b4978e869c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:08.782755 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372b501-1a69-4078-9bd1-37b4978e869c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:08.783038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372b501-1a69-4078-9bd1-37b4978e869c None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:08.783679 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372b501-1a69-4078-9bd1-37b4978e869c None admin] RBAC: Adding query filter params (name=image) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:08.783990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372b501-1a69-4078-9bd1-37b4978e869c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:08.785415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372b501-1a69-4078-9bd1-37b4978e869c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:08.791724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 502/1005] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:08.798749 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372b501-1a69-4078-9bd1-37b4978e869c None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:08.858853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeac6f5-9afa-4a1a-9a92-f6750f09dd0b None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:08.895181 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66097eeb-5b34-4ca2-a2d2-aacfe60936dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:08.895686 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66097eeb-5b34-4ca2-a2d2-aacfe60936dc None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:08.895962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66097eeb-5b34-4ca2-a2d2-aacfe60936dc None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:08.896320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66097eeb-5b34-4ca2-a2d2-aacfe60936dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:08.896953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66097eeb-5b34-4ca2-a2d2-aacfe60936dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:08.898330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66097eeb-5b34-4ca2-a2d2-aacfe60936dc None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:08.924717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 504/1006] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 15:58:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:58:08.928711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372b501-1a69-4078-9bd1-37b4978e869c None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:08.971777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:08.978534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb851d6-062d-4056-b0b7-0f9d6d04ed34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:08.980180 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb851d6-062d-4056-b0b7-0f9d6d04ed34 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:08.980471 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb851d6-062d-4056-b0b7-0f9d6d04ed34 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:08.980796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb851d6-062d-4056-b0b7-0f9d6d04ed34 None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:08.981466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb851d6-062d-4056-b0b7-0f9d6d04ed34 None admin] RBAC: Adding query filter params (type=image) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:08.981775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb851d6-062d-4056-b0b7-0f9d6d04ed34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:08.983210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb851d6-062d-4056-b0b7-0f9d6d04ed34 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:08.992791 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 503/1007] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:10.883050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85aa57-ad77-406c-a1b3-5839fa0210bb None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:10.883626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85aa57-ad77-406c-a1b3-5839fa0210bb None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:10.883626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85aa57-ad77-406c-a1b3-5839fa0210bb None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:10.885247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 505/1008] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:10.890891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad77cbd-bd6b-41cc-8b93-d59a9876216e None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:10.891510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad77cbd-bd6b-41cc-8b93-d59a9876216e None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:10.891510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad77cbd-bd6b-41cc-8b93-d59a9876216e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:10.914687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-cad77cbd-bd6b-41cc-8b93-d59a9876216e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:10.916453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-cad77cbd-bd6b-41cc-8b93-d59a9876216e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:11.009624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 504/1009] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:10 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:11.331169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85aa57-ad77-406c-a1b3-5839fa0210bb None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:11.359293 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:11.413350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ef71-c631-4ba2-a5c9-3e64369e021a None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:11.413664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ef71-c631-4ba2-a5c9-3e64369e021a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:11.413943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ef71-c631-4ba2-a5c9-3e64369e021a None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:11.415518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 505/1010] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:58:11.423409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb0760-3ead-4c85-875a-95a9fd60d5a1 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:11.423730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb0760-3ead-4c85-875a-95a9fd60d5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:11.424000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb0760-3ead-4c85-875a-95a9fd60d5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:11.453905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-d1cb0760-3ead-4c85-875a-95a9fd60d5a1 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:11.456414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d1cb0760-3ead-4c85-875a-95a9fd60d5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:11.502534 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85aa57-ad77-406c-a1b3-5839fa0210bb None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:11.547277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ebf7b-2319-4fe4-9851-b3a033ee78b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:11.547919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ebf7b-2319-4fe4-9851-b3a033ee78b3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:11.548201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ebf7b-2319-4fe4-9851-b3a033ee78b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:11.548471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ebf7b-2319-4fe4-9851-b3a033ee78b3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:11.549097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ebf7b-2319-4fe4-9851-b3a033ee78b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:11.550500 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ebf7b-2319-4fe4-9851-b3a033ee78b3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-b14ebf7b-2319-4fe4-9851-b3a033ee78b3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:11.559802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:11.560901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:11.561749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 506/1011] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:58:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:11.567256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ebf7b-2319-4fe4-9851-b3a033ee78b3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:11.575796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 506/1012] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:11 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:58:11.629719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cce72-dc5a-4587-a7fb-a30d303c5e57 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:11.630261 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cce72-dc5a-4587-a7fb-a30d303c5e57 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:11.630759 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cce72-dc5a-4587-a7fb-a30d303c5e57 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:11.632374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 507/1013] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:58:11.637926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865740fd-8708-4f8e-8252-49f3cfb3124f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:11.638514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865740fd-8708-4f8e-8252-49f3cfb3124f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:11.638862 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865740fd-8708-4f8e-8252-49f3cfb3124f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:11.658991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-865740fd-8708-4f8e-8252-49f3cfb3124f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:11.660392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-865740fd-8708-4f8e-8252-49f3cfb3124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:11.664834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:11.690593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ebf7b-2319-4fe4-9851-b3a033ee78b3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:11.717576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:11.734370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f2555-93f2-4011-bc0d-191df8cac287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:11.735332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f2555-93f2-4011-bc0d-191df8cac287 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:11.735747 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f2555-93f2-4011-bc0d-191df8cac287 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:11.736213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f2555-93f2-4011-bc0d-191df8cac287 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:11.737112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f2555-93f2-4011-bc0d-191df8cac287 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:11.737547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f2555-93f2-4011-bc0d-191df8cac287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:11.739519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f2555-93f2-4011-bc0d-191df8cac287 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:11.744035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 508/1014] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:11 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:11.751081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 507/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:58:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:11.751839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865740fd-8708-4f8e-8252-49f3cfb3124f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:11.859223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f2555-93f2-4011-bc0d-191df8cac287 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:11.859787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865740fd-8708-4f8e-8252-49f3cfb3124f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:11.900564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a853594-b577-4944-af6b-0fe1a27dd8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:11.901246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a853594-b577-4944-af6b-0fe1a27dd8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:11.901414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a853594-b577-4944-af6b-0fe1a27dd8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:11.901885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a853594-b577-4944-af6b-0fe1a27dd8b7 None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:11.902552 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a853594-b577-4944-af6b-0fe1a27dd8b7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:11.902854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a853594-b577-4944-af6b-0fe1a27dd8b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:11.904742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a853594-b577-4944-af6b-0fe1a27dd8b7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:11.915225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 509/1016] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Sep 7 15:58:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:11.916563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a853594-b577-4944-af6b-0fe1a27dd8b7 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:11.976717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f2555-93f2-4011-bc0d-191df8cac287 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:11.992637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:12.023690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078f672-47c3-4077-8162-c45b40f6c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:12.025020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078f672-47c3-4077-8162-c45b40f6c93c None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.025456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078f672-47c3-4077-8162-c45b40f6c93c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.025880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078f672-47c3-4077-8162-c45b40f6c93c None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.026799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078f672-47c3-4077-8162-c45b40f6c93c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:12.028904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078f672-47c3-4077-8162-c45b40f6c93c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:12.040641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:12.055432 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 508/1017] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:58:11 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:58:12.055432 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078f672-47c3-4077-8162-c45b40f6c93c None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:12.074323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a853594-b577-4944-af6b-0fe1a27dd8b7 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:12.132178 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454702a9-585c-44fd-ac98-8c2b98d41257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:12.132854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454702a9-585c-44fd-ac98-8c2b98d41257 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.133159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454702a9-585c-44fd-ac98-8c2b98d41257 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.133431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454702a9-585c-44fd-ac98-8c2b98d41257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.134109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454702a9-585c-44fd-ac98-8c2b98d41257 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:12.135515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454702a9-585c-44fd-ac98-8c2b98d41257 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:12.162014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 510/1018] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 15:58:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:58:12.195966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078f672-47c3-4077-8162-c45b40f6c93c None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:12.259102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb68a3-d0bd-4105-af7c-d1b65c8ffb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:12.259341 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb68a3-d0bd-4105-af7c-d1b65c8ffb4d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.259571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb68a3-d0bd-4105-af7c-d1b65c8ffb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.259775 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb68a3-d0bd-4105-af7c-d1b65c8ffb4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.261855 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb68a3-d0bd-4105-af7c-d1b65c8ffb4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:12.263415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb68a3-d0bd-4105-af7c-d1b65c8ffb4d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:12.265414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 509/1019] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:12.272433 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454702a9-585c-44fd-ac98-8c2b98d41257 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:12.397856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454702a9-585c-44fd-ac98-8c2b98d41257 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:12.400248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:12.440709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc1712-69df-4569-9c81-30ca39022872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:12.441336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1712-69df-4569-9c81-30ca39022872 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.441610 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1712-69df-4569-9c81-30ca39022872 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.441878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1712-69df-4569-9c81-30ca39022872 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.442546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc1712-69df-4569-9c81-30ca39022872 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:12.444109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc1712-69df-4569-9c81-30ca39022872 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:12.480759 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 511/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:58:12 2022] POST /identity/v3/projects => generated 311 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:58:14.334223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0b58-55e1-4715-9214-7f4f4185d1e3 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:14.334721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0b58-55e1-4715-9214-7f4f4185d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:14.334721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0b58-55e1-4715-9214-7f4f4185d1e3 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:14.336011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 510/1021] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:14.342017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b30883-fdcd-42b1-95a9-d413d705dfc2 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:14.342499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b30883-fdcd-42b1-95a9-d413d705dfc2 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:14.342577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b30883-fdcd-42b1-95a9-d413d705dfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:14.363534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-10b30883-fdcd-42b1-95a9-d413d705dfc2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:14.364771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-10b30883-fdcd-42b1-95a9-d413d705dfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:14.445290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 512/1022] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:14.503317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb7ba5-b2ad-4206-8520-1b6f081ece54 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:14.503640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb7ba5-b2ad-4206-8520-1b6f081ece54 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:14.503864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb7ba5-b2ad-4206-8520-1b6f081ece54 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:14.505391 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 511/1023] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:14.511655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32577745-72fa-49c1-a77e-8e90ecc4de38 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:14.511943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32577745-72fa-49c1-a77e-8e90ecc4de38 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:14.512220 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32577745-72fa-49c1-a77e-8e90ecc4de38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:14.531915 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-32577745-72fa-49c1-a77e-8e90ecc4de38 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:14.533151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-32577745-72fa-49c1-a77e-8e90ecc4de38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:14.606006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 513/1024] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:14.716393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb7ba5-b2ad-4206-8520-1b6f081ece54 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:14.784657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:14.808160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e92cb-54cf-4fa2-93eb-92e66def5d46 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:14.808517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e92cb-54cf-4fa2-93eb-92e66def5d46 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:14.808838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e92cb-54cf-4fa2-93eb-92e66def5d46 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:14.810457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 514/1025] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:58:14.815695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e2d4d-329e-4c91-a2a4-c9a3e5148cb0 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:14.816249 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e2d4d-329e-4c91-a2a4-c9a3e5148cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:14.817192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e2d4d-329e-4c91-a2a4-c9a3e5148cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:14.833544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb7ba5-b2ad-4206-8520-1b6f081ece54 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:14.841861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-674e2d4d-329e-4c91-a2a4-c9a3e5148cb0 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:14.843379 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-674e2d4d-329e-4c91-a2a4-c9a3e5148cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:14.855657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:14.881568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba089c32-8d06-4675-a962-e81856db7d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:14.882118 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba089c32-8d06-4675-a962-e81856db7d77 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:14.882397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba089c32-8d06-4675-a962-e81856db7d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:14.882675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba089c32-8d06-4675-a962-e81856db7d77 None admin] PATH_INFO: `/v3/services/image` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:14.883263 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba089c32-8d06-4675-a962-e81856db7d77 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:14.884635 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba089c32-8d06-4675-a962-e81856db7d77 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-ba089c32-8d06-4675-a962-e81856db7d77 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:14.894875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:14.896995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:14.897958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 512/1026] 10.222.0.43 () {56 vars in 1105 bytes} [Wed Sep 7 15:58:14 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:14.898778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba089c32-8d06-4675-a962-e81856db7d77 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:14.926633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 515/1027] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:58:14.927489 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e2d4d-329e-4c91-a2a4-c9a3e5148cb0 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:15.045584 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba089c32-8d06-4675-a962-e81856db7d77 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:15.062123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e2d4d-329e-4c91-a2a4-c9a3e5148cb0 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:15.085083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:15.099093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6e06b-85ed-4fba-a75f-9718dee73e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:15.100183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6e06b-85ed-4fba-a75f-9718dee73e5c None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:15.100745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6e06b-85ed-4fba-a75f-9718dee73e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:15.101348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6e06b-85ed-4fba-a75f-9718dee73e5c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:15.109099 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2cdc4-5b96-4888-bcad-87a15a260cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:15.109750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2cdc4-5b96-4888-bcad-87a15a260cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:15.109997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2cdc4-5b96-4888-bcad-87a15a260cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:15.110270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2cdc4-5b96-4888-bcad-87a15a260cb4 None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:15.110916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2cdc4-5b96-4888-bcad-87a15a260cb4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:15.111217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2cdc4-5b96-4888-bcad-87a15a260cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:15.113078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2cdc4-5b96-4888-bcad-87a15a260cb4 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:15.122326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6e06b-85ed-4fba-a75f-9718dee73e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:58:15.125331 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 516/1028] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-28d6e06b-85ed-4fba-a75f-9718dee73e5c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:58:15.128024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:15.129059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:15.129918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:15.129918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:15.129918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:15.129918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:15.129918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:58:15.129918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:58:15.129918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:58:15.129918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:58:15.129918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:58:15.129918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:58:15.129918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:58:15.129918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:15.130578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2cdc4-5b96-4888-bcad-87a15a260cb4 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:15.139177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 513/1029] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Sep 7 15:58:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:15.144768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6e06b-85ed-4fba-a75f-9718dee73e5c None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:15.153908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:15.280138 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2cdc4-5b96-4888-bcad-87a15a260cb4 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:15.315658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6e06b-85ed-4fba-a75f-9718dee73e5c None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:15.336006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f858a-509c-4e01-818d-55c7908932bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:15.336908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f858a-509c-4e01-818d-55c7908932bd None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:15.337259 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f858a-509c-4e01-818d-55c7908932bd None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:15.337540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f858a-509c-4e01-818d-55c7908932bd None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:15.338198 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f858a-509c-4e01-818d-55c7908932bd None admin] RBAC: Adding query filter params (type=image) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:15.338500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f858a-509c-4e01-818d-55c7908932bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:15.341135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f858a-509c-4e01-818d-55c7908932bd None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:15.347436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 517/1030] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:15.348432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f858a-509c-4e01-818d-55c7908932bd None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:15.373493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72eaa5-143f-45b8-b7b2-7d08721bc796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:15.374124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72eaa5-143f-45b8-b7b2-7d08721bc796 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:15.374424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72eaa5-143f-45b8-b7b2-7d08721bc796 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:15.374672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72eaa5-143f-45b8-b7b2-7d08721bc796 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:15.375358 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72eaa5-143f-45b8-b7b2-7d08721bc796 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:15.375664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72eaa5-143f-45b8-b7b2-7d08721bc796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:15.377346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72eaa5-143f-45b8-b7b2-7d08721bc796 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:15.386729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 514/1031] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Sep 7 15:58:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:15.387416 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72eaa5-143f-45b8-b7b2-7d08721bc796 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:15.435167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:15.459052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:15.472135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f858a-509c-4e01-818d-55c7908932bd None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:15.510329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d78c99-e329-43e6-a7b6-50c4db3bebbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:15.511496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d78c99-e329-43e6-a7b6-50c4db3bebbf None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:15.511780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d78c99-e329-43e6-a7b6-50c4db3bebbf None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:15.512051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d78c99-e329-43e6-a7b6-50c4db3bebbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:15.513546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d78c99-e329-43e6-a7b6-50c4db3bebbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:15.514998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d78c99-e329-43e6-a7b6-50c4db3bebbf None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:15.516828 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 518/1032] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:15.517476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d78c99-e329-43e6-a7b6-50c4db3bebbf None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:15.525864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72eaa5-143f-45b8-b7b2-7d08721bc796 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:15.564708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53670d80-09f2-4b98-a38f-dc48daab48c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:15.565360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53670d80-09f2-4b98-a38f-dc48daab48c3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:15.565722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53670d80-09f2-4b98-a38f-dc48daab48c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:15.565934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53670d80-09f2-4b98-a38f-dc48daab48c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:15.566649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53670d80-09f2-4b98-a38f-dc48daab48c3 None admin] RBAC: Adding query filter params (interface=public, service_id=d2c399d2363e4925b2cb9ac80f978c02, region_id=RegionOne) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:15.566959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53670d80-09f2-4b98-a38f-dc48daab48c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:15.568424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53670d80-09f2-4b98-a38f-dc48daab48c3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:15.575335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 515/1033] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Sep 7 15:58:15 2022] GET /identity/v3/endpoints?service_id=d2c399d2363e4925b2cb9ac80f978c02&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:15.576068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53670d80-09f2-4b98-a38f-dc48daab48c3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:15.629392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d78c99-e329-43e6-a7b6-50c4db3bebbf None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:15.669982 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335acd7-8d61-41cf-abca-6bcbd47944d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:15.670811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335acd7-8d61-41cf-abca-6bcbd47944d7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:15.671218 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335acd7-8d61-41cf-abca-6bcbd47944d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:15.671529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335acd7-8d61-41cf-abca-6bcbd47944d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:15.681162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:15.684238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335acd7-8d61-41cf-abca-6bcbd47944d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:15.686237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335acd7-8d61-41cf-abca-6bcbd47944d7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-7335acd7-8d61-41cf-abca-6bcbd47944d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:58:15.702298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:15.703378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:58:15.704298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:58:15.704298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:15.704298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:15.704298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 519/1034] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:15.704298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335acd7-8d61-41cf-abca-6bcbd47944d7 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:15.714216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53670d80-09f2-4b98-a38f-dc48daab48c3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:15.728628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:15.751156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa4cb0-b8d7-44fd-af19-d024955c0b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:15.751778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa4cb0-b8d7-44fd-af19-d024955c0b40 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:15.752056 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa4cb0-b8d7-44fd-af19-d024955c0b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:15.752332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa4cb0-b8d7-44fd-af19-d024955c0b40 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:15.753052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa4cb0-b8d7-44fd-af19-d024955c0b40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:15.754496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa4cb0-b8d7-44fd-af19-d024955c0b40 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:15.777084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 516/1035] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:58:15 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:58:15.777941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa4cb0-b8d7-44fd-af19-d024955c0b40 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:15.824375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335acd7-8d61-41cf-abca-6bcbd47944d7 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:15.865045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305cc20-56c7-4a7f-bc4c-16675d924ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:15.865670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305cc20-56c7-4a7f-bc4c-16675d924ecb None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:15.865947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305cc20-56c7-4a7f-bc4c-16675d924ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:15.866217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305cc20-56c7-4a7f-bc4c-16675d924ecb None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:15.866845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305cc20-56c7-4a7f-bc4c-16675d924ecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:15.868321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305cc20-56c7-4a7f-bc4c-16675d924ecb None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:15.876597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 520/1036] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Sep 7 15:58:15 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:58:15.923854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa4cb0-b8d7-44fd-af19-d024955c0b40 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:15.974569 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4b8a-a8b2-4ff3-985d-ca2108ebe1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:15.975116 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4b8a-a8b2-4ff3-985d-ca2108ebe1ac None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:15.975395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4b8a-a8b2-4ff3-985d-ca2108ebe1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:15.975669 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4b8a-a8b2-4ff3-985d-ca2108ebe1ac None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:15.976505 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e4b8a-a8b2-4ff3-985d-ca2108ebe1ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:15.976848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e4b8a-a8b2-4ff3-985d-ca2108ebe1ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:15.978338 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e4b8a-a8b2-4ff3-985d-ca2108ebe1ac None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:16.002233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 517/1037] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:16.008018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305cc20-56c7-4a7f-bc4c-16675d924ecb None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:16.088532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:16.147765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305cc20-56c7-4a7f-bc4c-16675d924ecb None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:16.186096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bc446-5144-4819-9d69-252aa9900650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:16.186759 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bc446-5144-4819-9d69-252aa9900650 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:16.187079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bc446-5144-4819-9d69-252aa9900650 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:16.187330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bc446-5144-4819-9d69-252aa9900650 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:16.196522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bc446-5144-4819-9d69-252aa9900650 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:16.198038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bc446-5144-4819-9d69-252aa9900650 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-c51bc446-5144-4819-9d69-252aa9900650 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:58:16.211715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:16.212910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:16.214415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:16.214415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:16.214415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:58:16.214415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:58:16.214415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:58:16.214415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:58:16.214415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:58:16.214415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:58:16.214415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:58:16.214415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:16.214415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 521/1038] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Sep 7 15:58:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:16.219308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4b8a-a8b2-4ff3-985d-ca2108ebe1ac None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:16.256498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:16.339567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4b8a-a8b2-4ff3-985d-ca2108ebe1ac None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:16.376941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c092d-4bec-44c3-b82e-d222a38dd306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:16.378050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c092d-4bec-44c3-b82e-d222a38dd306 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:16.378050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c092d-4bec-44c3-b82e-d222a38dd306 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:16.378212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c092d-4bec-44c3-b82e-d222a38dd306 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:16.378869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c092d-4bec-44c3-b82e-d222a38dd306 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:16.379234 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c092d-4bec-44c3-b82e-d222a38dd306 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:16.380622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c092d-4bec-44c3-b82e-d222a38dd306 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:16.401132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 518/1039] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Sep 7 15:58:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:16.407767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bc446-5144-4819-9d69-252aa9900650 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:16.530054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bc446-5144-4819-9d69-252aa9900650 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:16.556305 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:16.578347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7fb1d-8206-4aff-97b6-5c202f42f29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:16.578971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7fb1d-8206-4aff-97b6-5c202f42f29c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:16.579250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7fb1d-8206-4aff-97b6-5c202f42f29c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:16.579520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7fb1d-8206-4aff-97b6-5c202f42f29c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:16.667174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7fb1d-8206-4aff-97b6-5c202f42f29c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:16.669218 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7fb1d-8206-4aff-97b6-5c202f42f29c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:16.784755 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 522/1040] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:58:16 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:58:16.790128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c092d-4bec-44c3-b82e-d222a38dd306 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:16.888227 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:16.902925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c092d-4bec-44c3-b82e-d222a38dd306 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:16.938907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243be730-54b9-4916-b7ec-623092179c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:16.939547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243be730-54b9-4916-b7ec-623092179c1f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:16.939831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243be730-54b9-4916-b7ec-623092179c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:16.940105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243be730-54b9-4916-b7ec-623092179c1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:16.950643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243be730-54b9-4916-b7ec-623092179c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:16.952105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243be730-54b9-4916-b7ec-623092179c1f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-243be730-54b9-4916-b7ec-623092179c1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:58:16.967633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:16.973935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:58:16.974872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:58:16.974872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:16.974872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:16.974872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 519/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:58:16.975102 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7fb1d-8206-4aff-97b6-5c202f42f29c None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:16.996961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:17.090371 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7fb1d-8206-4aff-97b6-5c202f42f29c None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:17.124701 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577c384-d393-4c7b-b818-07fc4ca1f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:17.125388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577c384-d393-4c7b-b818-07fc4ca1f71a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:17.125664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577c384-d393-4c7b-b818-07fc4ca1f71a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:17.125934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577c384-d393-4c7b-b818-07fc4ca1f71a None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:17.126575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577c384-d393-4c7b-b818-07fc4ca1f71a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:17.126876 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577c384-d393-4c7b-b818-07fc4ca1f71a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:17.128267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577c384-d393-4c7b-b818-07fc4ca1f71a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:17.145800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 523/1042] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:17.146973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243be730-54b9-4916-b7ec-623092179c1f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:17.254196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243be730-54b9-4916-b7ec-623092179c1f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:17.289819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb6974-5b64-4b53-be6e-17fb3ec6320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:17.290456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb6974-5b64-4b53-be6e-17fb3ec6320d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:17.290742 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb6974-5b64-4b53-be6e-17fb3ec6320d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:17.291087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb6974-5b64-4b53-be6e-17fb3ec6320d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:17.298528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb6974-5b64-4b53-be6e-17fb3ec6320d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:17.300063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb6974-5b64-4b53-be6e-17fb3ec6320d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:17.302675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-22eb6974-5b64-4b53-be6e-17fb3ec6320d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:58:17.313247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:17.314215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:17.315120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:58:17.315120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:58:17.315120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:58:17.315120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:58:17.315120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:58:17.315120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:58:17.315120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:58:17.315120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:17.315120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 520/1043] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:58:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:17.320831 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577c384-d393-4c7b-b818-07fc4ca1f71a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:17.403598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:17.428654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577c384-d393-4c7b-b818-07fc4ca1f71a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:17.464244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c04d94-910a-4476-b383-75caeba4f143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:17.464881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c04d94-910a-4476-b383-75caeba4f143 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:17.465161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c04d94-910a-4476-b383-75caeba4f143 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:17.465447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c04d94-910a-4476-b383-75caeba4f143 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:17.466119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c04d94-910a-4476-b383-75caeba4f143 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:17.466422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c04d94-910a-4476-b383-75caeba4f143 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:17.467850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c04d94-910a-4476-b383-75caeba4f143 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:17.480484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 524/1044] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:58:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:17.486378 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb6974-5b64-4b53-be6e-17fb3ec6320d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:17.592881 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb6974-5b64-4b53-be6e-17fb3ec6320d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:17.627935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94adc7b5-bee7-444c-84dd-f323d330a987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:17.628544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adc7b5-bee7-444c-84dd-f323d330a987 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:17.628857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adc7b5-bee7-444c-84dd-f323d330a987 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:17.629134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adc7b5-bee7-444c-84dd-f323d330a987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:17.629866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94adc7b5-bee7-444c-84dd-f323d330a987 None admin] RBAC: Adding query filter params (role.id=b57f3b4978524f40ad698b68b0f919fd, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=9d71c0688ea84c05af925f3fb08f35ad) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:17.630178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94adc7b5-bee7-444c-84dd-f323d330a987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:17.631615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94adc7b5-bee7-444c-84dd-f323d330a987 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:17.644714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 521/1045] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:58:17 2022] GET /identity/v3/role_assignments?user.id=9d71c0688ea84c05af925f3fb08f35ad&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=b57f3b4978524f40ad698b68b0f919fd => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:18.137332 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759d8ac-f0ee-43f5-8424-09e74dd414c4 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.137332 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759d8ac-f0ee-43f5-8424-09e74dd414c4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.137594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759d8ac-f0ee-43f5-8424-09e74dd414c4 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.138976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 525/1046] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:18.142626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb502ad-95dc-413d-a819-3dc0b812c1ca None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.142917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb502ad-95dc-413d-a819-3dc0b812c1ca None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.143195 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb502ad-95dc-413d-a819-3dc0b812c1ca None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.144798 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3396ccf-0b90-4cbe-bf56-77b34e6fafbc None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.144918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 522/1047] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:18.145084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3396ccf-0b90-4cbe-bf56-77b34e6fafbc None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.145401 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3396ccf-0b90-4cbe-bf56-77b34e6fafbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.150246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f54080-ab5f-4994-aa56-b818b87623b9 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.150528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f54080-ab5f-4994-aa56-b818b87623b9 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.150803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f54080-ab5f-4994-aa56-b818b87623b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.164425 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b3396ccf-0b90-4cbe-bf56-77b34e6fafbc None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:18.165671 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b3396ccf-0b90-4cbe-bf56-77b34e6fafbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:18.169556 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e8f54080-ab5f-4994-aa56-b818b87623b9 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:18.170721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e8f54080-ab5f-4994-aa56-b818b87623b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:18.236424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:18.240783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 526/1048] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:58:18.247080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 523/1049] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:58:18.509425 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3396ccf-0b90-4cbe-bf56-77b34e6fafbc None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:18.539660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f54080-ab5f-4994-aa56-b818b87623b9 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:18.587633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:18.630769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3396ccf-0b90-4cbe-bf56-77b34e6fafbc None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:18.651219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f54080-ab5f-4994-aa56-b818b87623b9 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:18.670515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2be97f-90e4-4add-9d2f-980f6b73e6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:18.671273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2be97f-90e4-4add-9d2f-980f6b73e6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.671554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2be97f-90e4-4add-9d2f-980f6b73e6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.671827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2be97f-90e4-4add-9d2f-980f6b73e6f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.683459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2be97f-90e4-4add-9d2f-980f6b73e6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-2b2be97f-90e4-4add-9d2f-980f6b73e6f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:58:18.688402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:18.689648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:18.691181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 527/1050] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:58:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:18.693218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747405f3-cf27-41d4-9712-08bee71ab42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:18.693862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747405f3-cf27-41d4-9712-08bee71ab42f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.694141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747405f3-cf27-41d4-9712-08bee71ab42f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.694615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747405f3-cf27-41d4-9712-08bee71ab42f None admin] PATH_INFO: `/v3/services/image` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.694993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747405f3-cf27-41d4-9712-08bee71ab42f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:18.695378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2be97f-90e4-4add-9d2f-980f6b73e6f5 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:18.696368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747405f3-cf27-41d4-9712-08bee71ab42f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-747405f3-cf27-41d4-9712-08bee71ab42f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:18.707360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:18.709142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:18.710303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 524/1051] 10.222.0.43 () {56 vars in 1105 bytes} [Wed Sep 7 15:58:18 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:58:18.714919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747405f3-cf27-41d4-9712-08bee71ab42f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:18.782470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:18.814811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2be97f-90e4-4add-9d2f-980f6b73e6f5 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:18.834088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747405f3-cf27-41d4-9712-08bee71ab42f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:18.842011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:18.853134 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154040d-f8ae-4ef6-a0b3-9f4200805c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:18.853740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154040d-f8ae-4ef6-a0b3-9f4200805c4c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.854015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154040d-f8ae-4ef6-a0b3-9f4200805c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.854780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154040d-f8ae-4ef6-a0b3-9f4200805c4c None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.855462 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154040d-f8ae-4ef6-a0b3-9f4200805c4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:18.855756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154040d-f8ae-4ef6-a0b3-9f4200805c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:18.857230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154040d-f8ae-4ef6-a0b3-9f4200805c4c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:18.866468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 528/1052] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:58:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:18.873710 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154040d-f8ae-4ef6-a0b3-9f4200805c4c None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:18.880852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92474ff-7a03-4b86-8501-9e7175c25c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:18.881474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92474ff-7a03-4b86-8501-9e7175c25c51 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.881749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92474ff-7a03-4b86-8501-9e7175c25c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.882017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92474ff-7a03-4b86-8501-9e7175c25c51 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.882647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92474ff-7a03-4b86-8501-9e7175c25c51 None admin] RBAC: Adding query filter params (name=image) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:18.882951 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92474ff-7a03-4b86-8501-9e7175c25c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:18.884503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92474ff-7a03-4b86-8501-9e7175c25c51 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:18.890340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 525/1053] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:18.895997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92474ff-7a03-4b86-8501-9e7175c25c51 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:18.987022 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154040d-f8ae-4ef6-a0b3-9f4200805c4c None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:19.005440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92474ff-7a03-4b86-8501-9e7175c25c51 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:19.030072 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca01246-3d76-477b-97fb-9262a13761cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:19.030721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca01246-3d76-477b-97fb-9262a13761cc None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:19.031005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca01246-3d76-477b-97fb-9262a13761cc None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:19.031282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca01246-3d76-477b-97fb-9262a13761cc None admin] PATH_INFO: `/v3/users/8f11e1ca666d494a8e8870d8d27c8268` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:19.035300 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:19.047761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca01246-3d76-477b-97fb-9262a13761cc None admin] RBAC: Authorizing `identity:get_user(user_id=8f11e1ca666d494a8e8870d8d27c8268)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:19.049247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca01246-3d76-477b-97fb-9262a13761cc None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:19.050437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb928d-371d-4a3c-ac08-d76bbd0e1717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:19.059557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 529/1054] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:58:18 2022] GET /identity/v3/users/8f11e1ca666d494a8e8870d8d27c8268 => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:19.059854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb928d-371d-4a3c-ac08-d76bbd0e1717 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:19.059854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb928d-371d-4a3c-ac08-d76bbd0e1717 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:19.059854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb928d-371d-4a3c-ac08-d76bbd0e1717 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:19.059854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb928d-371d-4a3c-ac08-d76bbd0e1717 None admin] RBAC: Adding query filter params (type=image) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:19.059854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb928d-371d-4a3c-ac08-d76bbd0e1717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:19.059854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb928d-371d-4a3c-ac08-d76bbd0e1717 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:19.062299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca01246-3d76-477b-97fb-9262a13761cc None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:19.067618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 526/1055] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:19.072175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb928d-371d-4a3c-ac08-d76bbd0e1717 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:19.122246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:19.184460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb928d-371d-4a3c-ac08-d76bbd0e1717 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:19.185400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca01246-3d76-477b-97fb-9262a13761cc None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:19.221707 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde7736-f844-4d31-a716-52e780d823ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:19.222420 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde7736-f844-4d31-a716-52e780d823ec None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:19.222708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde7736-f844-4d31-a716-52e780d823ec None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:19.222982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde7736-f844-4d31-a716-52e780d823ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:19.223670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde7736-f844-4d31-a716-52e780d823ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:19.224816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbdfe0-2ea0-461d-ad6b-b3287c005fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:19.225094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde7736-f844-4d31-a716-52e780d823ec None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:19.225430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbdfe0-2ea0-461d-ad6b-b3287c005fae None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:19.225711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbdfe0-2ea0-461d-ad6b-b3287c005fae None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:19.225986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbdfe0-2ea0-461d-ad6b-b3287c005fae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:19.256926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 527/1056] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 15:58:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:58:19.303088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbdfe0-2ea0-461d-ad6b-b3287c005fae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:19.304489 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbdfe0-2ea0-461d-ad6b-b3287c005fae None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:19.358189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:19.426264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 530/1057] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:58:19 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 15:58:19.428034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde7736-f844-4d31-a716-52e780d823ec None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:19.479452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:19.551092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde7736-f844-4d31-a716-52e780d823ec None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:19.587177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f4d2d-5200-427a-8b34-7914e4faecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:19.587738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f4d2d-5200-427a-8b34-7914e4faecb5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:19.588015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f4d2d-5200-427a-8b34-7914e4faecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:19.588288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f4d2d-5200-427a-8b34-7914e4faecb5 None admin] PATH_INFO: `/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:19.590021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f4d2d-5200-427a-8b34-7914e4faecb5 None admin] RBAC: Authorizing `identity:get_project(project_id=179cfef2dbdb4d5899dd22e37c0b4f12)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:19.591453 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f4d2d-5200-427a-8b34-7914e4faecb5 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:19.593288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 528/1058] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:58:19 2022] GET /identity/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:19.600087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbdfe0-2ea0-461d-ad6b-b3287c005fae None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:19.703578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbdfe0-2ea0-461d-ad6b-b3287c005fae None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:19.739432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72fb2c-a116-4193-8b32-a3dff9f4d1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:19.740064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72fb2c-a116-4193-8b32-a3dff9f4d1cb None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:19.740341 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72fb2c-a116-4193-8b32-a3dff9f4d1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:19.740611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72fb2c-a116-4193-8b32-a3dff9f4d1cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:19.741392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72fb2c-a116-4193-8b32-a3dff9f4d1cb None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=179cfef2dbdb4d5899dd22e37c0b4f12, user.id=8f11e1ca666d494a8e8870d8d27c8268) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:19.741700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72fb2c-a116-4193-8b32-a3dff9f4d1cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:19.743173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72fb2c-a116-4193-8b32-a3dff9f4d1cb None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:19.756752 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 531/1059] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:58:19 2022] GET /identity/v3/role_assignments?user.id=8f11e1ca666d494a8e8870d8d27c8268&scope.project.id=179cfef2dbdb4d5899dd22e37c0b4f12&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:19.863932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9bc52-a5ea-4fc9-a801-155fdcb208d7 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:19.864124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9bc52-a5ea-4fc9-a801-155fdcb208d7 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:19.864394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9bc52-a5ea-4fc9-a801-155fdcb208d7 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:19.865959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 529/1060] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:58:19.872246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a1986-ce63-44f4-96b6-55736a8ef71a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:19.872566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a1986-ce63-44f4-96b6-55736a8ef71a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:19.872833 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a1986-ce63-44f4-96b6-55736a8ef71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:19.892676 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-695a1986-ce63-44f4-96b6-55736a8ef71a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:19.894168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-695a1986-ce63-44f4-96b6-55736a8ef71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:19.898489 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:19.970456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 532/1061] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:20.236424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9bc52-a5ea-4fc9-a801-155fdcb208d7 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:20.339880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9bc52-a5ea-4fc9-a801-155fdcb208d7 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:20.347656 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:20.375755 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8933f1-fa4e-495c-aade-e7f75f4ef0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:20.376392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8933f1-fa4e-495c-aade-e7f75f4ef0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:20.376673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8933f1-fa4e-495c-aade-e7f75f4ef0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:20.376987 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8933f1-fa4e-495c-aade-e7f75f4ef0a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:20.388358 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8933f1-fa4e-495c-aade-e7f75f4ef0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-5b8933f1-fa4e-495c-aade-e7f75f4ef0a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:58:20.393148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:20.394430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:20.395331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 530/1062] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Sep 7 15:58:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:20.400434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a1986-ce63-44f4-96b6-55736a8ef71a None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:20.508895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a1986-ce63-44f4-96b6-55736a8ef71a None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:20.548199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674c868-ef09-4cbe-8164-f95aef074b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:20.548837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674c868-ef09-4cbe-8164-f95aef074b6a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:20.549114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674c868-ef09-4cbe-8164-f95aef074b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:20.549380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674c868-ef09-4cbe-8164-f95aef074b6a None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:20.550039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674c868-ef09-4cbe-8164-f95aef074b6a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:20.550334 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674c868-ef09-4cbe-8164-f95aef074b6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:20.551686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674c868-ef09-4cbe-8164-f95aef074b6a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:20.560001 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 533/1063] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Sep 7 15:58:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:20.565892 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8933f1-fa4e-495c-aade-e7f75f4ef0a8 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:20.672384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8933f1-fa4e-495c-aade-e7f75f4ef0a8 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:20.707573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823705-26b1-4870-a538-1742c1eedabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:20.708203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823705-26b1-4870-a538-1742c1eedabb None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:20.708482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823705-26b1-4870-a538-1742c1eedabb None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:20.708780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823705-26b1-4870-a538-1742c1eedabb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:20.719403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823705-26b1-4870-a538-1742c1eedabb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:20.720877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823705-26b1-4870-a538-1742c1eedabb None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-62823705-26b1-4870-a538-1742c1eedabb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:58:20.736464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:20.737645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:58:20.738714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:58:20.738714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:20.738714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:20.738714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 531/1064] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:20.743226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674c868-ef09-4cbe-8164-f95aef074b6a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:20.746626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:20.852483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674c868-ef09-4cbe-8164-f95aef074b6a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:20.887374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc496e-1420-4988-afc6-89033dabfcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:20.887974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc496e-1420-4988-afc6-89033dabfcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:20.888252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc496e-1420-4988-afc6-89033dabfcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:20.888523 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc496e-1420-4988-afc6-89033dabfcc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:20.889188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc496e-1420-4988-afc6-89033dabfcc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:20.889485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc496e-1420-4988-afc6-89033dabfcc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:20.890834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc496e-1420-4988-afc6-89033dabfcc3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:20.903253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 534/1065] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:20.908651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823705-26b1-4870-a538-1742c1eedabb None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:20.929042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:21.020795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823705-26b1-4870-a538-1742c1eedabb None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:21.057399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827a9e5-3869-478a-86b8-019c7da246e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:21.058040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827a9e5-3869-478a-86b8-019c7da246e8 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:21.058412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827a9e5-3869-478a-86b8-019c7da246e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:21.058737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827a9e5-3869-478a-86b8-019c7da246e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:21.066803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827a9e5-3869-478a-86b8-019c7da246e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:21.068274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827a9e5-3869-478a-86b8-019c7da246e8 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-6827a9e5-3869-478a-86b8-019c7da246e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:58:21.080308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:21.081510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:21.084138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:21.084138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:21.084138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:58:21.084138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:58:21.084138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:58:21.084138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:58:21.084138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:58:21.084138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:58:21.084138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:58:21.084138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:21.084138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 532/1066] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Sep 7 15:58:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:21.088032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc496e-1420-4988-afc6-89033dabfcc3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:21.154465 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:21.193794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc496e-1420-4988-afc6-89033dabfcc3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:21.228555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0d64c-f1ca-4d2d-8a3c-66666af9846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:21.229215 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0d64c-f1ca-4d2d-8a3c-66666af9846b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:21.230193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0d64c-f1ca-4d2d-8a3c-66666af9846b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:21.230551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0d64c-f1ca-4d2d-8a3c-66666af9846b None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:21.231279 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0d64c-f1ca-4d2d-8a3c-66666af9846b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:21.231578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0d64c-f1ca-4d2d-8a3c-66666af9846b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:21.233011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0d64c-f1ca-4d2d-8a3c-66666af9846b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:21.254893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 535/1067] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Sep 7 15:58:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:21.256201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827a9e5-3869-478a-86b8-019c7da246e8 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:21.344031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:21.377764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827a9e5-3869-478a-86b8-019c7da246e8 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:21.430132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab18c-4595-4efe-a30a-1ba53f62d235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:21.430787 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab18c-4595-4efe-a30a-1ba53f62d235 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:21.431068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab18c-4595-4efe-a30a-1ba53f62d235 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:21.431337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab18c-4595-4efe-a30a-1ba53f62d235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:21.447206 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab18c-4595-4efe-a30a-1ba53f62d235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:21.450345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab18c-4595-4efe-a30a-1ba53f62d235 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-25bab18c-4595-4efe-a30a-1ba53f62d235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:58:21.474204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:21.475272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:58:21.476163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:58:21.476163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:21.476163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:21.480743 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 533/1068] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:21.481819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0d64c-f1ca-4d2d-8a3c-66666af9846b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:21.577187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3bcf1-ddcf-4bcb-91db-1d20cc888503 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:21.577950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3bcf1-ddcf-4bcb-91db-1d20cc888503 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:21.577950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3bcf1-ddcf-4bcb-91db-1d20cc888503 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:21.580867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 534/1069] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:58:21.587570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f55a9-53ec-47b4-9db4-a4409ffe0c2e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:21.587945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f55a9-53ec-47b4-9db4-a4409ffe0c2e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:21.588115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f55a9-53ec-47b4-9db4-a4409ffe0c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:21.610880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-282f55a9-53ec-47b4-9db4-a4409ffe0c2e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:21.612121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-282f55a9-53ec-47b4-9db4-a4409ffe0c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:21.637507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0d64c-f1ca-4d2d-8a3c-66666af9846b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:21.664663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:21.683096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0874-dbc9-40a8-95fc-e36ab2576cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:21.683636 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0874-dbc9-40a8-95fc-e36ab2576cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:21.683915 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0874-dbc9-40a8-95fc-e36ab2576cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:21.684184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0874-dbc9-40a8-95fc-e36ab2576cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:21.684879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a0874-dbc9-40a8-95fc-e36ab2576cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:21.685182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a0874-dbc9-40a8-95fc-e36ab2576cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:21.686584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a0874-dbc9-40a8-95fc-e36ab2576cb9 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:21.699942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 536/1070] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:21.706275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0874-dbc9-40a8-95fc-e36ab2576cb9 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:21.717093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 535/1071] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:21.840284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0874-dbc9-40a8-95fc-e36ab2576cb9 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:21.879107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948e1a4-1b2a-43f5-86ce-21a761d0762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:21.879750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948e1a4-1b2a-43f5-86ce-21a761d0762e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:21.880030 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948e1a4-1b2a-43f5-86ce-21a761d0762e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:21.880291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948e1a4-1b2a-43f5-86ce-21a761d0762e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:21.888877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948e1a4-1b2a-43f5-86ce-21a761d0762e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:21.890380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948e1a4-1b2a-43f5-86ce-21a761d0762e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-3948e1a4-1b2a-43f5-86ce-21a761d0762e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:58:21.911254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:21.912295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:21.919050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:58:21.919050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:58:21.919050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:58:21.919050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:58:21.919050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:58:21.919050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:58:21.919050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:58:21.919050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:21.919050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 537/1072] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:58:21.921883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f55a9-53ec-47b4-9db4-a4409ffe0c2e None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:21.996062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:22.002692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948e1a4-1b2a-43f5-86ce-21a761d0762e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:22.047300 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f55a9-53ec-47b4-9db4-a4409ffe0c2e None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:22.049435 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:22.084231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b92aa3-f747-4ab9-bb14-68de454cc9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:22.084876 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b92aa3-f747-4ab9-bb14-68de454cc9db None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:22.085154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b92aa3-f747-4ab9-bb14-68de454cc9db None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:22.085422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b92aa3-f747-4ab9-bb14-68de454cc9db None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:22.086117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b92aa3-f747-4ab9-bb14-68de454cc9db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:22.086425 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b92aa3-f747-4ab9-bb14-68de454cc9db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:22.087858 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b92aa3-f747-4ab9-bb14-68de454cc9db None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:22.099825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 536/1073] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:22.101132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8acb-a80e-4188-867a-1ddb487f1cfd None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:22.101418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8acb-a80e-4188-867a-1ddb487f1cfd None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:22.101688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8acb-a80e-4188-867a-1ddb487f1cfd None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:22.103047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 537/1074] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:22.106627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8acb-a80e-4188-867a-1ddb487f1cfd None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:22.140336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948e1a4-1b2a-43f5-86ce-21a761d0762e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:22.186630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00e435-285a-4e45-b4ed-0275e084860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:22.187255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00e435-285a-4e45-b4ed-0275e084860b None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:22.187540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00e435-285a-4e45-b4ed-0275e084860b None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:22.187809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00e435-285a-4e45-b4ed-0275e084860b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:22.245379 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8acb-a80e-4188-867a-1ddb487f1cfd None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:22.272174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00e435-285a-4e45-b4ed-0275e084860b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:22.274630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00e435-285a-4e45-b4ed-0275e084860b None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:22.280307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:22.296889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01273e3c-606f-4f02-aa50-da9378b11656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:22.297571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01273e3c-606f-4f02-aa50-da9378b11656 None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:22.297838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01273e3c-606f-4f02-aa50-da9378b11656 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:22.298110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01273e3c-606f-4f02-aa50-da9378b11656 None admin] PATH_INFO: `/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/9d71c0688ea84c05af925f3fb08f35ad/roles/b57f3b4978524f40ad698b68b0f919fd` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:22.300260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01273e3c-606f-4f02-aa50-da9378b11656 None admin] RBAC: Authorizing `identity:create_grant(project_id=983beac5fc784756b6bdf11b07e219ac, user_id=9d71c0688ea84c05af925f3fb08f35ad, role_id=b57f3b4978524f40ad698b68b0f919fd)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:22.301737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01273e3c-606f-4f02-aa50-da9378b11656 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:22.314980 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 538/1075] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:58:22 2022] PUT /identity/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/9d71c0688ea84c05af925f3fb08f35ad/roles/b57f3b4978524f40ad698b68b0f919fd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:58:22.316315 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde6f47-6380-415d-8a6a-dda50aac3ca4 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:22.316610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde6f47-6380-415d-8a6a-dda50aac3ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:22.316907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde6f47-6380-415d-8a6a-dda50aac3ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:22.337706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-1dde6f47-6380-415d-8a6a-dda50aac3ca4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:22.339918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1dde6f47-6380-415d-8a6a-dda50aac3ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:22.355789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:22.440436 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 539/1076] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:22.441053 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 538/1077] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:58:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 15:58:22.447302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde6f47-6380-415d-8a6a-dda50aac3ca4 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:22.589989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde6f47-6380-415d-8a6a-dda50aac3ca4 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:22.603129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:22.634520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cd127-fc23-4b36-a04a-e6e8ab7f91a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:22.635152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cd127-fc23-4b36-a04a-e6e8ab7f91a5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:22.635464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cd127-fc23-4b36-a04a-e6e8ab7f91a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:22.635787 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cd127-fc23-4b36-a04a-e6e8ab7f91a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:22.647668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cd127-fc23-4b36-a04a-e6e8ab7f91a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:22.649491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cd127-fc23-4b36-a04a-e6e8ab7f91a5 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-f28cd127-fc23-4b36-a04a-e6e8ab7f91a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:58:22.667517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:22.668900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:58:22.669842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:58:22.669842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:22.669842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:22.669842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 540/1078] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:22.677882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00e435-285a-4e45-b4ed-0275e084860b None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:22.766173 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cd127-fc23-4b36-a04a-e6e8ab7f91a5 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:22.821950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00e435-285a-4e45-b4ed-0275e084860b None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:22.874390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f209131-80fb-4993-9b1d-8e9129f3b468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:22.875682 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f209131-80fb-4993-9b1d-8e9129f3b468 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:22.876115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f209131-80fb-4993-9b1d-8e9129f3b468 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:22.876557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f209131-80fb-4993-9b1d-8e9129f3b468 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:22.877392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f209131-80fb-4993-9b1d-8e9129f3b468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:22.877847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f209131-80fb-4993-9b1d-8e9129f3b468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:22.879480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f209131-80fb-4993-9b1d-8e9129f3b468 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:22.892713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:22.905157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 539/1079] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:22.937119 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cd127-fc23-4b36-a04a-e6e8ab7f91a5 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:22.986883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f5574-005b-44e3-a118-cc67d096724d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:22.987987 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f5574-005b-44e3-a118-cc67d096724d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:22.988361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f5574-005b-44e3-a118-cc67d096724d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:22.989132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f5574-005b-44e3-a118-cc67d096724d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:23.012907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f5574-005b-44e3-a118-cc67d096724d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-df9f5574-005b-44e3-a118-cc67d096724d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:58:23.019373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:23.020443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:23.021661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:23.021661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:23.021661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:23.021661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:23.021661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:58:23.021661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:58:23.021661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:58:23.021661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:58:23.021661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:58:23.021661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:58:23.021661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:58:23.021661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:23.027074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 541/1080] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:58:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:58:23.028485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f209131-80fb-4993-9b1d-8e9129f3b468 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:23.170746 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f209131-80fb-4993-9b1d-8e9129f3b468 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:23.211887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fde620-7997-49d1-8146-bb61dc28f836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:23.212501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde620-7997-49d1-8146-bb61dc28f836 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:23.212823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde620-7997-49d1-8146-bb61dc28f836 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:23.213098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde620-7997-49d1-8146-bb61dc28f836 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:23.213830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fde620-7997-49d1-8146-bb61dc28f836 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:23.214865 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fde620-7997-49d1-8146-bb61dc28f836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:23.216254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fde620-7997-49d1-8146-bb61dc28f836 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:23.227094 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 540/1081] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:23.238772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f5574-005b-44e3-a118-cc67d096724d None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:23.278359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:23.376470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f5574-005b-44e3-a118-cc67d096724d None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:23.419218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e9c22-abf0-4af6-a77d-d58225989547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:23.419849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e9c22-abf0-4af6-a77d-d58225989547 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:23.420133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e9c22-abf0-4af6-a77d-d58225989547 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:23.420405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e9c22-abf0-4af6-a77d-d58225989547 None admin] PATH_INFO: `/v3/users/8f11e1ca666d494a8e8870d8d27c8268` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:23.421717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e9c22-abf0-4af6-a77d-d58225989547 None admin] RBAC: Authorizing `identity:get_user(user_id=8f11e1ca666d494a8e8870d8d27c8268)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:23.423102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e9c22-abf0-4af6-a77d-d58225989547 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:23.424702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 542/1082] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:58:23 2022] GET /identity/v3/users/8f11e1ca666d494a8e8870d8d27c8268 => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:23.430639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fde620-7997-49d1-8146-bb61dc28f836 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:23.508742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:23.562613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fde620-7997-49d1-8146-bb61dc28f836 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:23.609129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded4731-95dc-4dea-889a-ddda0898555a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:23.609916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4731-95dc-4dea-889a-ddda0898555a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:23.610198 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4731-95dc-4dea-889a-ddda0898555a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:23.610849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4731-95dc-4dea-889a-ddda0898555a None admin] PATH_INFO: `/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:23.612312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded4731-95dc-4dea-889a-ddda0898555a None admin] RBAC: Authorizing `identity:get_project(project_id=179cfef2dbdb4d5899dd22e37c0b4f12)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:23.614043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded4731-95dc-4dea-889a-ddda0898555a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:23.615722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 541/1083] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:58:23 2022] GET /identity/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:23.622310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e9c22-abf0-4af6-a77d-d58225989547 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:23.734339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:23.746395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e9c22-abf0-4af6-a77d-d58225989547 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:23.790089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59972a9-9b91-4507-bff6-4606e85b4b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:23.791068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59972a9-9b91-4507-bff6-4606e85b4b76 None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:23.791494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59972a9-9b91-4507-bff6-4606e85b4b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:23.792705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59972a9-9b91-4507-bff6-4606e85b4b76 None admin] PATH_INFO: `/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12/users/8f11e1ca666d494a8e8870d8d27c8268/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:23.795564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59972a9-9b91-4507-bff6-4606e85b4b76 None admin] RBAC: Authorizing `identity:create_grant(project_id=179cfef2dbdb4d5899dd22e37c0b4f12, user_id=8f11e1ca666d494a8e8870d8d27c8268, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:23.797937 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59972a9-9b91-4507-bff6-4606e85b4b76 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:23.818808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 543/1084] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:58:23 2022] PUT /identity/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12/users/8f11e1ca666d494a8e8870d8d27c8268/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:24.777877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edc409-09cb-48ef-914c-d7f619673a4a None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:24.778415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edc409-09cb-48ef-914c-d7f619673a4a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:24.778415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edc409-09cb-48ef-914c-d7f619673a4a None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:24.779752 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 542/1085] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:24.785329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093f16d-8f71-44e7-8369-cc7d0438be7c None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:24.785776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093f16d-8f71-44e7-8369-cc7d0438be7c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:24.785872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093f16d-8f71-44e7-8369-cc7d0438be7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:24.805896 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-6093f16d-8f71-44e7-8369-cc7d0438be7c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:24.807862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6093f16d-8f71-44e7-8369-cc7d0438be7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:24.900323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 544/1086] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:25.185887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edc409-09cb-48ef-914c-d7f619673a4a None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:25.298124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edc409-09cb-48ef-914c-d7f619673a4a None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:25.334917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:25.342306 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4657489-377b-4cf6-b3ec-3dce955ba130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:25.343034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4657489-377b-4cf6-b3ec-3dce955ba130 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:25.343344 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4657489-377b-4cf6-b3ec-3dce955ba130 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:25.343621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4657489-377b-4cf6-b3ec-3dce955ba130 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:25.355534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4657489-377b-4cf6-b3ec-3dce955ba130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-c4657489-377b-4cf6-b3ec-3dce955ba130 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:58:25.360476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:25.361502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:25.362561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 543/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Sep 7 15:58:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:58:25.368538 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093f16d-8f71-44e7-8369-cc7d0438be7c None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:25.470357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:25.491711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093f16d-8f71-44e7-8369-cc7d0438be7c None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:25.534450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce434b-1f53-4a91-ac6f-54d5a67b0161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:25.535089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce434b-1f53-4a91-ac6f-54d5a67b0161 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:25.535367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce434b-1f53-4a91-ac6f-54d5a67b0161 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:25.535658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce434b-1f53-4a91-ac6f-54d5a67b0161 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:25.536345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce434b-1f53-4a91-ac6f-54d5a67b0161 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:25.536646 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce434b-1f53-4a91-ac6f-54d5a67b0161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:25.538076 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce434b-1f53-4a91-ac6f-54d5a67b0161 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:25.548321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 545/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Sep 7 15:58:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:25.554116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4657489-377b-4cf6-b3ec-3dce955ba130 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:25.665065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4657489-377b-4cf6-b3ec-3dce955ba130 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:25.707311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bdc85-55d4-4ae4-8b10-53ffdd7f6a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:25.708017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bdc85-55d4-4ae4-8b10-53ffdd7f6a2e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:25.708297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bdc85-55d4-4ae4-8b10-53ffdd7f6a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:25.708570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bdc85-55d4-4ae4-8b10-53ffdd7f6a2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:25.722651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bdc85-55d4-4ae4-8b10-53ffdd7f6a2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:25.724252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bdc85-55d4-4ae4-8b10-53ffdd7f6a2e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-ed8bdc85-55d4-4ae4-8b10-53ffdd7f6a2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:58:25.746534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:25.748105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:58:25.749107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:58:25.749107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:25.749107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:25.749107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 544/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:25.754058 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce434b-1f53-4a91-ac6f-54d5a67b0161 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:25.876467 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce434b-1f53-4a91-ac6f-54d5a67b0161 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:25.923121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f90f50-2f26-4e35-86c7-e8fc15eee3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:25.923757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f90f50-2f26-4e35-86c7-e8fc15eee3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:25.924085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f90f50-2f26-4e35-86c7-e8fc15eee3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:25.924362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f90f50-2f26-4e35-86c7-e8fc15eee3a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:25.925151 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f90f50-2f26-4e35-86c7-e8fc15eee3a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:25.925661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f90f50-2f26-4e35-86c7-e8fc15eee3a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:25.927131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f90f50-2f26-4e35-86c7-e8fc15eee3a1 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:25.941281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 546/1090] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:25.950251 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bdc85-55d4-4ae4-8b10-53ffdd7f6a2e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:26.004197 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:26.073894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bdc85-55d4-4ae4-8b10-53ffdd7f6a2e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:26.078677 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc7095-66ef-428d-a6dd-de4f4f4d71c3 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:26.078959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc7095-66ef-428d-a6dd-de4f4f4d71c3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:26.079249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc7095-66ef-428d-a6dd-de4f4f4d71c3 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:26.080588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 547/1091] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:58:26.086123 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92509390-5d4d-4a6a-b089-5e9246d78af5 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:26.086412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92509390-5d4d-4a6a-b089-5e9246d78af5 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:26.086682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92509390-5d4d-4a6a-b089-5e9246d78af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:26.093335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:26.107835 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-92509390-5d4d-4a6a-b089-5e9246d78af5 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:26.109075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-92509390-5d4d-4a6a-b089-5e9246d78af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:26.113187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ddcd2-8712-4ce9-a91c-d6f9410952b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:26.113835 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ddcd2-8712-4ce9-a91c-d6f9410952b3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:26.114112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ddcd2-8712-4ce9-a91c-d6f9410952b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:26.114386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ddcd2-8712-4ce9-a91c-d6f9410952b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:26.123155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ddcd2-8712-4ce9-a91c-d6f9410952b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:26.124610 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ddcd2-8712-4ce9-a91c-d6f9410952b3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-514ddcd2-8712-4ce9-a91c-d6f9410952b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:58:26.136932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:26.137971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:26.139318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:26.139318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:26.139318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:58:26.139318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:58:26.139318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:58:26.139318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:58:26.139318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:58:26.139318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:58:26.139318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:58:26.139318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:26.139318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 545/1092] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Sep 7 15:58:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:26.144052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ddcd2-8712-4ce9-a91c-d6f9410952b3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:26.201423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 548/1093] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:58:26.264316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ddcd2-8712-4ce9-a91c-d6f9410952b3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:26.266213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:26.305217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418f01b-da8a-4a5f-bb5c-9747e69dd1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:26.306099 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418f01b-da8a-4a5f-bb5c-9747e69dd1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:26.306099 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418f01b-da8a-4a5f-bb5c-9747e69dd1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:26.306486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418f01b-da8a-4a5f-bb5c-9747e69dd1c4 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:26.307969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418f01b-da8a-4a5f-bb5c-9747e69dd1c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:26.308499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418f01b-da8a-4a5f-bb5c-9747e69dd1c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:26.310099 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418f01b-da8a-4a5f-bb5c-9747e69dd1c4 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:26.334895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 546/1094] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Sep 7 15:58:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:26.340673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92509390-5d4d-4a6a-b089-5e9246d78af5 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:26.456764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92509390-5d4d-4a6a-b089-5e9246d78af5 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:26.475301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418f01b-da8a-4a5f-bb5c-9747e69dd1c4 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:26.497759 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:26.503993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b34d7-98fc-46a6-aeae-8394d0e77e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:26.504868 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b34d7-98fc-46a6-aeae-8394d0e77e71 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:26.505239 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b34d7-98fc-46a6-aeae-8394d0e77e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:26.505602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b34d7-98fc-46a6-aeae-8394d0e77e71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:26.595772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418f01b-da8a-4a5f-bb5c-9747e69dd1c4 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:26.608999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b34d7-98fc-46a6-aeae-8394d0e77e71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:26.610836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b34d7-98fc-46a6-aeae-8394d0e77e71 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:26.634965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4745fa-2249-428c-b080-ce265157f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:26.636001 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4745fa-2249-428c-b080-ce265157f0bf None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:26.636495 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4745fa-2249-428c-b080-ce265157f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:26.637023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4745fa-2249-428c-b080-ce265157f0bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:26.650228 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4745fa-2249-428c-b080-ce265157f0bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-ab4745fa-2249-428c-b080-ce265157f0bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:58:26.660643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:26.661698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:26.662879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 547/1095] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:58:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:58:26.664229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4745fa-2249-428c-b080-ce265157f0bf None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:26.692946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:26.732152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 549/1096] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:58:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:58:26.738489 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b34d7-98fc-46a6-aeae-8394d0e77e71 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:26.775406 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:26.799760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4745fa-2249-428c-b080-ce265157f0bf None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:26.850975 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa48200-34c9-46e2-8b84-2c4bcc6a5943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:26.851914 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa48200-34c9-46e2-8b84-2c4bcc6a5943 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:26.852360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa48200-34c9-46e2-8b84-2c4bcc6a5943 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:26.852829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa48200-34c9-46e2-8b84-2c4bcc6a5943 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:26.853743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa48200-34c9-46e2-8b84-2c4bcc6a5943 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:26.854453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa48200-34c9-46e2-8b84-2c4bcc6a5943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:26.856754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa48200-34c9-46e2-8b84-2c4bcc6a5943 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:26.867333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 548/1097] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:58:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:26.868300 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b34d7-98fc-46a6-aeae-8394d0e77e71 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:26.875166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa48200-34c9-46e2-8b84-2c4bcc6a5943 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:26.907303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210208e-cab8-4000-8124-3027c533e788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:26.908060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210208e-cab8-4000-8124-3027c533e788 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:26.908429 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210208e-cab8-4000-8124-3027c533e788 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:26.908894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210208e-cab8-4000-8124-3027c533e788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:26.921913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210208e-cab8-4000-8124-3027c533e788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:26.923817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210208e-cab8-4000-8124-3027c533e788 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-5210208e-cab8-4000-8124-3027c533e788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:58:26.941559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:26.943252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:58:26.950582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:58:26.950582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:58:26.950582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:26.950582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 550/1098] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:26.951713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210208e-cab8-4000-8124-3027c533e788 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:26.982056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:27.007640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa48200-34c9-46e2-8b84-2c4bcc6a5943 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:27.053308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d867ec7-3981-458c-bd09-6ed172d55e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:27.053939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d867ec7-3981-458c-bd09-6ed172d55e05 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.054220 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d867ec7-3981-458c-bd09-6ed172d55e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.054494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d867ec7-3981-458c-bd09-6ed172d55e05 None admin] PATH_INFO: `/v3/users/8f11e1ca666d494a8e8870d8d27c8268` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:27.055623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d867ec7-3981-458c-bd09-6ed172d55e05 None admin] RBAC: Authorizing `identity:get_user(user_id=8f11e1ca666d494a8e8870d8d27c8268)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:27.057078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d867ec7-3981-458c-bd09-6ed172d55e05 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:27.059107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 549/1099] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:58:26 2022] GET /identity/v3/users/8f11e1ca666d494a8e8870d8d27c8268 => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:27.064902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d867ec7-3981-458c-bd09-6ed172d55e05 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:27.070933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:27.096229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210208e-cab8-4000-8124-3027c533e788 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:27.137125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96031587-695c-4aee-bfe5-177172f73453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:27.138047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96031587-695c-4aee-bfe5-177172f73453 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.138493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96031587-695c-4aee-bfe5-177172f73453 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.138904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96031587-695c-4aee-bfe5-177172f73453 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:27.139886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96031587-695c-4aee-bfe5-177172f73453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:27.140317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96031587-695c-4aee-bfe5-177172f73453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:27.142170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96031587-695c-4aee-bfe5-177172f73453 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:27.156199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 551/1100] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 15:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:27.164020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96031587-695c-4aee-bfe5-177172f73453 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:27.194975 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d867ec7-3981-458c-bd09-6ed172d55e05 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:27.236932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d32bdc-6fbe-482c-ad92-bc4e6c002179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:27.237653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d32bdc-6fbe-482c-ad92-bc4e6c002179 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.238103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d32bdc-6fbe-482c-ad92-bc4e6c002179 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.238564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d32bdc-6fbe-482c-ad92-bc4e6c002179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:27.265424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:27.296259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96031587-695c-4aee-bfe5-177172f73453 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:27.338171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d32bdc-6fbe-482c-ad92-bc4e6c002179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:27.341004 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d32bdc-6fbe-482c-ad92-bc4e6c002179 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:27.351924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb8886-10e9-4bf9-b019-6adb3dca7b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:27.352575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8886-10e9-4bf9-b019-6adb3dca7b7e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.352893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8886-10e9-4bf9-b019-6adb3dca7b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.353169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb8886-10e9-4bf9-b019-6adb3dca7b7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:27.361397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb8886-10e9-4bf9-b019-6adb3dca7b7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:27.362877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb8886-10e9-4bf9-b019-6adb3dca7b7e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-37bb8886-10e9-4bf9-b019-6adb3dca7b7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:58:27.375974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:27.377242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:27.378191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:58:27.378191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:58:27.378191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:58:27.378191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:58:27.378191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:58:27.378191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:58:27.378191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:58:27.378191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:27.378191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 552/1101] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 15:58:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:27.383271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb8886-10e9-4bf9-b019-6adb3dca7b7e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:27.387134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:27.472127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 550/1102] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:58:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 15:58:27.479819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d32bdc-6fbe-482c-ad92-bc4e6c002179 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:27.510170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb8886-10e9-4bf9-b019-6adb3dca7b7e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:27.541037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:27.554340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541a3db-21de-447f-b79c-73e7c083fea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:27.554960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541a3db-21de-447f-b79c-73e7c083fea3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.555243 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541a3db-21de-447f-b79c-73e7c083fea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.555520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541a3db-21de-447f-b79c-73e7c083fea3 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:27.556215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541a3db-21de-447f-b79c-73e7c083fea3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:27.556526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541a3db-21de-447f-b79c-73e7c083fea3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:27.558048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541a3db-21de-447f-b79c-73e7c083fea3 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:27.571469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 553/1103] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 15:58:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:27.578230 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541a3db-21de-447f-b79c-73e7c083fea3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:27.614716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d32bdc-6fbe-482c-ad92-bc4e6c002179 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:27.655617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ba27d-473e-4349-b6c1-61b0857a4ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:27.656254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ba27d-473e-4349-b6c1-61b0857a4ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.656532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ba27d-473e-4349-b6c1-61b0857a4ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.656849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ba27d-473e-4349-b6c1-61b0857a4ac7 None admin] PATH_INFO: `/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:27.657966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ba27d-473e-4349-b6c1-61b0857a4ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=179cfef2dbdb4d5899dd22e37c0b4f12)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:27.659836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ba27d-473e-4349-b6c1-61b0857a4ac7 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:27.661858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 551/1104] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:58:27 2022] GET /identity/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:27.664337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:27.669924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ba27d-473e-4349-b6c1-61b0857a4ac7 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:27.708037 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541a3db-21de-447f-b79c-73e7c083fea3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:27.752340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfa217-2668-4d02-9aad-870969eb1671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:27.753021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfa217-2668-4d02-9aad-870969eb1671 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.753358 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfa217-2668-4d02-9aad-870969eb1671 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.753692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfa217-2668-4d02-9aad-870969eb1671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:27.754638 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfa217-2668-4d02-9aad-870969eb1671 None admin] RBAC: Adding query filter params (role.id=b57f3b4978524f40ad698b68b0f919fd, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=9d71c0688ea84c05af925f3fb08f35ad) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:27.755005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfa217-2668-4d02-9aad-870969eb1671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:27.756792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfa217-2668-4d02-9aad-870969eb1671 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:27.764109 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 554/1105] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:58:27 2022] GET /identity/v3/role_assignments?user.id=9d71c0688ea84c05af925f3fb08f35ad&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=b57f3b4978524f40ad698b68b0f919fd => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:27.801789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ba27d-473e-4349-b6c1-61b0857a4ac7 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:27.827793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:27.851219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed82da-8ecb-4d30-811a-1c9170cc9f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:27.851900 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed82da-8ecb-4d30-811a-1c9170cc9f39 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.852175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed82da-8ecb-4d30-811a-1c9170cc9f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.852470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed82da-8ecb-4d30-811a-1c9170cc9f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:27.853532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed82da-8ecb-4d30-811a-1c9170cc9f39 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=179cfef2dbdb4d5899dd22e37c0b4f12, user.id=8f11e1ca666d494a8e8870d8d27c8268) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:27.853900 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed82da-8ecb-4d30-811a-1c9170cc9f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:27.856457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed82da-8ecb-4d30-811a-1c9170cc9f39 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:27.866378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 552/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:58:27 2022] GET /identity/v3/role_assignments?user.id=8f11e1ca666d494a8e8870d8d27c8268&scope.project.id=179cfef2dbdb4d5899dd22e37c0b4f12&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:30.160934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b01ac-c59f-4d0a-993f-dcaeabaf9824 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:30.161503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b01ac-c59f-4d0a-993f-dcaeabaf9824 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:30.161828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b01ac-c59f-4d0a-993f-dcaeabaf9824 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:30.164050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 555/1107] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:30.170821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf5d4-257d-443c-a4ec-927e6bce6741 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:30.171345 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf5d4-257d-443c-a4ec-927e6bce6741 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:30.171686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf5d4-257d-443c-a4ec-927e6bce6741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:30.193775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-dd7cf5d4-257d-443c-a4ec-927e6bce6741 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:30.195218 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-dd7cf5d4-257d-443c-a4ec-927e6bce6741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:30.271617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 553/1108] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:30.559662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b01ac-c59f-4d0a-993f-dcaeabaf9824 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:30.687387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b01ac-c59f-4d0a-993f-dcaeabaf9824 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:30.720106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:30.730407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30908-cdc3-4165-9ad0-a19f7e4c9837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:30.731040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30908-cdc3-4165-9ad0-a19f7e4c9837 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:30.731405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30908-cdc3-4165-9ad0-a19f7e4c9837 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:30.731586 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30908-cdc3-4165-9ad0-a19f7e4c9837 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:30.732727 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30908-cdc3-4165-9ad0-a19f7e4c9837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:30.734202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30908-cdc3-4165-9ad0-a19f7e4c9837 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:30.735761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 556/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:30.742079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cf5d4-257d-443c-a4ec-927e6bce6741 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:30.855805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cf5d4-257d-443c-a4ec-927e6bce6741 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:30.871706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:30.897226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e289a6e-96dd-4eb0-85c1-dc0cf9cb5144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:30.897885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e289a6e-96dd-4eb0-85c1-dc0cf9cb5144 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:30.898185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e289a6e-96dd-4eb0-85c1-dc0cf9cb5144 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:30.898479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e289a6e-96dd-4eb0-85c1-dc0cf9cb5144 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:30.899190 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e289a6e-96dd-4eb0-85c1-dc0cf9cb5144 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:30.901304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e289a6e-96dd-4eb0-85c1-dc0cf9cb5144 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:30.926957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 554/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:58:30 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:58:33.253693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d532b2-e711-4391-9a8d-784cfab4e16a None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:33.254338 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d532b2-e711-4391-9a8d-784cfab4e16a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:33.254338 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d532b2-e711-4391-9a8d-784cfab4e16a None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:33.255553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 557/1111] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:33.261113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b794023-ccf0-4592-84c1-40e594f4b10f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:33.261647 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b794023-ccf0-4592-84c1-40e594f4b10f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:33.261647 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b794023-ccf0-4592-84c1-40e594f4b10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:33.282175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7b794023-ccf0-4592-84c1-40e594f4b10f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:33.283276 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7b794023-ccf0-4592-84c1-40e594f4b10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:33.357155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 555/1112] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:33.627074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d532b2-e711-4391-9a8d-784cfab4e16a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:33.748491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d532b2-e711-4391-9a8d-784cfab4e16a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:33.784567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38675f3-09a0-42b4-9b89-6871dd1c04ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:33.785233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38675f3-09a0-42b4-9b89-6871dd1c04ba None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:33.785514 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38675f3-09a0-42b4-9b89-6871dd1c04ba None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:33.785822 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38675f3-09a0-42b4-9b89-6871dd1c04ba None admin] PATH_INFO: `/v3/roles/62c69ea249044f258a2a6f2138ff4ceb` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:33.787296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38675f3-09a0-42b4-9b89-6871dd1c04ba None admin] RBAC: Authorizing `identity:get_role(role_id=62c69ea249044f258a2a6f2138ff4ceb)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:33.788709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38675f3-09a0-42b4-9b89-6871dd1c04ba None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:33.790050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 558/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:58:33 2022] GET /identity/v3/roles/62c69ea249044f258a2a6f2138ff4ceb => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:33.799439 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b794023-ccf0-4592-84c1-40e594f4b10f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:33.927101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:33.933160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b794023-ccf0-4592-84c1-40e594f4b10f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:33.974470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72325773-e101-4b2e-a84b-5c5d65df1b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:33.975398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72325773-e101-4b2e-a84b-5c5d65df1b66 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:33.975891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72325773-e101-4b2e-a84b-5c5d65df1b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:33.976387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72325773-e101-4b2e-a84b-5c5d65df1b66 None admin] PATH_INFO: `/v3/users/3da9ef916ced489a995848a3974fbef4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:33.998626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72325773-e101-4b2e-a84b-5c5d65df1b66 None admin] RBAC: Authorizing `identity:get_user(user_id=3da9ef916ced489a995848a3974fbef4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:34.001326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72325773-e101-4b2e-a84b-5c5d65df1b66 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:34.003906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 556/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:58:33 2022] GET /identity/v3/users/3da9ef916ced489a995848a3974fbef4 => generated 286 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:34.009879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38675f3-09a0-42b4-9b89-6871dd1c04ba None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:34.081790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:34.121663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38675f3-09a0-42b4-9b89-6871dd1c04ba None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:34.163128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d49a99-9066-464c-bc07-8f6ecf79f211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:34.163734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d49a99-9066-464c-bc07-8f6ecf79f211 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:34.164012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d49a99-9066-464c-bc07-8f6ecf79f211 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:34.164283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d49a99-9066-464c-bc07-8f6ecf79f211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:34.235523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d49a99-9066-464c-bc07-8f6ecf79f211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:34.236886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d49a99-9066-464c-bc07-8f6ecf79f211 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:34.302178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:34.344629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 559/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:58:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:58:34.350907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72325773-e101-4b2e-a84b-5c5d65df1b66 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:34.456535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72325773-e101-4b2e-a84b-5c5d65df1b66 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:34.492157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17623c61-5d9d-4e00-9072-0132e9eb4a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:34.493184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17623c61-5d9d-4e00-9072-0132e9eb4a5e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:34.493184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17623c61-5d9d-4e00-9072-0132e9eb4a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:34.493486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17623c61-5d9d-4e00-9072-0132e9eb4a5e None admin] PATH_INFO: `/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:34.494743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17623c61-5d9d-4e00-9072-0132e9eb4a5e None admin] RBAC: Authorizing `identity:get_project(project_id=179cfef2dbdb4d5899dd22e37c0b4f12)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:34.496398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17623c61-5d9d-4e00-9072-0132e9eb4a5e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:34.498387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 557/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:58:34 2022] GET /identity/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:34.505077 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d49a99-9066-464c-bc07-8f6ecf79f211 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:34.615553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d49a99-9066-464c-bc07-8f6ecf79f211 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:34.653133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b0147-f4ce-489a-bc2d-a406bc9e9748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:34.653742 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b0147-f4ce-489a-bc2d-a406bc9e9748 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:34.654082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b0147-f4ce-489a-bc2d-a406bc9e9748 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:34.654315 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b0147-f4ce-489a-bc2d-a406bc9e9748 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:34.655153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b0147-f4ce-489a-bc2d-a406bc9e9748 None admin] RBAC: Adding query filter params (role.id=62c69ea249044f258a2a6f2138ff4ceb, scope.project.id=179cfef2dbdb4d5899dd22e37c0b4f12, user.id=3da9ef916ced489a995848a3974fbef4) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:34.655338 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b0147-f4ce-489a-bc2d-a406bc9e9748 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:34.656935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b0147-f4ce-489a-bc2d-a406bc9e9748 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:34.662983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 560/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:58:34 2022] GET /identity/v3/role_assignments?user.id=3da9ef916ced489a995848a3974fbef4&scope.project.id=179cfef2dbdb4d5899dd22e37c0b4f12&role.id=62c69ea249044f258a2a6f2138ff4ceb => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:36.868485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e19c44-1280-48cb-9589-87750dd14916 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:36.869054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e19c44-1280-48cb-9589-87750dd14916 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:36.869054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e19c44-1280-48cb-9589-87750dd14916 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:36.870439 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 558/1118] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:36.875782 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3306e-e990-431c-a3d8-f64fc19f6255 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:36.876214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3306e-e990-431c-a3d8-f64fc19f6255 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:36.876334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3306e-e990-431c-a3d8-f64fc19f6255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:36.895387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-ccd3306e-e990-431c-a3d8-f64fc19f6255 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:36.896589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ccd3306e-e990-431c-a3d8-f64fc19f6255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:36.920037 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:36.964664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 561/1119] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:58:37.251632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e19c44-1280-48cb-9589-87750dd14916 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:37.277409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:37.357468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e19c44-1280-48cb-9589-87750dd14916 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:37.399541 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb3f71-6f60-4586-ab6d-bb5474392a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:37.400182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb3f71-6f60-4586-ab6d-bb5474392a20 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:37.400475 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb3f71-6f60-4586-ab6d-bb5474392a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:37.401027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb3f71-6f60-4586-ab6d-bb5474392a20 None admin] PATH_INFO: `/v3/roles/62c69ea249044f258a2a6f2138ff4ceb` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:37.402517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb3f71-6f60-4586-ab6d-bb5474392a20 None admin] RBAC: Authorizing `identity:get_role(role_id=62c69ea249044f258a2a6f2138ff4ceb)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:37.403891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb3f71-6f60-4586-ab6d-bb5474392a20 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:37.405252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 559/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:58:37 2022] GET /identity/v3/roles/62c69ea249044f258a2a6f2138ff4ceb => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:37.411715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3306e-e990-431c-a3d8-f64fc19f6255 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:37.508877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3306e-e990-431c-a3d8-f64fc19f6255 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:37.541905 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bf7f1-8d89-4780-99bf-73ed429aa70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:37.542538 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bf7f1-8d89-4780-99bf-73ed429aa70e None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:37.542813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bf7f1-8d89-4780-99bf-73ed429aa70e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:37.543081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bf7f1-8d89-4780-99bf-73ed429aa70e None admin] PATH_INFO: `/v3/users/3da9ef916ced489a995848a3974fbef4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:37.544187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bf7f1-8d89-4780-99bf-73ed429aa70e None admin] RBAC: Authorizing `identity:get_user(user_id=3da9ef916ced489a995848a3974fbef4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:37.545642 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23bf7f1-8d89-4780-99bf-73ed429aa70e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:37.547216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 562/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:58:37 2022] GET /identity/v3/users/3da9ef916ced489a995848a3974fbef4 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:58:37.553150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb3f71-6f60-4586-ab6d-bb5474392a20 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:37.641522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:37.651273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb3f71-6f60-4586-ab6d-bb5474392a20 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:37.685156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6f383-34f3-4c16-8893-a8955282e4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:37.685778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6f383-34f3-4c16-8893-a8955282e4da None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:37.686055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6f383-34f3-4c16-8893-a8955282e4da None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:37.686324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6f383-34f3-4c16-8893-a8955282e4da None admin] PATH_INFO: `/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:37.687435 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6f383-34f3-4c16-8893-a8955282e4da None admin] RBAC: Authorizing `identity:get_project(project_id=179cfef2dbdb4d5899dd22e37c0b4f12)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:37.688891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6f383-34f3-4c16-8893-a8955282e4da None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:37.690518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 560/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:58:37 2022] GET /identity/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:37.696553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bf7f1-8d89-4780-99bf-73ed429aa70e None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:37.725525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:37.799843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bf7f1-8d89-4780-99bf-73ed429aa70e None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:37.832869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef814f7-7b13-472a-938b-461541c9c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:37.833520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef814f7-7b13-472a-938b-461541c9c4da None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:37.833800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef814f7-7b13-472a-938b-461541c9c4da None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:37.834075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef814f7-7b13-472a-938b-461541c9c4da None admin] PATH_INFO: `/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12/users/3da9ef916ced489a995848a3974fbef4/roles/62c69ea249044f258a2a6f2138ff4ceb` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:37.836202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef814f7-7b13-472a-938b-461541c9c4da None admin] RBAC: Authorizing `identity:create_grant(project_id=179cfef2dbdb4d5899dd22e37c0b4f12, user_id=3da9ef916ced489a995848a3974fbef4, role_id=62c69ea249044f258a2a6f2138ff4ceb)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:37.837669 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef814f7-7b13-472a-938b-461541c9c4da None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:37.851833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 563/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:58:37 2022] PUT /identity/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12/users/3da9ef916ced489a995848a3974fbef4/roles/62c69ea249044f258a2a6f2138ff4ceb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:40.007939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2dbd4-6116-4e99-8794-28020c8c706f None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:40.008480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2dbd4-6116-4e99-8794-28020c8c706f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:40.008480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2dbd4-6116-4e99-8794-28020c8c706f None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:40.010425 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 561/1124] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:40.016011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6f645-b659-4917-a461-5f3d5d324867 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:40.016499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6f645-b659-4917-a461-5f3d5d324867 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:40.016601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6f645-b659-4917-a461-5f3d5d324867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:40.042073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e7d6f645-b659-4917-a461-5f3d5d324867 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:40.043315 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e7d6f645-b659-4917-a461-5f3d5d324867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:40.113820 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 564/1125] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:40.379393 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2dbd4-6116-4e99-8794-28020c8c706f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:40.486682 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2dbd4-6116-4e99-8794-28020c8c706f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:40.523114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1023a79-5891-40cb-b54f-9150742c7087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:40.523738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1023a79-5891-40cb-b54f-9150742c7087 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:40.524015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1023a79-5891-40cb-b54f-9150742c7087 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:40.524287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1023a79-5891-40cb-b54f-9150742c7087 None admin] PATH_INFO: `/v3/roles/62c69ea249044f258a2a6f2138ff4ceb` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:40.526233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1023a79-5891-40cb-b54f-9150742c7087 None admin] RBAC: Authorizing `identity:get_role(role_id=62c69ea249044f258a2a6f2138ff4ceb)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:40.527637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1023a79-5891-40cb-b54f-9150742c7087 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:40.528990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 562/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:58:40 2022] GET /identity/v3/roles/62c69ea249044f258a2a6f2138ff4ceb => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:40.534925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6f645-b659-4917-a461-5f3d5d324867 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:40.553027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:40.643278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6f645-b659-4917-a461-5f3d5d324867 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:40.677619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81753952-2e6e-4f3d-9916-45398e977bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:40.678266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81753952-2e6e-4f3d-9916-45398e977bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:40.678554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81753952-2e6e-4f3d-9916-45398e977bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:40.678834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81753952-2e6e-4f3d-9916-45398e977bc8 None admin] PATH_INFO: `/v3/users/3da9ef916ced489a995848a3974fbef4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:40.679991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81753952-2e6e-4f3d-9916-45398e977bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=3da9ef916ced489a995848a3974fbef4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:40.681476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81753952-2e6e-4f3d-9916-45398e977bc8 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:40.683137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 565/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:58:40 2022] GET /identity/v3/users/3da9ef916ced489a995848a3974fbef4 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:40.688957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1023a79-5891-40cb-b54f-9150742c7087 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:40.717918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:40.794163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1023a79-5891-40cb-b54f-9150742c7087 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:40.828395 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb7785-2675-4d81-837c-92c81d5801c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:40.829020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb7785-2675-4d81-837c-92c81d5801c4 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:40.829297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb7785-2675-4d81-837c-92c81d5801c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:40.829567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb7785-2675-4d81-837c-92c81d5801c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:40.897111 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb7785-2675-4d81-837c-92c81d5801c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:40.898487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb7785-2675-4d81-837c-92c81d5801c4 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:40.926479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:41.001795 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 563/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:58:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:58:41.007823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81753952-2e6e-4f3d-9916-45398e977bc8 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:41.098823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:41.115710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81753952-2e6e-4f3d-9916-45398e977bc8 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:41.156446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1d340-76e6-4b41-a674-dcd225128bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:41.157022 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1d340-76e6-4b41-a674-dcd225128bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:41.157306 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1d340-76e6-4b41-a674-dcd225128bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:41.157585 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1d340-76e6-4b41-a674-dcd225128bb2 None admin] PATH_INFO: `/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:41.158694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1d340-76e6-4b41-a674-dcd225128bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=179cfef2dbdb4d5899dd22e37c0b4f12)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:41.160265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1d340-76e6-4b41-a674-dcd225128bb2 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:41.161940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 566/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:58:41 2022] GET /identity/v3/projects/179cfef2dbdb4d5899dd22e37c0b4f12 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:41.169084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb7785-2675-4d81-837c-92c81d5801c4 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:41.270113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb7785-2675-4d81-837c-92c81d5801c4 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:41.296037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:41.304374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd3f7c-9e7c-430b-ba99-1fe2e964de93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:41.304998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd3f7c-9e7c-430b-ba99-1fe2e964de93 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:41.305277 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd3f7c-9e7c-430b-ba99-1fe2e964de93 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:41.305553 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd3f7c-9e7c-430b-ba99-1fe2e964de93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:41.306269 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd3f7c-9e7c-430b-ba99-1fe2e964de93 None admin] RBAC: Adding query filter params (role.id=62c69ea249044f258a2a6f2138ff4ceb, scope.project.id=179cfef2dbdb4d5899dd22e37c0b4f12, user.id=3da9ef916ced489a995848a3974fbef4) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:41.307131 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd3f7c-9e7c-430b-ba99-1fe2e964de93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:41.308848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd3f7c-9e7c-430b-ba99-1fe2e964de93 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:41.314919 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 564/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:58:41 2022] GET /identity/v3/role_assignments?user.id=3da9ef916ced489a995848a3974fbef4&scope.project.id=179cfef2dbdb4d5899dd22e37c0b4f12&role.id=62c69ea249044f258a2a6f2138ff4ceb => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:43.547013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692801c-8ff2-48d4-aeb7-44fc7f16ab39 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:43.547628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692801c-8ff2-48d4-aeb7-44fc7f16ab39 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:43.547628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692801c-8ff2-48d4-aeb7-44fc7f16ab39 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:43.548944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 567/1131] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:43.554865 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b093f1-3929-4076-a213-da146a5a5d42 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:43.555394 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b093f1-3929-4076-a213-da146a5a5d42 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:43.555394 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b093f1-3929-4076-a213-da146a5a5d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:43.575524 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-32b093f1-3929-4076-a213-da146a5a5d42 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:43.576792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-32b093f1-3929-4076-a213-da146a5a5d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:43.652196 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 565/1132] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:43.928623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692801c-8ff2-48d4-aeb7-44fc7f16ab39 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:44.040539 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692801c-8ff2-48d4-aeb7-44fc7f16ab39 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:44.081143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357fc02-edca-4efe-8134-f87f87952123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:44.081793 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357fc02-edca-4efe-8134-f87f87952123 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:44.082069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357fc02-edca-4efe-8134-f87f87952123 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:44.082341 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357fc02-edca-4efe-8134-f87f87952123 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:44.083612 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357fc02-edca-4efe-8134-f87f87952123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:44.085195 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357fc02-edca-4efe-8134-f87f87952123 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:44.086901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 568/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:44.093431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b093f1-3929-4076-a213-da146a5a5d42 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:44.220062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b093f1-3929-4076-a213-da146a5a5d42 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:44.249175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:44.262466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c71fa-8ec6-495d-9068-6441ef88e054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:44.263076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c71fa-8ec6-495d-9068-6441ef88e054 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:44.263357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c71fa-8ec6-495d-9068-6441ef88e054 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:44.263633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c71fa-8ec6-495d-9068-6441ef88e054 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:44.264310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c71fa-8ec6-495d-9068-6441ef88e054 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:44.265766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c71fa-8ec6-495d-9068-6441ef88e054 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:44.294781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 566/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:58:44 2022] POST /identity/v3/projects => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:58:46.563301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bbc22-12ca-449c-93f5-5020d74fbe26 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:46.563872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bbc22-12ca-449c-93f5-5020d74fbe26 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:46.563872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bbc22-12ca-449c-93f5-5020d74fbe26 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:46.565258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 569/1135] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:46.571914 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2e6c5-e151-43c0-a6a9-b5158e45953c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:46.573125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2e6c5-e151-43c0-a6a9-b5158e45953c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:46.573589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2e6c5-e151-43c0-a6a9-b5158e45953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:46.593836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-25c2e6c5-e151-43c0-a6a9-b5158e45953c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:46.595056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-25c2e6c5-e151-43c0-a6a9-b5158e45953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:46.672447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 567/1136] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:46.965653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bbc22-12ca-449c-93f5-5020d74fbe26 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:46.989019 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:47.085570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bbc22-12ca-449c-93f5-5020d74fbe26 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:47.121891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cd273-5416-4475-8fff-f348da1fcf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:47.122525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cd273-5416-4475-8fff-f348da1fcf28 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:47.122803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cd273-5416-4475-8fff-f348da1fcf28 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:47.123075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cd273-5416-4475-8fff-f348da1fcf28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:47.124181 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cd273-5416-4475-8fff-f348da1fcf28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:47.125642 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cd273-5416-4475-8fff-f348da1fcf28 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:47.127208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 570/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 15:58:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:47.136234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2e6c5-e151-43c0-a6a9-b5158e45953c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:47.248277 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2e6c5-e151-43c0-a6a9-b5158e45953c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:47.250683 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:47.286636 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795bd98-f6e6-4548-b66d-dd28717ac180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:47.287238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795bd98-f6e6-4548-b66d-dd28717ac180 None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:47.287516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795bd98-f6e6-4548-b66d-dd28717ac180 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:47.287786 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795bd98-f6e6-4548-b66d-dd28717ac180 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:47.288432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795bd98-f6e6-4548-b66d-dd28717ac180 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:47.289959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795bd98-f6e6-4548-b66d-dd28717ac180 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:47.313397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 568/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:58:47 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:58:49.596959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a4130-9cde-4bb8-bae0-f96397899bea None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:49.597502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a4130-9cde-4bb8-bae0-f96397899bea None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:49.597611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a4130-9cde-4bb8-bae0-f96397899bea None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:49.598882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 571/1139] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:49.604386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f16bc-3a3c-418a-a264-63423e37fd2f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:49.604870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f16bc-3a3c-418a-a264-63423e37fd2f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:49.604961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f16bc-3a3c-418a-a264-63423e37fd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:49.623149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7f9f16bc-3a3c-418a-a264-63423e37fd2f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:49.624346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7f9f16bc-3a3c-418a-a264-63423e37fd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:49.692388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 569/1140] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:49.960250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a4130-9cde-4bb8-bae0-f96397899bea None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:50.053995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:50.068020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a4130-9cde-4bb8-bae0-f96397899bea None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:50.101961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c1926-f616-440c-8053-1a102d0614a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:50.102587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c1926-f616-440c-8053-1a102d0614a4 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:50.102869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c1926-f616-440c-8053-1a102d0614a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:50.103656 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c1926-f616-440c-8053-1a102d0614a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:50.114275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c1926-f616-440c-8053-1a102d0614a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-524c1926-f616-440c-8053-1a102d0614a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:58:50.119701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:50.124762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:50.125991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 572/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:58:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:50.127328 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f16bc-3a3c-418a-a264-63423e37fd2f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:50.236878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:50.248519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f16bc-3a3c-418a-a264-63423e37fd2f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:50.283932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448392eb-1178-47dc-88ec-33569e3c1578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:50.284538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448392eb-1178-47dc-88ec-33569e3c1578 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:50.284859 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448392eb-1178-47dc-88ec-33569e3c1578 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:50.285134 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448392eb-1178-47dc-88ec-33569e3c1578 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:50.285819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448392eb-1178-47dc-88ec-33569e3c1578 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:50.286102 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448392eb-1178-47dc-88ec-33569e3c1578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:50.287474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448392eb-1178-47dc-88ec-33569e3c1578 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:50.297128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 570/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:58:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:50.303541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c1926-f616-440c-8053-1a102d0614a4 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:50.406343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c1926-f616-440c-8053-1a102d0614a4 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:50.440764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721143a1-6a7d-402f-89cb-954cc13f126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:50.441399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721143a1-6a7d-402f-89cb-954cc13f126c None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:50.441681 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721143a1-6a7d-402f-89cb-954cc13f126c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:50.441953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721143a1-6a7d-402f-89cb-954cc13f126c None admin] PATH_INFO: `/v3/users/cffaf099e23d4b1cb1be347f7d573234` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:50.457226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721143a1-6a7d-402f-89cb-954cc13f126c None admin] RBAC: Authorizing `identity:get_user(user_id=cffaf099e23d4b1cb1be347f7d573234)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:50.458682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721143a1-6a7d-402f-89cb-954cc13f126c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:50.460340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 573/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:58:50 2022] GET /identity/v3/users/cffaf099e23d4b1cb1be347f7d573234 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:50.467467 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448392eb-1178-47dc-88ec-33569e3c1578 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:50.577063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448392eb-1178-47dc-88ec-33569e3c1578 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:50.614200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4290-90b3-46f8-b949-d90307a2b6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:50.615161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4290-90b3-46f8-b949-d90307a2b6da None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:50.615161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4290-90b3-46f8-b949-d90307a2b6da None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:50.615430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4290-90b3-46f8-b949-d90307a2b6da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:50.639259 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:50.689954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d4290-90b3-46f8-b949-d90307a2b6da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:50.691606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d4290-90b3-46f8-b949-d90307a2b6da None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:50.794371 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 571/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:58:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:58:50.800483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721143a1-6a7d-402f-89cb-954cc13f126c None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:50.809960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:50.905611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721143a1-6a7d-402f-89cb-954cc13f126c None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:50.941430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e2a11-850e-4dc2-89b5-ec53d1eda202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:50.942064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2a11-850e-4dc2-89b5-ec53d1eda202 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:50.942344 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2a11-850e-4dc2-89b5-ec53d1eda202 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:50.942615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2a11-850e-4dc2-89b5-ec53d1eda202 None admin] PATH_INFO: `/v3/projects/44fd337fcb254a7f983a402e7e701581` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:50.943805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e2a11-850e-4dc2-89b5-ec53d1eda202 None admin] RBAC: Authorizing `identity:get_project(project_id=44fd337fcb254a7f983a402e7e701581)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:50.945279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e2a11-850e-4dc2-89b5-ec53d1eda202 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:50.947484 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 574/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:58:50 2022] GET /identity/v3/projects/44fd337fcb254a7f983a402e7e701581 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:50.953989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4290-90b3-46f8-b949-d90307a2b6da None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:51.007628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:51.068438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4290-90b3-46f8-b949-d90307a2b6da None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:51.106330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3225e71-58fa-42f3-a632-e08561c1dd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:51.106928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3225e71-58fa-42f3-a632-e08561c1dd08 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:51.107205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3225e71-58fa-42f3-a632-e08561c1dd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:51.107469 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3225e71-58fa-42f3-a632-e08561c1dd08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:51.108184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3225e71-58fa-42f3-a632-e08561c1dd08 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=44fd337fcb254a7f983a402e7e701581, user.id=cffaf099e23d4b1cb1be347f7d573234) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:51.108486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3225e71-58fa-42f3-a632-e08561c1dd08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:51.109944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3225e71-58fa-42f3-a632-e08561c1dd08 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:51.115298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 572/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:58:50 2022] GET /identity/v3/role_assignments?user.id=cffaf099e23d4b1cb1be347f7d573234&scope.project.id=44fd337fcb254a7f983a402e7e701581&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:53.317035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915eb018-507a-4217-8048-4d4ef5a7aee9 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:53.317564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915eb018-507a-4217-8048-4d4ef5a7aee9 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:53.317564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915eb018-507a-4217-8048-4d4ef5a7aee9 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:53.318852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 575/1147] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:53.324728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee70990-b786-4946-bc3f-8750963578ff None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:53.325166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee70990-b786-4946-bc3f-8750963578ff None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:53.325274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee70990-b786-4946-bc3f-8750963578ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:53.343864 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-8ee70990-b786-4946-bc3f-8750963578ff None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:53.345096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8ee70990-b786-4946-bc3f-8750963578ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:53.412837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 573/1148] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:53.682663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915eb018-507a-4217-8048-4d4ef5a7aee9 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:53.772695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:53.814581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915eb018-507a-4217-8048-4d4ef5a7aee9 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:53.849620 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407d42a-f970-4bea-a9ce-e44be80848e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:53.850244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407d42a-f970-4bea-a9ce-e44be80848e3 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:53.850523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407d42a-f970-4bea-a9ce-e44be80848e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:53.850797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407d42a-f970-4bea-a9ce-e44be80848e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:53.861873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407d42a-f970-4bea-a9ce-e44be80848e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-2407d42a-f970-4bea-a9ce-e44be80848e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:58:53.866695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:53.867898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:58:53.869224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 576/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:58:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:58:53.883473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee70990-b786-4946-bc3f-8750963578ff None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:53.934060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:53.986818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee70990-b786-4946-bc3f-8750963578ff None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:54.022133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee595d68-80ba-48ce-a8ac-1cac218867cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:54.022743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee595d68-80ba-48ce-a8ac-1cac218867cc None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:54.023022 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee595d68-80ba-48ce-a8ac-1cac218867cc None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:54.023356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee595d68-80ba-48ce-a8ac-1cac218867cc None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:54.024028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee595d68-80ba-48ce-a8ac-1cac218867cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:54.024328 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee595d68-80ba-48ce-a8ac-1cac218867cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:54.026090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee595d68-80ba-48ce-a8ac-1cac218867cc None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:54.034915 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 574/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:58:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:54.041437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407d42a-f970-4bea-a9ce-e44be80848e3 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:54.144134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407d42a-f970-4bea-a9ce-e44be80848e3 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:54.179308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2cda5-0c18-4476-9c7e-709d33a3e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:54.179938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2cda5-0c18-4476-9c7e-709d33a3e9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:54.180222 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2cda5-0c18-4476-9c7e-709d33a3e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:54.180495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2cda5-0c18-4476-9c7e-709d33a3e9f2 None admin] PATH_INFO: `/v3/users/cffaf099e23d4b1cb1be347f7d573234` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:54.181889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2cda5-0c18-4476-9c7e-709d33a3e9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cffaf099e23d4b1cb1be347f7d573234)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:54.183322 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2cda5-0c18-4476-9c7e-709d33a3e9f2 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:54.184991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 577/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:58:54 2022] GET /identity/v3/users/cffaf099e23d4b1cb1be347f7d573234 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:54.190871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee595d68-80ba-48ce-a8ac-1cac218867cc None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:54.291515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee595d68-80ba-48ce-a8ac-1cac218867cc None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:54.300719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:54.325640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf1121-ddb1-4acd-996e-b1f32b8f2659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:54.326308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1121-ddb1-4acd-996e-b1f32b8f2659 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:54.326540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1121-ddb1-4acd-996e-b1f32b8f2659 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:54.326817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1121-ddb1-4acd-996e-b1f32b8f2659 None admin] PATH_INFO: `/v3/projects/44fd337fcb254a7f983a402e7e701581` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:54.327943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf1121-ddb1-4acd-996e-b1f32b8f2659 None admin] RBAC: Authorizing `identity:get_project(project_id=44fd337fcb254a7f983a402e7e701581)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:54.329408 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf1121-ddb1-4acd-996e-b1f32b8f2659 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:54.331038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 575/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:58:54 2022] GET /identity/v3/projects/44fd337fcb254a7f983a402e7e701581 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:54.337042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2cda5-0c18-4476-9c7e-709d33a3e9f2 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:54.340441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:54.441657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2cda5-0c18-4476-9c7e-709d33a3e9f2 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:54.475097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1209664-e6c2-45a8-8783-02a0079a424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:54.475758 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1209664-e6c2-45a8-8783-02a0079a424f None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:54.476037 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1209664-e6c2-45a8-8783-02a0079a424f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:54.476309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1209664-e6c2-45a8-8783-02a0079a424f None admin] PATH_INFO: `/v3/projects/44fd337fcb254a7f983a402e7e701581/users/cffaf099e23d4b1cb1be347f7d573234/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:54.478912 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1209664-e6c2-45a8-8783-02a0079a424f None admin] RBAC: Authorizing `identity:create_grant(project_id=44fd337fcb254a7f983a402e7e701581, user_id=cffaf099e23d4b1cb1be347f7d573234, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:54.480355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1209664-e6c2-45a8-8783-02a0079a424f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:54.495121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 578/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:58:54 2022] PUT /identity/v3/projects/44fd337fcb254a7f983a402e7e701581/users/cffaf099e23d4b1cb1be347f7d573234/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:56.672083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf253fe-47bd-4f7e-88ab-3710a51b63ba None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:56.672622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf253fe-47bd-4f7e-88ab-3710a51b63ba None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:56.672622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf253fe-47bd-4f7e-88ab-3710a51b63ba None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:56.674003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 576/1154] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:58:56.679403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e417ee4-5d42-42a0-a424-1bac9cd20067 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:56.679830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e417ee4-5d42-42a0-a424-1bac9cd20067 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:56.679958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e417ee4-5d42-42a0-a424-1bac9cd20067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:56.698314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8e417ee4-5d42-42a0-a424-1bac9cd20067 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:56.699522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8e417ee4-5d42-42a0-a424-1bac9cd20067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:56.761220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:56.772657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 579/1155] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:58:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:58:57.048363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf253fe-47bd-4f7e-88ab-3710a51b63ba None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:57.154945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf253fe-47bd-4f7e-88ab-3710a51b63ba None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:57.192005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01bb7-5052-4418-9aaa-fb52b8552d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:57.192637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01bb7-5052-4418-9aaa-fb52b8552d72 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:57.192940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01bb7-5052-4418-9aaa-fb52b8552d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:57.193209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01bb7-5052-4418-9aaa-fb52b8552d72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:57.203904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db01bb7-5052-4418-9aaa-fb52b8552d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-7db01bb7-5052-4418-9aaa-fb52b8552d72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:58:57.208771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:58:57.210365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:58:57.211501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 577/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:58:57.217928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e417ee4-5d42-42a0-a424-1bac9cd20067 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:57.318023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e417ee4-5d42-42a0-a424-1bac9cd20067 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:57.353670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c896c-1c7c-443b-b7b8-7c221de70e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:57.354291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c896c-1c7c-443b-b7b8-7c221de70e78 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:57.354569 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c896c-1c7c-443b-b7b8-7c221de70e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:57.354843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c896c-1c7c-443b-b7b8-7c221de70e78 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:57.355512 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c896c-1c7c-443b-b7b8-7c221de70e78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:57.355818 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c896c-1c7c-443b-b7b8-7c221de70e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:57.357221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c896c-1c7c-443b-b7b8-7c221de70e78 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:57.365399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 580/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:57.371649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01bb7-5052-4418-9aaa-fb52b8552d72 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:57.406599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:57.474504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01bb7-5052-4418-9aaa-fb52b8552d72 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:57.509667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769f9a5-e3c8-4525-9455-1e38dccef448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:57.510556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769f9a5-e3c8-4525-9455-1e38dccef448 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:57.510837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769f9a5-e3c8-4525-9455-1e38dccef448 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:57.511107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769f9a5-e3c8-4525-9455-1e38dccef448 None admin] PATH_INFO: `/v3/users/cffaf099e23d4b1cb1be347f7d573234` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:57.512220 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769f9a5-e3c8-4525-9455-1e38dccef448 None admin] RBAC: Authorizing `identity:get_user(user_id=cffaf099e23d4b1cb1be347f7d573234)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:57.513672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769f9a5-e3c8-4525-9455-1e38dccef448 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:57.515241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 578/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:58:57 2022] GET /identity/v3/users/cffaf099e23d4b1cb1be347f7d573234 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:57.521508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c896c-1c7c-443b-b7b8-7c221de70e78 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:57.580002 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:57.627254 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c896c-1c7c-443b-b7b8-7c221de70e78 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:57.660877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f78ad-f465-493e-b953-28a677795250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:57.661490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f78ad-f465-493e-b953-28a677795250 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:57.661769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f78ad-f465-493e-b953-28a677795250 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:57.662040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f78ad-f465-493e-b953-28a677795250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:57.732790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f78ad-f465-493e-b953-28a677795250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:57.734256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f78ad-f465-493e-b953-28a677795250 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:57.788495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:57.835319 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 581/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:58:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:58:57.841663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769f9a5-e3c8-4525-9455-1e38dccef448 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:57.979490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769f9a5-e3c8-4525-9455-1e38dccef448 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:57.981899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:58.017720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7360-9790-4c43-9de7-291afc1b3e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:58.018607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7360-9790-4c43-9de7-291afc1b3e17 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:58.018881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7360-9790-4c43-9de7-291afc1b3e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:58.019147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7360-9790-4c43-9de7-291afc1b3e17 None admin] PATH_INFO: `/v3/projects/44fd337fcb254a7f983a402e7e701581` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:58.020261 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa7360-9790-4c43-9de7-291afc1b3e17 None admin] RBAC: Authorizing `identity:get_project(project_id=44fd337fcb254a7f983a402e7e701581)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:58.021716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa7360-9790-4c43-9de7-291afc1b3e17 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:58.023381 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 579/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:58:57 2022] GET /identity/v3/projects/44fd337fcb254a7f983a402e7e701581 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:58.030343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f78ad-f465-493e-b953-28a677795250 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:58.137996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f78ad-f465-493e-b953-28a677795250 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:58.173462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb3553-dda7-4fcc-a2b6-c3d1e61e4976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:58.174062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb3553-dda7-4fcc-a2b6-c3d1e61e4976 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:58.174340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb3553-dda7-4fcc-a2b6-c3d1e61e4976 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:58.174613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb3553-dda7-4fcc-a2b6-c3d1e61e4976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:58.175335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb3553-dda7-4fcc-a2b6-c3d1e61e4976 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=44fd337fcb254a7f983a402e7e701581, user.id=cffaf099e23d4b1cb1be347f7d573234) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:58.175644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb3553-dda7-4fcc-a2b6-c3d1e61e4976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:58.177126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb3553-dda7-4fcc-a2b6-c3d1e61e4976 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:58.183044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 582/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:58:58 2022] GET /identity/v3/role_assignments?user.id=cffaf099e23d4b1cb1be347f7d573234&scope.project.id=44fd337fcb254a7f983a402e7e701581&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:00.445470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a52c7e-4c68-4973-b90d-6bd05ac08299 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:00.446045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a52c7e-4c68-4973-b90d-6bd05ac08299 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:00.446045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a52c7e-4c68-4973-b90d-6bd05ac08299 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:00.448563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 580/1162] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:59:00.454476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08f513-72ca-4737-80bd-08cbf9b53c5a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:00.454966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08f513-72ca-4737-80bd-08cbf9b53c5a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:00.455096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08f513-72ca-4737-80bd-08cbf9b53c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:00.474551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-2e08f513-72ca-4737-80bd-08cbf9b53c5a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:00.475805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2e08f513-72ca-4737-80bd-08cbf9b53c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:00.490476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:00.548308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 583/1163] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:59:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:59:00.827028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a52c7e-4c68-4973-b90d-6bd05ac08299 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:00.936230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a52c7e-4c68-4973-b90d-6bd05ac08299 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:00.971582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a82622-91c1-4ffd-a2dd-0c3df8edc698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:00.972193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a82622-91c1-4ffd-a2dd-0c3df8edc698 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:00.972474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a82622-91c1-4ffd-a2dd-0c3df8edc698 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:00.972776 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a82622-91c1-4ffd-a2dd-0c3df8edc698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:01.016815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:01.045645 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a82622-91c1-4ffd-a2dd-0c3df8edc698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:01.047103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a82622-91c1-4ffd-a2dd-0c3df8edc698 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:01.151886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 581/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:59:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:59:01.157830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08f513-72ca-4737-80bd-08cbf9b53c5a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:01.265771 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08f513-72ca-4737-80bd-08cbf9b53c5a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:01.301566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eae69-17f4-40ba-8305-26b19a9e7a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:01.302204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eae69-17f4-40ba-8305-26b19a9e7a1d None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:01.302482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eae69-17f4-40ba-8305-26b19a9e7a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:01.302752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eae69-17f4-40ba-8305-26b19a9e7a1d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:01.311073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eae69-17f4-40ba-8305-26b19a9e7a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:01.312585 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eae69-17f4-40ba-8305-26b19a9e7a1d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-818eae69-17f4-40ba-8305-26b19a9e7a1d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:59:01.325741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:59:01.327061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:59:01.327945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 584/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Sep 7 15:59:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:59:01.333160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a82622-91c1-4ffd-a2dd-0c3df8edc698 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:01.406522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:01.437461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a82622-91c1-4ffd-a2dd-0c3df8edc698 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:01.474182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb0c61-9b39-4c79-980e-ff7b8eeeb3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:01.474852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb0c61-9b39-4c79-980e-ff7b8eeeb3fe None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:01.475073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb0c61-9b39-4c79-980e-ff7b8eeeb3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:01.475344 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb0c61-9b39-4c79-980e-ff7b8eeeb3fe None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:01.476005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb0c61-9b39-4c79-980e-ff7b8eeeb3fe None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:59:01.476311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb0c61-9b39-4c79-980e-ff7b8eeeb3fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:01.478274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb0c61-9b39-4c79-980e-ff7b8eeeb3fe None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:01.486479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 582/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Sep 7 15:59:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:03.703572 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c493a3-97ac-4b46-970d-1f49fe78984a None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:03.704158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c493a3-97ac-4b46-970d-1f49fe78984a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:03.704158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c493a3-97ac-4b46-970d-1f49fe78984a None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:03.705502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 585/1167] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:59:03.710966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a80ba-cd82-4221-98a5-74c4c93a8aad None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:03.711426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a80ba-cd82-4221-98a5-74c4c93a8aad None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:03.711517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a80ba-cd82-4221-98a5-74c4c93a8aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:03.730463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-4f1a80ba-cd82-4221-98a5-74c4c93a8aad None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:03.731678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4f1a80ba-cd82-4221-98a5-74c4c93a8aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:03.802315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 583/1168] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:59:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:59:04.069915 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c493a3-97ac-4b46-970d-1f49fe78984a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:04.081194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:04.170217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c493a3-97ac-4b46-970d-1f49fe78984a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:04.203813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca341fe6-b6ff-4b3f-bfad-93a7012a4fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:04.204417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca341fe6-b6ff-4b3f-bfad-93a7012a4fc5 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:04.204714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca341fe6-b6ff-4b3f-bfad-93a7012a4fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:04.204989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca341fe6-b6ff-4b3f-bfad-93a7012a4fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:04.205664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca341fe6-b6ff-4b3f-bfad-93a7012a4fc5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:04.207027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca341fe6-b6ff-4b3f-bfad-93a7012a4fc5 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:04.223101 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 586/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Wed Sep 7 15:59:04 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:59:06.445764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981365c3-cf6a-48a1-a2f4-9e4ad16c4b13 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:06.446344 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981365c3-cf6a-48a1-a2f4-9e4ad16c4b13 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:06.446447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981365c3-cf6a-48a1-a2f4-9e4ad16c4b13 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:06.448504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 584/1170] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:59:06.454154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a42f12-4638-49e7-bb11-8f553dabaa8d None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:06.454623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a42f12-4638-49e7-bb11-8f553dabaa8d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:06.454727 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a42f12-4638-49e7-bb11-8f553dabaa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:06.473137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e9a42f12-4638-49e7-bb11-8f553dabaa8d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:06.474329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e9a42f12-4638-49e7-bb11-8f553dabaa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:06.537093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:06.544613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 587/1171] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:59:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:59:06.819870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981365c3-cf6a-48a1-a2f4-9e4ad16c4b13 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:06.891717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:06.928453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981365c3-cf6a-48a1-a2f4-9e4ad16c4b13 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:06.964000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6050c8c-0711-4655-ac42-fe2054ca52ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:06.964620 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050c8c-0711-4655-ac42-fe2054ca52ab None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:06.964929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050c8c-0711-4655-ac42-fe2054ca52ab None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:06.965205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050c8c-0711-4655-ac42-fe2054ca52ab None admin] PATH_INFO: `/v3/domains/ba4f50b1c6ee48058c3a59db7ac45e7d` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:06.975665 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6050c8c-0711-4655-ac42-fe2054ca52ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=ba4f50b1c6ee48058c3a59db7ac45e7d)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:06.977191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6050c8c-0711-4655-ac42-fe2054ca52ab None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:06.978842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 585/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Wed Sep 7 15:59:06 2022] GET /identity/v3/domains/ba4f50b1c6ee48058c3a59db7ac45e7d => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:06.984763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a42f12-4638-49e7-bb11-8f553dabaa8d None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:07.089679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a42f12-4638-49e7-bb11-8f553dabaa8d None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:07.123958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770e54d-0e98-4547-8d00-3574389ec6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:07.124566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770e54d-0e98-4547-8d00-3574389ec6f0 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:07.124876 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770e54d-0e98-4547-8d00-3574389ec6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:07.125151 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770e54d-0e98-4547-8d00-3574389ec6f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:07.125806 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770e54d-0e98-4547-8d00-3574389ec6f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:07.127249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770e54d-0e98-4547-8d00-3574389ec6f0 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:07.156203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 588/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 15:59:06 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:59:09.412942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9868e-4c08-4c5f-886c-8543dbaafa8f None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:09.413477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9868e-4c08-4c5f-886c-8543dbaafa8f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:09.413477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9868e-4c08-4c5f-886c-8543dbaafa8f None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:09.414731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 586/1174] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:59:09.420744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f300-dc74-4039-beb1-bde0b84f7a72 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:09.421214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f300-dc74-4039-beb1-bde0b84f7a72 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:09.421320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f300-dc74-4039-beb1-bde0b84f7a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:09.440207 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-2636f300-dc74-4039-beb1-bde0b84f7a72 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:09.441472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2636f300-dc74-4039-beb1-bde0b84f7a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:09.500281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:09.524334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 589/1175] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:59:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:59:09.802725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9868e-4c08-4c5f-886c-8543dbaafa8f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:09.907923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9868e-4c08-4c5f-886c-8543dbaafa8f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:09.934761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:09.943623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b6ea1-e226-45a9-a667-4aefa4056d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:09.944246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b6ea1-e226-45a9-a667-4aefa4056d91 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:09.944518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b6ea1-e226-45a9-a667-4aefa4056d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:09.944819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b6ea1-e226-45a9-a667-4aefa4056d91 None admin] PATH_INFO: `/v3/domains/ba4f50b1c6ee48058c3a59db7ac45e7d` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:09.945930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b6ea1-e226-45a9-a667-4aefa4056d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ba4f50b1c6ee48058c3a59db7ac45e7d)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:09.947897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b6ea1-e226-45a9-a667-4aefa4056d91 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:09.949484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 587/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Wed Sep 7 15:59:09 2022] GET /identity/v3/domains/ba4f50b1c6ee48058c3a59db7ac45e7d => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:09.955308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636f300-dc74-4039-beb1-bde0b84f7a72 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:10.058010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636f300-dc74-4039-beb1-bde0b84f7a72 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:10.092817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3918e-ba33-4798-9c9b-72015b070dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:10.093425 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3918e-ba33-4798-9c9b-72015b070dbc None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:10.093706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3918e-ba33-4798-9c9b-72015b070dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:10.093977 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3918e-ba33-4798-9c9b-72015b070dbc None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:10.094644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3918e-ba33-4798-9c9b-72015b070dbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:10.096077 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3918e-ba33-4798-9c9b-72015b070dbc None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:10.121933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 590/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 15:59:09 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:59:12.424978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6388113-d971-4d39-9aa5-e3723481bae4 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:12.425548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6388113-d971-4d39-9aa5-e3723481bae4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:12.425548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6388113-d971-4d39-9aa5-e3723481bae4 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:12.426863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 588/1178] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:59:12.433196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3438d5-111b-4a7e-9b76-ace3c38dcae7 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:12.433666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3438d5-111b-4a7e-9b76-ace3c38dcae7 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:12.433758 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3438d5-111b-4a7e-9b76-ace3c38dcae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:12.452477 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-cf3438d5-111b-4a7e-9b76-ace3c38dcae7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:12.453704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-cf3438d5-111b-4a7e-9b76-ace3c38dcae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:12.483503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:12.528594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 591/1179] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:59:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:59:12.803735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6388113-d971-4d39-9aa5-e3723481bae4 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:12.923037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6388113-d971-4d39-9aa5-e3723481bae4 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:12.961589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae5ae2-231d-4247-8790-79a7c1252931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:12.962812 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae5ae2-231d-4247-8790-79a7c1252931 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:12.963088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae5ae2-231d-4247-8790-79a7c1252931 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:12.963359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae5ae2-231d-4247-8790-79a7c1252931 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:12.973893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae5ae2-231d-4247-8790-79a7c1252931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-c5ae5ae2-231d-4247-8790-79a7c1252931 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:59:12.979369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:59:12.980562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:59:12.981686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 589/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:59:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:59:12.986718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3438d5-111b-4a7e-9b76-ace3c38dcae7 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:13.097439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3438d5-111b-4a7e-9b76-ace3c38dcae7 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:13.133247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac2851-c0f0-41ca-b39f-1c9b30b08c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:13.134438 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac2851-c0f0-41ca-b39f-1c9b30b08c75 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:13.134999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac2851-c0f0-41ca-b39f-1c9b30b08c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:13.134999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac2851-c0f0-41ca-b39f-1c9b30b08c75 None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:13.135631 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac2851-c0f0-41ca-b39f-1c9b30b08c75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:59:13.135932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac2851-c0f0-41ca-b39f-1c9b30b08c75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:13.137367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac2851-c0f0-41ca-b39f-1c9b30b08c75 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:13.146882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 592/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:59:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:13.153405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae5ae2-231d-4247-8790-79a7c1252931 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:13.218195 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:13.265315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae5ae2-231d-4247-8790-79a7c1252931 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:13.329121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92425605-be15-478c-a6d6-ad572a1a2b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:13.330195 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92425605-be15-478c-a6d6-ad572a1a2b5d None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:13.330674 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92425605-be15-478c-a6d6-ad572a1a2b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:13.331170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92425605-be15-478c-a6d6-ad572a1a2b5d None admin] PATH_INFO: `/v3/users/6516e70154534c3d8da7da5289bdd7eb` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:13.355652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92425605-be15-478c-a6d6-ad572a1a2b5d None admin] RBAC: Authorizing `identity:get_user(user_id=6516e70154534c3d8da7da5289bdd7eb)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:13.357077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92425605-be15-478c-a6d6-ad572a1a2b5d None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:13.358810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 590/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:59:13 2022] GET /identity/v3/users/6516e70154534c3d8da7da5289bdd7eb => generated 311 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:13.365247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac2851-c0f0-41ca-b39f-1c9b30b08c75 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:13.402155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:13.494369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac2851-c0f0-41ca-b39f-1c9b30b08c75 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:13.535823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa05d5-81bb-4527-be46-e6d6b2ee1b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:13.536457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa05d5-81bb-4527-be46-e6d6b2ee1b13 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:13.536773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa05d5-81bb-4527-be46-e6d6b2ee1b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:13.537052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa05d5-81bb-4527-be46-e6d6b2ee1b13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:13.611282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa05d5-81bb-4527-be46-e6d6b2ee1b13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:13.612710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa05d5-81bb-4527-be46-e6d6b2ee1b13 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:13.645102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:13.723419 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 593/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:59:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 15:59:13.730572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92425605-be15-478c-a6d6-ad572a1a2b5d None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:13.846466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92425605-be15-478c-a6d6-ad572a1a2b5d None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:13.862077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:13.886028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35824a-9f1c-48d6-837e-7f0a1102a281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:13.886681 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35824a-9f1c-48d6-837e-7f0a1102a281 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:13.886963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35824a-9f1c-48d6-837e-7f0a1102a281 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:13.887239 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35824a-9f1c-48d6-837e-7f0a1102a281 None admin] PATH_INFO: `/v3/projects/5414c2e54b6a431f8b3d5b98b283d742` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:13.888430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35824a-9f1c-48d6-837e-7f0a1102a281 None admin] RBAC: Authorizing `identity:get_project(project_id=5414c2e54b6a431f8b3d5b98b283d742)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:13.889925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35824a-9f1c-48d6-837e-7f0a1102a281 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:13.891635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 591/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:59:13 2022] GET /identity/v3/projects/5414c2e54b6a431f8b3d5b98b283d742 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:13.898227 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa05d5-81bb-4527-be46-e6d6b2ee1b13 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:14.006085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa05d5-81bb-4527-be46-e6d6b2ee1b13 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:14.036831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:14.045781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793354c-be8f-4436-8e69-4f8eb3ce8572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:14.046392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793354c-be8f-4436-8e69-4f8eb3ce8572 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:14.046675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793354c-be8f-4436-8e69-4f8eb3ce8572 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:14.046949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793354c-be8f-4436-8e69-4f8eb3ce8572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:14.047682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793354c-be8f-4436-8e69-4f8eb3ce8572 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=5414c2e54b6a431f8b3d5b98b283d742, user.id=6516e70154534c3d8da7da5289bdd7eb) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:59:14.047992 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793354c-be8f-4436-8e69-4f8eb3ce8572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:14.049472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793354c-be8f-4436-8e69-4f8eb3ce8572 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:14.055184 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 594/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:59:13 2022] GET /identity/v3/role_assignments?user.id=6516e70154534c3d8da7da5289bdd7eb&scope.project.id=5414c2e54b6a431f8b3d5b98b283d742&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:16.305890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0a3e1-b3ef-4bbc-b05f-f28f8660402c None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:16.306512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0a3e1-b3ef-4bbc-b05f-f28f8660402c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:16.306512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0a3e1-b3ef-4bbc-b05f-f28f8660402c None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:16.311675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 592/1186] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:59:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:59:16.317918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c3486-239a-4a6c-95af-6c1c213bc7d4 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:16.318460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c3486-239a-4a6c-95af-6c1c213bc7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:16.318753 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c3486-239a-4a6c-95af-6c1c213bc7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:16.339133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-2e4c3486-239a-4a6c-95af-6c1c213bc7d4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:16.340349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2e4c3486-239a-4a6c-95af-6c1c213bc7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:16.414186 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 595/1187] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:59:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:59:16.686332 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0a3e1-b3ef-4bbc-b05f-f28f8660402c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:16.796840 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0a3e1-b3ef-4bbc-b05f-f28f8660402c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:16.834352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d08ef-16f9-44c3-9e11-f2a65dac6ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:16.835100 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d08ef-16f9-44c3-9e11-f2a65dac6ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:16.835380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d08ef-16f9-44c3-9e11-f2a65dac6ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:16.835650 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d08ef-16f9-44c3-9e11-f2a65dac6ad0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:16.846161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d08ef-16f9-44c3-9e11-f2a65dac6ad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-665d08ef-16f9-44c3-9e11-f2a65dac6ad0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:59:16.850980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:59:16.852342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 15:59:16.853581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 593/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:59:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:59:16.858695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c3486-239a-4a6c-95af-6c1c213bc7d4 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:16.971393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c3486-239a-4a6c-95af-6c1c213bc7d4 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:16.997350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:17.012145 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dfa13-fab0-42fc-a9bf-a005c2b4187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:17.012838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dfa13-fab0-42fc-a9bf-a005c2b4187f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:17.013161 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dfa13-fab0-42fc-a9bf-a005c2b4187f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:17.013441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dfa13-fab0-42fc-a9bf-a005c2b4187f None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:17.014112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dfa13-fab0-42fc-a9bf-a005c2b4187f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:59:17.014422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dfa13-fab0-42fc-a9bf-a005c2b4187f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:17.015811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dfa13-fab0-42fc-a9bf-a005c2b4187f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:17.024827 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 596/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:59:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:17.030634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d08ef-16f9-44c3-9e11-f2a65dac6ad0 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:17.076498 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:17.136578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d08ef-16f9-44c3-9e11-f2a65dac6ad0 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:17.171622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ea5c9-9e21-4225-9369-1ae08c3a6a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:17.172258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ea5c9-9e21-4225-9369-1ae08c3a6a9c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:17.172539 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ea5c9-9e21-4225-9369-1ae08c3a6a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:17.172843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ea5c9-9e21-4225-9369-1ae08c3a6a9c None admin] PATH_INFO: `/v3/users/6516e70154534c3d8da7da5289bdd7eb` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:17.173965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ea5c9-9e21-4225-9369-1ae08c3a6a9c None admin] RBAC: Authorizing `identity:get_user(user_id=6516e70154534c3d8da7da5289bdd7eb)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:17.175417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ea5c9-9e21-4225-9369-1ae08c3a6a9c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:17.177253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 594/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:59:17 2022] GET /identity/v3/users/6516e70154534c3d8da7da5289bdd7eb => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:17.185827 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dfa13-fab0-42fc-a9bf-a005c2b4187f None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:17.294337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dfa13-fab0-42fc-a9bf-a005c2b4187f None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:17.330724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a0d6c-bbea-4356-9aa4-075126191f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:17.331440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a0d6c-bbea-4356-9aa4-075126191f10 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:17.331627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a0d6c-bbea-4356-9aa4-075126191f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:17.331903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a0d6c-bbea-4356-9aa4-075126191f10 None admin] PATH_INFO: `/v3/projects/5414c2e54b6a431f8b3d5b98b283d742` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:17.333084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a0d6c-bbea-4356-9aa4-075126191f10 None admin] RBAC: Authorizing `identity:get_project(project_id=5414c2e54b6a431f8b3d5b98b283d742)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:17.334537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a0d6c-bbea-4356-9aa4-075126191f10 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:17.336420 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 597/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:59:17 2022] GET /identity/v3/projects/5414c2e54b6a431f8b3d5b98b283d742 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:59:17.345952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ea5c9-9e21-4225-9369-1ae08c3a6a9c None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:17.460294 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ea5c9-9e21-4225-9369-1ae08c3a6a9c None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:17.470968 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:17.498048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dc79a-5511-4419-a4d3-bde9867a5295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:17.498714 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dc79a-5511-4419-a4d3-bde9867a5295 None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:17.498993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dc79a-5511-4419-a4d3-bde9867a5295 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:17.499268 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dc79a-5511-4419-a4d3-bde9867a5295 None admin] PATH_INFO: `/v3/projects/5414c2e54b6a431f8b3d5b98b283d742/users/6516e70154534c3d8da7da5289bdd7eb/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:17.501200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9dc79a-5511-4419-a4d3-bde9867a5295 None admin] RBAC: Authorizing `identity:create_grant(project_id=5414c2e54b6a431f8b3d5b98b283d742, user_id=6516e70154534c3d8da7da5289bdd7eb, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:17.502623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9dc79a-5511-4419-a4d3-bde9867a5295 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:17.520101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 595/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 15:59:17 2022] PUT /identity/v3/projects/5414c2e54b6a431f8b3d5b98b283d742/users/6516e70154534c3d8da7da5289bdd7eb/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:59:19.681127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72046ddf-37c9-4eb1-bcde-1fb6056afae2 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:19.681688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72046ddf-37c9-4eb1-bcde-1fb6056afae2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:19.681688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72046ddf-37c9-4eb1-bcde-1fb6056afae2 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:19.683019 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 598/1193] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 15:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:59:19.688474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a454a-5e22-44ac-ac8b-3f719ca82451 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:19.688980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a454a-5e22-44ac-ac8b-3f719ca82451 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:19.689083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a454a-5e22-44ac-ac8b-3f719ca82451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:19.707966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-8c3a454a-5e22-44ac-ac8b-3f719ca82451 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:19.709199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8c3a454a-5e22-44ac-ac8b-3f719ca82451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:19.781846 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 596/1194] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 15:59:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:59:20.057474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72046ddf-37c9-4eb1-bcde-1fb6056afae2 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:20.112638 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:20.171693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72046ddf-37c9-4eb1-bcde-1fb6056afae2 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:20.218810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4146-0665-4dc5-bd0d-93d1a774a0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:20.219449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4146-0665-4dc5-bd0d-93d1a774a0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:20.219735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4146-0665-4dc5-bd0d-93d1a774a0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:20.220010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4146-0665-4dc5-bd0d-93d1a774a0c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:20.230816 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c4146-0665-4dc5-bd0d-93d1a774a0c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-9f4c4146-0665-4dc5-bd0d-93d1a774a0c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:59:20.235660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:59:20.236904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 15:59:20.238141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 599/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 15:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:59:20.243122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a454a-5e22-44ac-ac8b-3f719ca82451 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:20.338253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:20.342527 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a454a-5e22-44ac-ac8b-3f719ca82451 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:20.378910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5ca41-1d27-4a9b-8b0a-e16550248e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:20.379514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ca41-1d27-4a9b-8b0a-e16550248e81 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:20.379795 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ca41-1d27-4a9b-8b0a-e16550248e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:20.380070 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5ca41-1d27-4a9b-8b0a-e16550248e81 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:20.380760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5ca41-1d27-4a9b-8b0a-e16550248e81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:59:20.381063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5ca41-1d27-4a9b-8b0a-e16550248e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:20.382442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5ca41-1d27-4a9b-8b0a-e16550248e81 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:20.391187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 597/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 15:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:20.397625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4146-0665-4dc5-bd0d-93d1a774a0c1 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:20.509430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4146-0665-4dc5-bd0d-93d1a774a0c1 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:20.523392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:20.544454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e50da-77d7-4dfe-b585-bf76d1923a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:20.545114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e50da-77d7-4dfe-b585-bf76d1923a59 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:20.545393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e50da-77d7-4dfe-b585-bf76d1923a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:20.545665 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e50da-77d7-4dfe-b585-bf76d1923a59 None admin] PATH_INFO: `/v3/users/6516e70154534c3d8da7da5289bdd7eb` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:20.546778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e50da-77d7-4dfe-b585-bf76d1923a59 None admin] RBAC: Authorizing `identity:get_user(user_id=6516e70154534c3d8da7da5289bdd7eb)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:20.548217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e50da-77d7-4dfe-b585-bf76d1923a59 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:20.549824 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 600/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Sep 7 15:59:20 2022] GET /identity/v3/users/6516e70154534c3d8da7da5289bdd7eb => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:20.556431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5ca41-1d27-4a9b-8b0a-e16550248e81 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:20.656801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5ca41-1d27-4a9b-8b0a-e16550248e81 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:20.691567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb32eee-7fc6-4962-bd85-a8ac08723191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:20.692281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb32eee-7fc6-4962-bd85-a8ac08723191 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:20.692422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb32eee-7fc6-4962-bd85-a8ac08723191 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:20.692794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb32eee-7fc6-4962-bd85-a8ac08723191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:20.721153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:20.762646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb32eee-7fc6-4962-bd85-a8ac08723191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:20.764089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb32eee-7fc6-4962-bd85-a8ac08723191 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:20.863259 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 598/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 15:59:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:59:20.870016 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e50da-77d7-4dfe-b585-bf76d1923a59 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:20.978774 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e50da-77d7-4dfe-b585-bf76d1923a59 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:21.015718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d0940-b369-4ddc-8af6-d6abff3a32e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:21.016358 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d0940-b369-4ddc-8af6-d6abff3a32e0 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:21.016638 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d0940-b369-4ddc-8af6-d6abff3a32e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:21.016941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d0940-b369-4ddc-8af6-d6abff3a32e0 None admin] PATH_INFO: `/v3/projects/5414c2e54b6a431f8b3d5b98b283d742` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:21.018322 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d0940-b369-4ddc-8af6-d6abff3a32e0 None admin] RBAC: Authorizing `identity:get_project(project_id=5414c2e54b6a431f8b3d5b98b283d742)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:21.019766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d0940-b369-4ddc-8af6-d6abff3a32e0 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:21.021460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 601/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Sep 7 15:59:20 2022] GET /identity/v3/projects/5414c2e54b6a431f8b3d5b98b283d742 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:21.027917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb32eee-7fc6-4962-bd85-a8ac08723191 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:21.090501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:21.133507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb32eee-7fc6-4962-bd85-a8ac08723191 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:21.170094 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165af3c-e8ff-46c7-aec5-a7ae08ad039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:21.170704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165af3c-e8ff-46c7-aec5-a7ae08ad039c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:21.170981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165af3c-e8ff-46c7-aec5-a7ae08ad039c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:21.171260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165af3c-e8ff-46c7-aec5-a7ae08ad039c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:21.171988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165af3c-e8ff-46c7-aec5-a7ae08ad039c None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=5414c2e54b6a431f8b3d5b98b283d742, user.id=6516e70154534c3d8da7da5289bdd7eb) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:59:21.172292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165af3c-e8ff-46c7-aec5-a7ae08ad039c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:21.173788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165af3c-e8ff-46c7-aec5-a7ae08ad039c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:21.180015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 599/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 15:59:21 2022] GET /identity/v3/role_assignments?user.id=6516e70154534c3d8da7da5289bdd7eb&scope.project.id=5414c2e54b6a431f8b3d5b98b283d742&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:31.010957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=76 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:31.177591 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=38 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:19.948377 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23812fda-367b-480a-9c70-1423b00b5b72 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:19.949019 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23812fda-367b-480a-9c70-1423b00b5b72 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:19.949112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23812fda-367b-480a-9c70-1423b00b5b72 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:19.950847 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 602/1201] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:00:19.956877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd878f74-690f-4957-82b2-71953ab03005 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:19.957458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd878f74-690f-4957-82b2-71953ab03005 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:19.957458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd878f74-690f-4957-82b2-71953ab03005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:19.979746 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-dd878f74-690f-4957-82b2-71953ab03005 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:19.981085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-dd878f74-690f-4957-82b2-71953ab03005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:20.091457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 600/1202] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:00:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:00:20.385236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23812fda-367b-480a-9c70-1423b00b5b72 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:20.527789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23812fda-367b-480a-9c70-1423b00b5b72 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:20.575567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7f93d-c6f8-42df-8250-0c1dd1fd3658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:20.576320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7f93d-c6f8-42df-8250-0c1dd1fd3658 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:20.576609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7f93d-c6f8-42df-8250-0c1dd1fd3658 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:20.576920 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7f93d-c6f8-42df-8250-0c1dd1fd3658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:20.594768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7f93d-c6f8-42df-8250-0c1dd1fd3658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:20.596317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7f93d-c6f8-42df-8250-0c1dd1fd3658 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-93f7f93d-c6f8-42df-8250-0c1dd1fd3658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:20.620988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:20.622255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:20.623241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:20.623241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:20.623241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:20.623241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 603/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:20.628867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd878f74-690f-4957-82b2-71953ab03005 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:20.779503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd878f74-690f-4957-82b2-71953ab03005 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:20.819619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:20.828305 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248eb11-4323-4a61-a12d-f5f54b85730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:20.829114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248eb11-4323-4a61-a12d-f5f54b85730c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:20.829581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248eb11-4323-4a61-a12d-f5f54b85730c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:20.829887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248eb11-4323-4a61-a12d-f5f54b85730c None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:20.830663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248eb11-4323-4a61-a12d-f5f54b85730c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:20.830979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248eb11-4323-4a61-a12d-f5f54b85730c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:20.833242 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248eb11-4323-4a61-a12d-f5f54b85730c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:20.850789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 601/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:20.861926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7f93d-c6f8-42df-8250-0c1dd1fd3658 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:20.944293 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:21.014696 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7f93d-c6f8-42df-8250-0c1dd1fd3658 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:21.063972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75369f64-e395-45af-986b-56d9780d6904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:21.064741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369f64-e395-45af-986b-56d9780d6904 None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:21.065042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369f64-e395-45af-986b-56d9780d6904 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:21.065357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369f64-e395-45af-986b-56d9780d6904 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:21.066156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75369f64-e395-45af-986b-56d9780d6904 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:21.069489 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75369f64-e395-45af-986b-56d9780d6904 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:21.100877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 604/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Sep 7 16:00:20 2022] POST /identity/v3/users => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:00:23.763379 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99d67b-6bf9-4fe0-8047-e21037eaed6b None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:23.764112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99d67b-6bf9-4fe0-8047-e21037eaed6b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:23.764112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99d67b-6bf9-4fe0-8047-e21037eaed6b None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:23.765661 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 602/1206] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:00:23.772220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612adf-ffbc-457c-869d-b7416e520f5d None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:23.772891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612adf-ffbc-457c-869d-b7416e520f5d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:23.772891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612adf-ffbc-457c-869d-b7416e520f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:23.796544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-4a612adf-ffbc-457c-869d-b7416e520f5d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:23.797783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4a612adf-ffbc-457c-869d-b7416e520f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:23.888520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 605/1207] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:00:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:00:24.185353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99d67b-6bf9-4fe0-8047-e21037eaed6b None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:24.337555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99d67b-6bf9-4fe0-8047-e21037eaed6b None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:24.383893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6c729-d0a8-4c92-b8b1-9a06dbb84489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:24.384748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6c729-d0a8-4c92-b8b1-9a06dbb84489 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:24.385009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6c729-d0a8-4c92-b8b1-9a06dbb84489 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:24.385272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6c729-d0a8-4c92-b8b1-9a06dbb84489 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:24.402551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6c729-d0a8-4c92-b8b1-9a06dbb84489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-63e6c729-d0a8-4c92-b8b1-9a06dbb84489 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:00:24.413478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:24.417837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:24.418719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 603/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 16:00:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:24.421426 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612adf-ffbc-457c-869d-b7416e520f5d None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:24.482426 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:24.562579 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612adf-ffbc-457c-869d-b7416e520f5d None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:24.611839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75aa7c-f92c-4071-8b73-004b322e3bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:24.612876 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75aa7c-f92c-4071-8b73-004b322e3bab None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:24.613454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75aa7c-f92c-4071-8b73-004b322e3bab None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:24.614031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75aa7c-f92c-4071-8b73-004b322e3bab None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:24.615819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75aa7c-f92c-4071-8b73-004b322e3bab None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:24.616373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75aa7c-f92c-4071-8b73-004b322e3bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:24.618337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75aa7c-f92c-4071-8b73-004b322e3bab None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:24.630024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 606/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 16:00:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:24.639024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6c729-d0a8-4c92-b8b1-9a06dbb84489 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:24.707137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:24.772594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6c729-d0a8-4c92-b8b1-9a06dbb84489 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:24.814543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d91d2-5ea2-43d3-a8ab-45a557d208e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:24.815287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d91d2-5ea2-43d3-a8ab-45a557d208e3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:24.815617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d91d2-5ea2-43d3-a8ab-45a557d208e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:24.815953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d91d2-5ea2-43d3-a8ab-45a557d208e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:24.827867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d91d2-5ea2-43d3-a8ab-45a557d208e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:24.829313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d91d2-5ea2-43d3-a8ab-45a557d208e3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-093d91d2-5ea2-43d3-a8ab-45a557d208e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:24.845368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:24.846740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:24.848748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:24.848748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:24.848748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:24.848748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 604/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:00:24.852790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75aa7c-f92c-4071-8b73-004b322e3bab None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:24.981510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:24.985121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75aa7c-f92c-4071-8b73-004b322e3bab None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:25.031828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf16429-0eee-457b-b296-ed00eb8c7014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:25.032439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf16429-0eee-457b-b296-ed00eb8c7014 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:25.032736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf16429-0eee-457b-b296-ed00eb8c7014 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:25.033008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf16429-0eee-457b-b296-ed00eb8c7014 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:25.033659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf16429-0eee-457b-b296-ed00eb8c7014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:25.033959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf16429-0eee-457b-b296-ed00eb8c7014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:25.037748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf16429-0eee-457b-b296-ed00eb8c7014 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:25.051546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 607/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:25.057449 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d91d2-5ea2-43d3-a8ab-45a557d208e3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:25.189212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d91d2-5ea2-43d3-a8ab-45a557d208e3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:25.190915 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:25.241418 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787f4e0-c9d3-4679-aa03-756d796daf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:25.242158 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787f4e0-c9d3-4679-aa03-756d796daf10 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:25.242544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787f4e0-c9d3-4679-aa03-756d796daf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:25.242924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787f4e0-c9d3-4679-aa03-756d796daf10 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:25.252828 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787f4e0-c9d3-4679-aa03-756d796daf10 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:25.254436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787f4e0-c9d3-4679-aa03-756d796daf10 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-4787f4e0-c9d3-4679-aa03-756d796daf10 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:00:25.268979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:25.275322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:25.276389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:25.276389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:25.276389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:00:25.276389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:00:25.276389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:00:25.276389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:00:25.276389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:00:25.276389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:00:25.276389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:00:25.276389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:25.276389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 605/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:25.277247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf16429-0eee-457b-b296-ed00eb8c7014 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:25.414953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf16429-0eee-457b-b296-ed00eb8c7014 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:25.470239 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4454d1-feb0-4c9f-a1a2-4b0b44bdcf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:25.470239 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4454d1-feb0-4c9f-a1a2-4b0b44bdcf09 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:25.470905 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4454d1-feb0-4c9f-a1a2-4b0b44bdcf09 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:25.471446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4454d1-feb0-4c9f-a1a2-4b0b44bdcf09 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:25.472516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4454d1-feb0-4c9f-a1a2-4b0b44bdcf09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:25.473123 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4454d1-feb0-4c9f-a1a2-4b0b44bdcf09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:25.474892 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4454d1-feb0-4c9f-a1a2-4b0b44bdcf09 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:25.510957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 608/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Sep 7 16:00:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:25.518014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787f4e0-c9d3-4679-aa03-756d796daf10 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:25.638798 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787f4e0-c9d3-4679-aa03-756d796daf10 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:25.677791 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a400da3-bb3d-44cc-b5b8-6666f4186812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:25.678401 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a400da3-bb3d-44cc-b5b8-6666f4186812 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:25.678698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a400da3-bb3d-44cc-b5b8-6666f4186812 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:25.679065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a400da3-bb3d-44cc-b5b8-6666f4186812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:25.714566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:25.758421 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a400da3-bb3d-44cc-b5b8-6666f4186812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:25.759877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a400da3-bb3d-44cc-b5b8-6666f4186812 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:25.872784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 606/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 16:00:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:00:25.878630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4454d1-feb0-4c9f-a1a2-4b0b44bdcf09 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:25.910608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:26.007921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4454d1-feb0-4c9f-a1a2-4b0b44bdcf09 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:26.050593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67008a7a-d7ca-471b-a982-94b3b7b56361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:26.051552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67008a7a-d7ca-471b-a982-94b3b7b56361 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:26.051836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67008a7a-d7ca-471b-a982-94b3b7b56361 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:26.052648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67008a7a-d7ca-471b-a982-94b3b7b56361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:26.064668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67008a7a-d7ca-471b-a982-94b3b7b56361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:26.066163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67008a7a-d7ca-471b-a982-94b3b7b56361 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-67008a7a-d7ca-471b-a982-94b3b7b56361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:26.083030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:26.084302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:26.085482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:26.085482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:26.085482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:26.085482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 609/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:00:26.092127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a400da3-bb3d-44cc-b5b8-6666f4186812 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:26.162470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:26.206921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a400da3-bb3d-44cc-b5b8-6666f4186812 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:26.246310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26008c99-28a7-4e8a-add0-c8d60946fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:26.247156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26008c99-28a7-4e8a-add0-c8d60946fea0 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:26.247398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26008c99-28a7-4e8a-add0-c8d60946fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:26.247781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26008c99-28a7-4e8a-add0-c8d60946fea0 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:26.248454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26008c99-28a7-4e8a-add0-c8d60946fea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:26.248796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26008c99-28a7-4e8a-add0-c8d60946fea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:26.250193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26008c99-28a7-4e8a-add0-c8d60946fea0 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:26.263623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 607/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:26.269709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67008a7a-d7ca-471b-a982-94b3b7b56361 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:26.356831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:26.395993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67008a7a-d7ca-471b-a982-94b3b7b56361 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:26.438386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e409d-d981-42b5-8d1f-ee2b796d4b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:26.439105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e409d-d981-42b5-8d1f-ee2b796d4b56 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:26.439365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e409d-d981-42b5-8d1f-ee2b796d4b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:26.439746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e409d-d981-42b5-8d1f-ee2b796d4b56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:26.449358 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e409d-d981-42b5-8d1f-ee2b796d4b56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:26.451072 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e409d-d981-42b5-8d1f-ee2b796d4b56 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-367e409d-d981-42b5-8d1f-ee2b796d4b56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:00:26.467517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:26.468728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:26.469918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:00:26.469918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:00:26.469918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:00:26.469918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:00:26.469918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:00:26.469918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:00:26.469918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:00:26.469918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:26.469918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 610/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 16:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:26.475876 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26008c99-28a7-4e8a-add0-c8d60946fea0 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:26.618537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26008c99-28a7-4e8a-add0-c8d60946fea0 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:26.648987 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:26.662443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331181c-ac77-49ba-b908-1e8a426680b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:26.663087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331181c-ac77-49ba-b908-1e8a426680b8 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:26.663683 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331181c-ac77-49ba-b908-1e8a426680b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:26.663683 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331181c-ac77-49ba-b908-1e8a426680b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:26.667829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331181c-ac77-49ba-b908-1e8a426680b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:26.667829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331181c-ac77-49ba-b908-1e8a426680b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:26.667829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331181c-ac77-49ba-b908-1e8a426680b8 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:26.681642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 608/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 16:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:26.687719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e409d-d981-42b5-8d1f-ee2b796d4b56 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:26.815654 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e409d-d981-42b5-8d1f-ee2b796d4b56 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:26.850045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:26.857658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a487c3-7281-4889-95c3-ad1c0db17891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:26.858309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a487c3-7281-4889-95c3-ad1c0db17891 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:26.858613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a487c3-7281-4889-95c3-ad1c0db17891 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:26.858930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a487c3-7281-4889-95c3-ad1c0db17891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:26.859674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a487c3-7281-4889-95c3-ad1c0db17891 None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=b918da0f83754f3887de1cfa2e4df028) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:26.859996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a487c3-7281-4889-95c3-ad1c0db17891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:26.861614 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a487c3-7281-4889-95c3-ad1c0db17891 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:26.869220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 611/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 16:00:26 2022] GET /identity/v3/role_assignments?user.id=b918da0f83754f3887de1cfa2e4df028&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:29.266931 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b08f15-5791-4c0d-9be7-8e07478965a4 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:29.267744 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b08f15-5791-4c0d-9be7-8e07478965a4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:29.267744 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b08f15-5791-4c0d-9be7-8e07478965a4 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:29.269115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 609/1220] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:00:29.275354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2595-0797-43c3-a2e6-b85f9f6d9734 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:29.276121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2595-0797-43c3-a2e6-b85f9f6d9734 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:29.276427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2595-0797-43c3-a2e6-b85f9f6d9734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:29.295949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-de9b2595-0797-43c3-a2e6-b85f9f6d9734 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:29.297093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-de9b2595-0797-43c3-a2e6-b85f9f6d9734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:29.374618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 612/1221] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:00:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:00:29.650857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b08f15-5791-4c0d-9be7-8e07478965a4 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:29.775421 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b08f15-5791-4c0d-9be7-8e07478965a4 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:29.825657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804cfc5-1f8c-4bfa-bef9-636026238c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:29.826357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804cfc5-1f8c-4bfa-bef9-636026238c69 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:29.826642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804cfc5-1f8c-4bfa-bef9-636026238c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:29.826924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804cfc5-1f8c-4bfa-bef9-636026238c69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:29.839184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804cfc5-1f8c-4bfa-bef9-636026238c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-2804cfc5-1f8c-4bfa-bef9-636026238c69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:00:29.844837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:29.846302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:29.847474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 610/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 16:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:29.853020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2595-0797-43c3-a2e6-b85f9f6d9734 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:29.983464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2595-0797-43c3-a2e6-b85f9f6d9734 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:30.013578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:30.027703 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e5698-faac-4a5c-9933-af15a4d767de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:30.029117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e5698-faac-4a5c-9933-af15a4d767de None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:30.029117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e5698-faac-4a5c-9933-af15a4d767de None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:30.029571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e5698-faac-4a5c-9933-af15a4d767de None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:30.030290 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e5698-faac-4a5c-9933-af15a4d767de None admin] RBAC: Adding query filter params (name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:30.030594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e5698-faac-4a5c-9933-af15a4d767de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:30.033753 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e5698-faac-4a5c-9933-af15a4d767de None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:30.047877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 613/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 16:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:30.049134 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804cfc5-1f8c-4bfa-bef9-636026238c69 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:30.103324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:30.178899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804cfc5-1f8c-4bfa-bef9-636026238c69 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:30.228507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed780a-49ad-4e86-b726-00297c8e122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:30.229384 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed780a-49ad-4e86-b726-00297c8e122e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:30.229662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed780a-49ad-4e86-b726-00297c8e122e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:30.229937 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed780a-49ad-4e86-b726-00297c8e122e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:30.244075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed780a-49ad-4e86-b726-00297c8e122e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:30.246331 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed780a-49ad-4e86-b726-00297c8e122e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-c6ed780a-49ad-4e86-b726-00297c8e122e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:30.266366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:30.268385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:30.274827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:30.274827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:30.274827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:30.274827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 611/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:30.275245 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e5698-faac-4a5c-9933-af15a4d767de None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:30.410636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e5698-faac-4a5c-9933-af15a4d767de None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:30.473210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d7e59-aa2f-4cfe-b636-9f11c0f2ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:30.474430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d7e59-aa2f-4cfe-b636-9f11c0f2ebbb None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:30.474808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d7e59-aa2f-4cfe-b636-9f11c0f2ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:30.475216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d7e59-aa2f-4cfe-b636-9f11c0f2ebbb None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:30.475878 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d7e59-aa2f-4cfe-b636-9f11c0f2ebbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:30.476256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d7e59-aa2f-4cfe-b636-9f11c0f2ebbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:30.477792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d7e59-aa2f-4cfe-b636-9f11c0f2ebbb None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:30.497706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 614/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:30.499528 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed780a-49ad-4e86-b726-00297c8e122e None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:30.624531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:30.632839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed780a-49ad-4e86-b726-00297c8e122e None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:30.670908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15cf59-e8ea-4531-81c3-2ba5b72cfcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:30.671619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15cf59-e8ea-4531-81c3-2ba5b72cfcaf None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:30.671902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15cf59-e8ea-4531-81c3-2ba5b72cfcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:30.672230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15cf59-e8ea-4531-81c3-2ba5b72cfcaf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:30.682902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15cf59-e8ea-4531-81c3-2ba5b72cfcaf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:30.684346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15cf59-e8ea-4531-81c3-2ba5b72cfcaf None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-5d15cf59-e8ea-4531-81c3-2ba5b72cfcaf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:00:30.699450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:30.700893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:30.701853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:30.701853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:30.701853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:00:30.701853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:00:30.701853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:00:30.701853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:00:30.701853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:00:30.701853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:00:30.701853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:00:30.701853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:30.701853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 612/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:30.707478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d7e59-aa2f-4cfe-b636-9f11c0f2ebbb None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:30.764427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:30.831441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d7e59-aa2f-4cfe-b636-9f11c0f2ebbb None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:30.872743 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e7d22-8b98-4124-9fa4-cc84671672cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:30.873368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e7d22-8b98-4124-9fa4-cc84671672cb None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:30.873691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e7d22-8b98-4124-9fa4-cc84671672cb None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:30.873987 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e7d22-8b98-4124-9fa4-cc84671672cb None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:30.874757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e7d22-8b98-4124-9fa4-cc84671672cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:30.875089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e7d22-8b98-4124-9fa4-cc84671672cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:30.877033 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e7d22-8b98-4124-9fa4-cc84671672cb None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:30.899369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 615/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Sep 7 16:00:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:00:30.906713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15cf59-e8ea-4531-81c3-2ba5b72cfcaf None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:31.043481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15cf59-e8ea-4531-81c3-2ba5b72cfcaf None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:31.096160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040f32b-aa32-4b21-a04a-204921820c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:31.096784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040f32b-aa32-4b21-a04a-204921820c27 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:31.097083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040f32b-aa32-4b21-a04a-204921820c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:31.097317 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040f32b-aa32-4b21-a04a-204921820c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:31.111054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040f32b-aa32-4b21-a04a-204921820c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:31.112610 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040f32b-aa32-4b21-a04a-204921820c27 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-4040f32b-aa32-4b21-a04a-204921820c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:31.132877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:31.136071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:31.137470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:31.137470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:31.137470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:31.137470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 613/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:31.140546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e7d22-8b98-4124-9fa4-cc84671672cb None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:31.258184 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e7d22-8b98-4124-9fa4-cc84671672cb None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:31.261111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:31.305687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7759a45-b9c4-4de0-a684-e7a529ca81b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:31.305687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7759a45-b9c4-4de0-a684-e7a529ca81b9 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:31.305687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7759a45-b9c4-4de0-a684-e7a529ca81b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:31.305687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7759a45-b9c4-4de0-a684-e7a529ca81b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:31.306110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7759a45-b9c4-4de0-a684-e7a529ca81b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:31.306329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7759a45-b9c4-4de0-a684-e7a529ca81b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:31.307895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7759a45-b9c4-4de0-a684-e7a529ca81b9 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:31.322773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 616/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:31.328505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040f32b-aa32-4b21-a04a-204921820c27 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:31.340834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:31.461082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040f32b-aa32-4b21-a04a-204921820c27 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:31.507573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf869ad-1476-49b6-be72-742bbdc2d97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:31.508222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf869ad-1476-49b6-be72-742bbdc2d97c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:31.509308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf869ad-1476-49b6-be72-742bbdc2d97c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:31.510042 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf869ad-1476-49b6-be72-742bbdc2d97c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:31.521624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf869ad-1476-49b6-be72-742bbdc2d97c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:31.523704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf869ad-1476-49b6-be72-742bbdc2d97c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-cbf869ad-1476-49b6-be72-742bbdc2d97c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:00:31.537834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:31.538966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:31.540012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:00:31.540012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:00:31.540012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:00:31.540012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:00:31.540012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:00:31.540012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:00:31.540012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:00:31.540012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:31.540012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 614/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 16:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:31.547813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7759a45-b9c4-4de0-a684-e7a529ca81b9 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:31.670880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7759a45-b9c4-4de0-a684-e7a529ca81b9 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:31.711266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7d92a-9627-42be-a82c-b3299d37f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:31.711914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7d92a-9627-42be-a82c-b3299d37f959 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:31.712218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7d92a-9627-42be-a82c-b3299d37f959 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:31.712529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7d92a-9627-42be-a82c-b3299d37f959 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:31.713348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7d92a-9627-42be-a82c-b3299d37f959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:31.713694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7d92a-9627-42be-a82c-b3299d37f959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:31.715318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7d92a-9627-42be-a82c-b3299d37f959 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:31.737024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 617/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 16:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:31.738528 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf869ad-1476-49b6-be72-742bbdc2d97c None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:31.820691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:31.862943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf869ad-1476-49b6-be72-742bbdc2d97c None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:31.907110 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f4edf-e3b4-49fb-9eff-b762cfa3e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:31.907795 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f4edf-e3b4-49fb-9eff-b762cfa3e472 None admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:31.908071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f4edf-e3b4-49fb-9eff-b762cfa3e472 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:31.908346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f4edf-e3b4-49fb-9eff-b762cfa3e472 None admin] PATH_INFO: `/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/b918da0f83754f3887de1cfa2e4df028/roles/aa755d19c52f4e299b98898217cbc688` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:31.924452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f4edf-e3b4-49fb-9eff-b762cfa3e472 None admin] RBAC: Authorizing `identity:create_grant(project_id=983beac5fc784756b6bdf11b07e219ac, user_id=b918da0f83754f3887de1cfa2e4df028, role_id=aa755d19c52f4e299b98898217cbc688)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:31.926039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f4edf-e3b4-49fb-9eff-b762cfa3e472 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:31.942881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 615/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 16:00:31 2022] PUT /identity/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/b918da0f83754f3887de1cfa2e4df028/roles/aa755d19c52f4e299b98898217cbc688 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:00:34.285494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0643409-e74d-41f8-a5d0-6d63f58249a5 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:34.286626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0643409-e74d-41f8-a5d0-6d63f58249a5 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:34.286626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0643409-e74d-41f8-a5d0-6d63f58249a5 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:34.288088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 618/1233] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:00:34.296763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2553bcf-1a14-4003-80ea-080930ea8cb5 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:34.296763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2553bcf-1a14-4003-80ea-080930ea8cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:34.296763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2553bcf-1a14-4003-80ea-080930ea8cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:34.316934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-e2553bcf-1a14-4003-80ea-080930ea8cb5 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:34.318367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e2553bcf-1a14-4003-80ea-080930ea8cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:34.393853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 616/1234] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:00:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:00:34.679354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0643409-e74d-41f8-a5d0-6d63f58249a5 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:34.709750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:34.810094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0643409-e74d-41f8-a5d0-6d63f58249a5 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:34.852773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf8f29-2ff7-49b5-95bd-9dd87f22764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:34.853454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8f29-2ff7-49b5-95bd-9dd87f22764a None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:34.853734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8f29-2ff7-49b5-95bd-9dd87f22764a None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:34.854006 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8f29-2ff7-49b5-95bd-9dd87f22764a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:34.868492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf8f29-2ff7-49b5-95bd-9dd87f22764a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-0bdf8f29-2ff7-49b5-95bd-9dd87f22764a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:00:34.873249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:34.874501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:34.875712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 619/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Sep 7 16:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:34.880936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2553bcf-1a14-4003-80ea-080930ea8cb5 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:34.936221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:34.999929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2553bcf-1a14-4003-80ea-080930ea8cb5 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:35.044804 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221ee1-256a-4432-9a71-67564356ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:35.045492 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221ee1-256a-4432-9a71-67564356ddfe None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:35.045775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221ee1-256a-4432-9a71-67564356ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:35.046079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221ee1-256a-4432-9a71-67564356ddfe None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:35.048520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58221ee1-256a-4432-9a71-67564356ddfe None admin] RBAC: Adding query filter params (name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:35.048520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58221ee1-256a-4432-9a71-67564356ddfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:35.048745 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58221ee1-256a-4432-9a71-67564356ddfe None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:35.063833 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 617/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Sep 7 16:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:35.065976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf8f29-2ff7-49b5-95bd-9dd87f22764a None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:35.167738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:35.188456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf8f29-2ff7-49b5-95bd-9dd87f22764a None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:35.234462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57985898-31a1-4b26-9333-a757273ab998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:35.235831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985898-31a1-4b26-9333-a757273ab998 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:35.236378 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985898-31a1-4b26-9333-a757273ab998 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:35.236800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985898-31a1-4b26-9333-a757273ab998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:35.259045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57985898-31a1-4b26-9333-a757273ab998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:35.262373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57985898-31a1-4b26-9333-a757273ab998 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-57985898-31a1-4b26-9333-a757273ab998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:35.282711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:35.283874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:35.284821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:35.284821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:35.284821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:35.284821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 620/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:35.290646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221ee1-256a-4432-9a71-67564356ddfe None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:35.417146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221ee1-256a-4432-9a71-67564356ddfe None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:35.432264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:35.471606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52bb92-9590-42a4-8a5b-e3e89362fbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:35.472162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52bb92-9590-42a4-8a5b-e3e89362fbbd None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:35.472413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52bb92-9590-42a4-8a5b-e3e89362fbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:35.472733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52bb92-9590-42a4-8a5b-e3e89362fbbd None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:35.474307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52bb92-9590-42a4-8a5b-e3e89362fbbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:35.474307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52bb92-9590-42a4-8a5b-e3e89362fbbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:35.475553 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52bb92-9590-42a4-8a5b-e3e89362fbbd None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:35.495674 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 618/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:35.501662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57985898-31a1-4b26-9333-a757273ab998 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:35.631968 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57985898-31a1-4b26-9333-a757273ab998 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:35.670918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15a0ae-11ce-407e-aca7-b1e88dd14964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:35.671583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15a0ae-11ce-407e-aca7-b1e88dd14964 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:35.671873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15a0ae-11ce-407e-aca7-b1e88dd14964 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:35.672331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15a0ae-11ce-407e-aca7-b1e88dd14964 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:35.675488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:35.681389 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15a0ae-11ce-407e-aca7-b1e88dd14964 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:35.683122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15a0ae-11ce-407e-aca7-b1e88dd14964 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-1a15a0ae-11ce-407e-aca7-b1e88dd14964 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:00:35.696129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:35.697336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:35.698458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:35.698458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:35.698458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:00:35.698458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:00:35.698458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:00:35.698458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:00:35.698458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:00:35.698458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:00:35.698458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:00:35.698458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:35.698458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 621/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:00:35.703344 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52bb92-9590-42a4-8a5b-e3e89362fbbd None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:35.819111 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52bb92-9590-42a4-8a5b-e3e89362fbbd None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:35.859652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d77c6-0b10-4edd-9bc6-33ea654b8cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:35.860535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d77c6-0b10-4edd-9bc6-33ea654b8cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:35.860855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d77c6-0b10-4edd-9bc6-33ea654b8cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:35.861128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d77c6-0b10-4edd-9bc6-33ea654b8cc1 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:35.861858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d77c6-0b10-4edd-9bc6-33ea654b8cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:35.862165 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d77c6-0b10-4edd-9bc6-33ea654b8cc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:35.863590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d77c6-0b10-4edd-9bc6-33ea654b8cc1 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:35.885520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 619/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Sep 7 16:00:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:35.893351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15a0ae-11ce-407e-aca7-b1e88dd14964 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:36.023009 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15a0ae-11ce-407e-aca7-b1e88dd14964 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:36.069926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1eb1f-ae82-40fc-94af-d8efb7abade5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:36.070464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1eb1f-ae82-40fc-94af-d8efb7abade5 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:36.070745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1eb1f-ae82-40fc-94af-d8efb7abade5 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:36.071087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1eb1f-ae82-40fc-94af-d8efb7abade5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:36.149058 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:36.156384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1eb1f-ae82-40fc-94af-d8efb7abade5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:36.157950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1eb1f-ae82-40fc-94af-d8efb7abade5 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:36.287689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 622/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 16:00:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:00:36.293595 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d77c6-0b10-4edd-9bc6-33ea654b8cc1 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:36.327532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:36.419454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d77c6-0b10-4edd-9bc6-33ea654b8cc1 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:36.465801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb1012-7c7c-45b8-b5cb-de77751dc78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:36.466503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb1012-7c7c-45b8-b5cb-de77751dc78a None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:36.466820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb1012-7c7c-45b8-b5cb-de77751dc78a None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:36.467088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb1012-7c7c-45b8-b5cb-de77751dc78a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:36.479028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb1012-7c7c-45b8-b5cb-de77751dc78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:36.480417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb1012-7c7c-45b8-b5cb-de77751dc78a None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-51bb1012-7c7c-45b8-b5cb-de77751dc78a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:36.499034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:36.500532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:36.502201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:36.502201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:36.502201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:36.502201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 620/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:36.507640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1eb1f-ae82-40fc-94af-d8efb7abade5 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:36.630696 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:36.638441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1eb1f-ae82-40fc-94af-d8efb7abade5 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:36.686729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61e8b1-a4b4-42cd-91c9-df57fbe8b5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:36.687346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61e8b1-a4b4-42cd-91c9-df57fbe8b5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:36.687630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61e8b1-a4b4-42cd-91c9-df57fbe8b5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:36.688027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61e8b1-a4b4-42cd-91c9-df57fbe8b5b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:36.688547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61e8b1-a4b4-42cd-91c9-df57fbe8b5b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:36.688887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61e8b1-a4b4-42cd-91c9-df57fbe8b5b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:36.690366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61e8b1-a4b4-42cd-91c9-df57fbe8b5b6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:36.705376 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 623/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:36.713043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb1012-7c7c-45b8-b5cb-de77751dc78a None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:36.803626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:36.829503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb1012-7c7c-45b8-b5cb-de77751dc78a None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:36.876760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3086d0e-6b53-4895-99b6-f95f63ec3246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:36.877399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086d0e-6b53-4895-99b6-f95f63ec3246 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:36.877675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086d0e-6b53-4895-99b6-f95f63ec3246 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:36.877946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3086d0e-6b53-4895-99b6-f95f63ec3246 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:36.888139 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3086d0e-6b53-4895-99b6-f95f63ec3246 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:36.890663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3086d0e-6b53-4895-99b6-f95f63ec3246 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-c3086d0e-6b53-4895-99b6-f95f63ec3246 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:00:36.911805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:36.914170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:36.921474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:00:36.921474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:00:36.921474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:00:36.921474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:00:36.921474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:00:36.921474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:00:36.921474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:00:36.921474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:36.921474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 621/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 16:00:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:36.922301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61e8b1-a4b4-42cd-91c9-df57fbe8b5b6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:37.054942 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61e8b1-a4b4-42cd-91c9-df57fbe8b5b6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:37.093804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529dfb0-c317-4780-b0c0-a26d9736573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:37.094428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529dfb0-c317-4780-b0c0-a26d9736573f None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:37.094713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529dfb0-c317-4780-b0c0-a26d9736573f None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:37.095052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529dfb0-c317-4780-b0c0-a26d9736573f None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:37.095699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529dfb0-c317-4780-b0c0-a26d9736573f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:37.096042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529dfb0-c317-4780-b0c0-a26d9736573f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:37.097576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529dfb0-c317-4780-b0c0-a26d9736573f None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:37.112326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 624/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 16:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:37.119795 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3086d0e-6b53-4895-99b6-f95f63ec3246 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:37.250744 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3086d0e-6b53-4895-99b6-f95f63ec3246 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:37.291532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011d842-78dd-48d9-9ac8-bbeb7972374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:37.292133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011d842-78dd-48d9-9ac8-bbeb7972374c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:37.292410 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011d842-78dd-48d9-9ac8-bbeb7972374c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:37.292725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011d842-78dd-48d9-9ac8-bbeb7972374c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:37.293478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011d842-78dd-48d9-9ac8-bbeb7972374c None admin] RBAC: Adding query filter params (role.id=aa755d19c52f4e299b98898217cbc688, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=b918da0f83754f3887de1cfa2e4df028) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:37.293808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011d842-78dd-48d9-9ac8-bbeb7972374c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:37.295374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011d842-78dd-48d9-9ac8-bbeb7972374c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:37.312785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 622/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 16:00:37 2022] GET /identity/v3/role_assignments?user.id=b918da0f83754f3887de1cfa2e4df028&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=aa755d19c52f4e299b98898217cbc688 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:39.631731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148dd7d-4903-44ec-a580-68657274c647 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:39.632422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148dd7d-4903-44ec-a580-68657274c647 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:39.632422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148dd7d-4903-44ec-a580-68657274c647 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:39.634236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 625/1247] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:00:39.642855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d10069-5378-4253-8184-9ff59b17e021 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:39.643399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d10069-5378-4253-8184-9ff59b17e021 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:39.643624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d10069-5378-4253-8184-9ff59b17e021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:39.653500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:39.670957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-35d10069-5378-4253-8184-9ff59b17e021 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:39.672199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-35d10069-5378-4253-8184-9ff59b17e021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:39.759607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 623/1248] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:00:40.034399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148dd7d-4903-44ec-a580-68657274c647 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:40.056570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:40.161897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148dd7d-4903-44ec-a580-68657274c647 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:40.206853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab872-7a48-496d-a030-e312952c39ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:40.208523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab872-7a48-496d-a030-e312952c39ce None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:40.209151 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab872-7a48-496d-a030-e312952c39ce None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:40.209666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab872-7a48-496d-a030-e312952c39ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:40.224241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ab872-7a48-496d-a030-e312952c39ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-806ab872-7a48-496d-a030-e312952c39ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:00:40.229323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:40.230333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:40.231188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 626/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 16:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:40.236852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d10069-5378-4253-8184-9ff59b17e021 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:40.353023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d10069-5378-4253-8184-9ff59b17e021 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:40.386727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:40.395624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3567e06-a46c-465c-8cf5-1b2afd625c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:40.396842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3567e06-a46c-465c-8cf5-1b2afd625c00 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:40.397204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3567e06-a46c-465c-8cf5-1b2afd625c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:40.397605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3567e06-a46c-465c-8cf5-1b2afd625c00 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:40.398438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3567e06-a46c-465c-8cf5-1b2afd625c00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:40.398849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3567e06-a46c-465c-8cf5-1b2afd625c00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:40.400539 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3567e06-a46c-465c-8cf5-1b2afd625c00 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:40.412652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 624/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 16:00:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:40.418147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab872-7a48-496d-a030-e312952c39ce None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:40.524608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:40.556616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab872-7a48-496d-a030-e312952c39ce None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:40.604619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e062a-5a20-4a43-b62c-0c8f4420ac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:40.604619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e062a-5a20-4a43-b62c-0c8f4420ac19 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:40.604619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e062a-5a20-4a43-b62c-0c8f4420ac19 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:40.604619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e062a-5a20-4a43-b62c-0c8f4420ac19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:40.616407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e062a-5a20-4a43-b62c-0c8f4420ac19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:40.617994 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e062a-5a20-4a43-b62c-0c8f4420ac19 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-3a5e062a-5a20-4a43-b62c-0c8f4420ac19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:40.638159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:40.640004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:40.641252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:40.641252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:40.641252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:40.641252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 627/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:40.646136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3567e06-a46c-465c-8cf5-1b2afd625c00 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:40.771377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3567e06-a46c-465c-8cf5-1b2afd625c00 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:40.807166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c3970-58c1-4f55-b46c-1945df35ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:40.807783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c3970-58c1-4f55-b46c-1945df35ec15 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:40.808184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c3970-58c1-4f55-b46c-1945df35ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:40.808469 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c3970-58c1-4f55-b46c-1945df35ec15 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:40.809253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c3970-58c1-4f55-b46c-1945df35ec15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:40.809628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c3970-58c1-4f55-b46c-1945df35ec15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:40.811127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c3970-58c1-4f55-b46c-1945df35ec15 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:40.831876 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 625/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:00:40.833671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e062a-5a20-4a43-b62c-0c8f4420ac19 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:40.948552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e062a-5a20-4a43-b62c-0c8f4420ac19 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:40.976457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:40.985582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393ecc6-e7de-40cd-8955-b19045b84e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:40.986210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393ecc6-e7de-40cd-8955-b19045b84e09 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:40.986497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393ecc6-e7de-40cd-8955-b19045b84e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:40.986803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393ecc6-e7de-40cd-8955-b19045b84e09 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:41.001884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393ecc6-e7de-40cd-8955-b19045b84e09 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:41.003371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393ecc6-e7de-40cd-8955-b19045b84e09 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-d393ecc6-e7de-40cd-8955-b19045b84e09 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:00:41.016521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:41.017970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:41.018947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:41.018947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:41.018947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:00:41.018947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:00:41.018947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:00:41.018947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:00:41.018947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:00:41.018947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:00:41.018947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:00:41.018947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:41.018947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 628/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:41.029209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c3970-58c1-4f55-b46c-1945df35ec15 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:41.092136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:41.146082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c3970-58c1-4f55-b46c-1945df35ec15 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:41.187236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b6d84-738b-4bfa-b06e-148c9c18dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:41.187838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b6d84-738b-4bfa-b06e-148c9c18dc38 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:41.188113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b6d84-738b-4bfa-b06e-148c9c18dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:41.188383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b6d84-738b-4bfa-b06e-148c9c18dc38 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:41.189135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b6d84-738b-4bfa-b06e-148c9c18dc38 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:41.189434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b6d84-738b-4bfa-b06e-148c9c18dc38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:41.190853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b6d84-738b-4bfa-b06e-148c9c18dc38 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:41.212049 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 626/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Sep 7 16:00:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:41.219418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393ecc6-e7de-40cd-8955-b19045b84e09 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:41.355211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393ecc6-e7de-40cd-8955-b19045b84e09 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:41.394032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048186d1-6a04-4d73-b3cf-75e3f118b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:41.394648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048186d1-6a04-4d73-b3cf-75e3f118b513 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:41.394927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048186d1-6a04-4d73-b3cf-75e3f118b513 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:41.395715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048186d1-6a04-4d73-b3cf-75e3f118b513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:41.464898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:41.483735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048186d1-6a04-4d73-b3cf-75e3f118b513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:41.485431 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048186d1-6a04-4d73-b3cf-75e3f118b513 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:41.639101 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 629/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 16:00:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:00:41.647322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b6d84-738b-4bfa-b06e-148c9c18dc38 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:41.768057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b6d84-738b-4bfa-b06e-148c9c18dc38 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:41.784636 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:41.811791 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbbf9b-e60e-4ba2-8842-74df319bf560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:41.812428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbbf9b-e60e-4ba2-8842-74df319bf560 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:41.813107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbbf9b-e60e-4ba2-8842-74df319bf560 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:41.813371 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbbf9b-e60e-4ba2-8842-74df319bf560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:41.825290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbbf9b-e60e-4ba2-8842-74df319bf560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:41.827001 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbbf9b-e60e-4ba2-8842-74df319bf560 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-89dbbf9b-e60e-4ba2-8842-74df319bf560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:41.849656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:41.851056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:41.851996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:41.851996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:41.851996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:41.851996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 627/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:00:41.857867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048186d1-6a04-4d73-b3cf-75e3f118b513 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:41.966804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:41.979328 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048186d1-6a04-4d73-b3cf-75e3f118b513 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:42.021501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ce4b4-61a9-47aa-b6df-8b03f5778d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:42.022031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce4b4-61a9-47aa-b6df-8b03f5778d32 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:42.022305 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce4b4-61a9-47aa-b6df-8b03f5778d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:42.022585 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce4b4-61a9-47aa-b6df-8b03f5778d32 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:42.023232 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ce4b4-61a9-47aa-b6df-8b03f5778d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:42.023535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ce4b4-61a9-47aa-b6df-8b03f5778d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:42.024998 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ce4b4-61a9-47aa-b6df-8b03f5778d32 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:42.051817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 630/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:42.054713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbbf9b-e60e-4ba2-8842-74df319bf560 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:42.186662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbbf9b-e60e-4ba2-8842-74df319bf560 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:42.237356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947ae60-6ee1-42a8-861f-25d5438997a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:42.238018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947ae60-6ee1-42a8-861f-25d5438997a8 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:42.238301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947ae60-6ee1-42a8-861f-25d5438997a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:42.238576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947ae60-6ee1-42a8-861f-25d5438997a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:42.250694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947ae60-6ee1-42a8-861f-25d5438997a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:42.252180 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947ae60-6ee1-42a8-861f-25d5438997a8 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-7947ae60-6ee1-42a8-861f-25d5438997a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:00:42.269695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:42.271274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:42.272240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:00:42.272240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:00:42.272240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:00:42.272240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:00:42.272240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:00:42.272240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:00:42.272240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:00:42.272240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:42.272240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 628/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 16:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:00:42.278192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ce4b4-61a9-47aa-b6df-8b03f5778d32 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:42.402745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ce4b4-61a9-47aa-b6df-8b03f5778d32 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:42.444848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63e3af-1cda-4702-92c1-22fd64058ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:42.445568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63e3af-1cda-4702-92c1-22fd64058ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:42.445818 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63e3af-1cda-4702-92c1-22fd64058ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:42.446159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63e3af-1cda-4702-92c1-22fd64058ce2 None admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:42.446913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63e3af-1cda-4702-92c1-22fd64058ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:42.447331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63e3af-1cda-4702-92c1-22fd64058ce2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:42.448915 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63e3af-1cda-4702-92c1-22fd64058ce2 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:42.463909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 631/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 16:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:42.470897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947ae60-6ee1-42a8-861f-25d5438997a8 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:42.510481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:42.602558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947ae60-6ee1-42a8-861f-25d5438997a8 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:42.644898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36658da2-b619-4fdc-8ffa-1a7f526898c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:42.645716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36658da2-b619-4fdc-8ffa-1a7f526898c0 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:42.645996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36658da2-b619-4fdc-8ffa-1a7f526898c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:42.646266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36658da2-b619-4fdc-8ffa-1a7f526898c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:42.647013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36658da2-b619-4fdc-8ffa-1a7f526898c0 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=b918da0f83754f3887de1cfa2e4df028) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:42.647319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36658da2-b619-4fdc-8ffa-1a7f526898c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:42.648772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36658da2-b619-4fdc-8ffa-1a7f526898c0 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:42.655159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 629/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 16:00:42 2022] GET /identity/v3/role_assignments?user.id=b918da0f83754f3887de1cfa2e4df028&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:44.841472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974d537-e677-47e3-82d1-ae69dfae572d None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:44.842070 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974d537-e677-47e3-82d1-ae69dfae572d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:44.842070 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974d537-e677-47e3-82d1-ae69dfae572d None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:44.843356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 632/1261] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:00:44.848937 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa076cc6-e4e5-4c97-b39e-a0504014a208 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:44.849337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa076cc6-e4e5-4c97-b39e-a0504014a208 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:44.849517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa076cc6-e4e5-4c97-b39e-a0504014a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:44.868319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-aa076cc6-e4e5-4c97-b39e-a0504014a208 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:44.869550 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-aa076cc6-e4e5-4c97-b39e-a0504014a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:44.936658 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 630/1262] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:00:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:00:45.208501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974d537-e677-47e3-82d1-ae69dfae572d None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:45.219592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:45.311578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974d537-e677-47e3-82d1-ae69dfae572d None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:45.346086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2915f8-6f78-42c4-b8bd-3270334fd5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:45.346726 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2915f8-6f78-42c4-b8bd-3270334fd5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:45.347010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2915f8-6f78-42c4-b8bd-3270334fd5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:45.347286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2915f8-6f78-42c4-b8bd-3270334fd5c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:45.358669 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2915f8-6f78-42c4-b8bd-3270334fd5c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-0d2915f8-6f78-42c4-b8bd-3270334fd5c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:00:45.363513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:45.365131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:45.366202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 633/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 16:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:45.371482 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa076cc6-e4e5-4c97-b39e-a0504014a208 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:45.395438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:45.481951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa076cc6-e4e5-4c97-b39e-a0504014a208 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:45.515892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4e2b6-135e-444a-92cb-7c8997795949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:45.516497 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4e2b6-135e-444a-92cb-7c8997795949 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:45.517056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4e2b6-135e-444a-92cb-7c8997795949 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:45.517325 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4e2b6-135e-444a-92cb-7c8997795949 None admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:45.517984 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4e2b6-135e-444a-92cb-7c8997795949 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:45.518283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4e2b6-135e-444a-92cb-7c8997795949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:45.519632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4e2b6-135e-444a-92cb-7c8997795949 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:45.528241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 631/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 16:00:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:45.534029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2915f8-6f78-42c4-b8bd-3270334fd5c1 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:45.604143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:45.640501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2915f8-6f78-42c4-b8bd-3270334fd5c1 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:45.676637 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69a5c4-99bb-44e0-8eac-e5e19ec67e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:45.677286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69a5c4-99bb-44e0-8eac-e5e19ec67e90 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:45.677554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69a5c4-99bb-44e0-8eac-e5e19ec67e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:45.677820 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69a5c4-99bb-44e0-8eac-e5e19ec67e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:45.688089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69a5c4-99bb-44e0-8eac-e5e19ec67e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:45.689734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69a5c4-99bb-44e0-8eac-e5e19ec67e90 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-ba69a5c4-99bb-44e0-8eac-e5e19ec67e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:45.704720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:45.705944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:45.707067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:45.707067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:45.707067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:45.707067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 634/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:45.712145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4e2b6-135e-444a-92cb-7c8997795949 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:45.796410 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:45.816460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4e2b6-135e-444a-92cb-7c8997795949 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:45.852383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dd5d4-b8dd-432e-a8ce-92ef5e974be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:45.853272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dd5d4-b8dd-432e-a8ce-92ef5e974be1 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:45.853272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dd5d4-b8dd-432e-a8ce-92ef5e974be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:45.853553 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dd5d4-b8dd-432e-a8ce-92ef5e974be1 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:45.854193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dd5d4-b8dd-432e-a8ce-92ef5e974be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:45.854497 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dd5d4-b8dd-432e-a8ce-92ef5e974be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:45.855861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dd5d4-b8dd-432e-a8ce-92ef5e974be1 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:45.868102 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 632/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:45.873835 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69a5c4-99bb-44e0-8eac-e5e19ec67e90 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:45.981799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69a5c4-99bb-44e0-8eac-e5e19ec67e90 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:46.002468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:46.018993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d32f7-a17a-4e3e-aac8-6dfe39981eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:46.019623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d32f7-a17a-4e3e-aac8-6dfe39981eef None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:46.020784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d32f7-a17a-4e3e-aac8-6dfe39981eef None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:46.021190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d32f7-a17a-4e3e-aac8-6dfe39981eef None admin] PATH_INFO: `/v3/users/placement` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:46.029265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d32f7-a17a-4e3e-aac8-6dfe39981eef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:46.030732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d32f7-a17a-4e3e-aac8-6dfe39981eef None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-be0d32f7-a17a-4e3e-aac8-6dfe39981eef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:00:46.042127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:46.043248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:46.044461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:46.044461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:46.044461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:00:46.044461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:00:46.044461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:00:46.044461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:00:46.044461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:00:46.044461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:00:46.044461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:00:46.044461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:46.044461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 635/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:46.049151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dd5d4-b8dd-432e-a8ce-92ef5e974be1 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:46.155608 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dd5d4-b8dd-432e-a8ce-92ef5e974be1 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:46.190028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23aa92-1ee0-4426-aaff-bc709b010de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:46.190635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23aa92-1ee0-4426-aaff-bc709b010de3 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:46.190917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23aa92-1ee0-4426-aaff-bc709b010de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:46.191196 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23aa92-1ee0-4426-aaff-bc709b010de3 None admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:46.192411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23aa92-1ee0-4426-aaff-bc709b010de3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:46.192741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23aa92-1ee0-4426-aaff-bc709b010de3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:46.194177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23aa92-1ee0-4426-aaff-bc709b010de3 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:46.203184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:46.213488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 633/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Sep 7 16:00:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:46.219496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d32f7-a17a-4e3e-aac8-6dfe39981eef None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:46.321087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d32f7-a17a-4e3e-aac8-6dfe39981eef None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:46.354615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec345f-00ec-4ebe-b137-a6231a8ecd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:46.355244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec345f-00ec-4ebe-b137-a6231a8ecd18 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:46.355530 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec345f-00ec-4ebe-b137-a6231a8ecd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:46.355791 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec345f-00ec-4ebe-b137-a6231a8ecd18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:46.371397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec345f-00ec-4ebe-b137-a6231a8ecd18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:46.372880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec345f-00ec-4ebe-b137-a6231a8ecd18 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-f0ec345f-00ec-4ebe-b137-a6231a8ecd18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:46.387351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:46.388521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:46.389640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:46.389640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:46.389640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:46.389640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 636/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:46.394537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23aa92-1ee0-4426-aaff-bc709b010de3 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:46.506858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23aa92-1ee0-4426-aaff-bc709b010de3 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:46.541752 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a4d3f-3d17-4095-a258-cc19f9ec394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:46.542359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a4d3f-3d17-4095-a258-cc19f9ec394f None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:46.542635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a4d3f-3d17-4095-a258-cc19f9ec394f None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:46.542905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a4d3f-3d17-4095-a258-cc19f9ec394f None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:46.543543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a4d3f-3d17-4095-a258-cc19f9ec394f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:46.543839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a4d3f-3d17-4095-a258-cc19f9ec394f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:46.545224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a4d3f-3d17-4095-a258-cc19f9ec394f None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:46.556673 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 634/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:46.562392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec345f-00ec-4ebe-b137-a6231a8ecd18 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:46.594185 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:46.665326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec345f-00ec-4ebe-b137-a6231a8ecd18 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:46.697888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ecdf5-8ec4-4e72-a9d3-3aa24c27aca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:46.698509 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ecdf5-8ec4-4e72-a9d3-3aa24c27aca6 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:46.698784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ecdf5-8ec4-4e72-a9d3-3aa24c27aca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:46.699050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ecdf5-8ec4-4e72-a9d3-3aa24c27aca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:46.705448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ecdf5-8ec4-4e72-a9d3-3aa24c27aca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:46.706875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ecdf5-8ec4-4e72-a9d3-3aa24c27aca6 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-f53ecdf5-8ec4-4e72-a9d3-3aa24c27aca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:00:46.718449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:46.719354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:46.720273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:00:46.720273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:00:46.720273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:00:46.720273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:00:46.720273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:00:46.720273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:00:46.720273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:00:46.720273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:46.720273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 637/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 16:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:46.726045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a4d3f-3d17-4095-a258-cc19f9ec394f None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:46.784498 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:46.826199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a4d3f-3d17-4095-a258-cc19f9ec394f None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:46.859788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825ee95-4ea1-4cc7-9380-47235db10271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:46.860483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825ee95-4ea1-4cc7-9380-47235db10271 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:46.860584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825ee95-4ea1-4cc7-9380-47235db10271 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:46.860852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825ee95-4ea1-4cc7-9380-47235db10271 None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:46.861535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825ee95-4ea1-4cc7-9380-47235db10271 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:46.861839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825ee95-4ea1-4cc7-9380-47235db10271 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:46.863258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825ee95-4ea1-4cc7-9380-47235db10271 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:46.875004 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 635/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 16:00:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:46.881712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ecdf5-8ec4-4e72-a9d3-3aa24c27aca6 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:46.981930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:46.991295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ecdf5-8ec4-4e72-a9d3-3aa24c27aca6 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:47.029540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02a3d0-52af-4868-9395-dbffdb28c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:47.030211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02a3d0-52af-4868-9395-dbffdb28c84e None admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:47.030492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02a3d0-52af-4868-9395-dbffdb28c84e None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:47.030767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02a3d0-52af-4868-9395-dbffdb28c84e None admin] PATH_INFO: `/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/b918da0f83754f3887de1cfa2e4df028/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:47.032622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02a3d0-52af-4868-9395-dbffdb28c84e None admin] RBAC: Authorizing `identity:create_grant(project_id=983beac5fc784756b6bdf11b07e219ac, user_id=b918da0f83754f3887de1cfa2e4df028, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:47.034092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02a3d0-52af-4868-9395-dbffdb28c84e None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:47.047098 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 638/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Sep 7 16:00:46 2022] PUT /identity/v3/projects/983beac5fc784756b6bdf11b07e219ac/users/b918da0f83754f3887de1cfa2e4df028/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:00:49.230888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798ae46-263f-4a13-9c6d-ec66d1225f4c None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.231420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798ae46-263f-4a13-9c6d-ec66d1225f4c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.231540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798ae46-263f-4a13-9c6d-ec66d1225f4c None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.232867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 636/1274] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:00:49.238337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef472a15-9429-453d-995f-18a72eb4f7d9 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.238847 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef472a15-9429-453d-995f-18a72eb4f7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.239940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef472a15-9429-453d-995f-18a72eb4f7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.258075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-ef472a15-9429-453d-995f-18a72eb4f7d9 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:49.259324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ef472a15-9429-453d-995f-18a72eb4f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:49.329223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 639/1275] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:00:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:00:49.624821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798ae46-263f-4a13-9c6d-ec66d1225f4c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.747806 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798ae46-263f-4a13-9c6d-ec66d1225f4c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.765511 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:49.783281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89e0a-db25-4b93-a0d7-d3d3de0ed926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.783917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89e0a-db25-4b93-a0d7-d3d3de0ed926 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.784195 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89e0a-db25-4b93-a0d7-d3d3de0ed926 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.784470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89e0a-db25-4b93-a0d7-d3d3de0ed926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.794784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa89e0a-db25-4b93-a0d7-d3d3de0ed926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-afa89e0a-db25-4b93-a0d7-d3d3de0ed926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 16:00:49.799601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:49.800763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:49.801940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 637/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Sep 7 16:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:49.807119 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef472a15-9429-453d-995f-18a72eb4f7d9 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.897720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:49.916342 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef472a15-9429-453d-995f-18a72eb4f7d9 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.950651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cf207-33e9-4703-b0f4-7f8ae6db319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.951260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cf207-33e9-4703-b0f4-7f8ae6db319c None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.951540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cf207-33e9-4703-b0f4-7f8ae6db319c None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.951819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cf207-33e9-4703-b0f4-7f8ae6db319c None admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.952498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cf207-33e9-4703-b0f4-7f8ae6db319c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:49.952828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cf207-33e9-4703-b0f4-7f8ae6db319c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:49.954203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cf207-33e9-4703-b0f4-7f8ae6db319c None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:49.963758 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 640/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Sep 7 16:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:49.970040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89e0a-db25-4b93-a0d7-d3d3de0ed926 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:50.078787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89e0a-db25-4b93-a0d7-d3d3de0ed926 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:50.115949 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f0585-296a-435b-b108-c39886bb1d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:50.116582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f0585-296a-435b-b108-c39886bb1d21 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:50.116889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f0585-296a-435b-b108-c39886bb1d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:50.117162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f0585-296a-435b-b108-c39886bb1d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:50.127909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f0585-296a-435b-b108-c39886bb1d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:50.130014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f0585-296a-435b-b108-c39886bb1d21 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-fe9f0585-296a-435b-b108-c39886bb1d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:50.145521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:50.146730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:50.147629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:50.147629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:50.147629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:50.147629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 638/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:50.152613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cf207-33e9-4703-b0f4-7f8ae6db319c None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:50.251780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cf207-33e9-4703-b0f4-7f8ae6db319c None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:50.291040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb0a91-c980-45b8-8cef-a9459164a377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:50.291654 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb0a91-c980-45b8-8cef-a9459164a377 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:50.291932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb0a91-c980-45b8-8cef-a9459164a377 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:50.292204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb0a91-c980-45b8-8cef-a9459164a377 None admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:50.292878 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb0a91-c980-45b8-8cef-a9459164a377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:50.293181 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb0a91-c980-45b8-8cef-a9459164a377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:50.294546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb0a91-c980-45b8-8cef-a9459164a377 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:50.307151 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 641/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:50.312984 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f0585-296a-435b-b108-c39886bb1d21 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:50.347749 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:50.426472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f0585-296a-435b-b108-c39886bb1d21 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:50.466873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e152516-c779-4ab4-b307-885fab2c3953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:50.467501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e152516-c779-4ab4-b307-885fab2c3953 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:50.467782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e152516-c779-4ab4-b307-885fab2c3953 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:50.468052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e152516-c779-4ab4-b307-885fab2c3953 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:50.476547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e152516-c779-4ab4-b307-885fab2c3953 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:50.478020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e152516-c779-4ab4-b307-885fab2c3953 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-2e152516-c779-4ab4-b307-885fab2c3953 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 16:00:50.490531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:50.491734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:50.492751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:50.492751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:50.492751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 16:00:50.492751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 16:00:50.492751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 16:00:50.492751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 16:00:50.492751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 16:00:50.492751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 16:00:50.492751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 16:00:50.492751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:50.492751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 639/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 16:00:50.497688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb0a91-c980-45b8-8cef-a9459164a377 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:50.501608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:50.608193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb0a91-c980-45b8-8cef-a9459164a377 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:50.643758 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de745bb-f113-4f8d-b518-5132c0608912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:50.644374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de745bb-f113-4f8d-b518-5132c0608912 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:50.644700 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de745bb-f113-4f8d-b518-5132c0608912 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:50.645580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de745bb-f113-4f8d-b518-5132c0608912 None admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:50.646318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de745bb-f113-4f8d-b518-5132c0608912 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:50.646625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de745bb-f113-4f8d-b518-5132c0608912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:50.648073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de745bb-f113-4f8d-b518-5132c0608912 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:50.666542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 642/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Sep 7 16:00:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:50.672468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e152516-c779-4ab4-b307-885fab2c3953 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:50.765831 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:50.776584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e152516-c779-4ab4-b307-885fab2c3953 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:50.820378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a8a6d-5775-4afe-ab60-6dbd54f9fb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:50.821028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a8a6d-5775-4afe-ab60-6dbd54f9fb01 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:50.821308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a8a6d-5775-4afe-ab60-6dbd54f9fb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:50.821582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a8a6d-5775-4afe-ab60-6dbd54f9fb01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:50.892752 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a8a6d-5775-4afe-ab60-6dbd54f9fb01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:50.894213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a8a6d-5775-4afe-ab60-6dbd54f9fb01 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:50.985439 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:50.996667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 640/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Sep 7 16:00:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 16:00:51.002470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de745bb-f113-4f8d-b518-5132c0608912 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:51.067520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:51.110802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de745bb-f113-4f8d-b518-5132c0608912 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:51.151831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d244f9c-d259-47ea-9872-180b3cc7bb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:51.152476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d244f9c-d259-47ea-9872-180b3cc7bb68 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:51.152787 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d244f9c-d259-47ea-9872-180b3cc7bb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:51.153063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d244f9c-d259-47ea-9872-180b3cc7bb68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:51.164352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d244f9c-d259-47ea-9872-180b3cc7bb68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:51.165888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d244f9c-d259-47ea-9872-180b3cc7bb68 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-8d244f9c-d259-47ea-9872-180b3cc7bb68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 16:00:51.181608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:51.182796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 16:00:51.183722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 16:00:51.183722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 16:00:51.183722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:51.183722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 643/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:51.188568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a8a6d-5775-4afe-ab60-6dbd54f9fb01 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:51.289656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a8a6d-5775-4afe-ab60-6dbd54f9fb01 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:51.324432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ee6a4-0ca9-4d21-bc7f-8f45be4202a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:51.325133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee6a4-0ca9-4d21-bc7f-8f45be4202a9 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:51.325339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee6a4-0ca9-4d21-bc7f-8f45be4202a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:51.325612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee6a4-0ca9-4d21-bc7f-8f45be4202a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:51.326254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ee6a4-0ca9-4d21-bc7f-8f45be4202a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:51.326558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ee6a4-0ca9-4d21-bc7f-8f45be4202a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:51.327926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ee6a4-0ca9-4d21-bc7f-8f45be4202a9 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:51.340181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 641/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Sep 7 16:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:00:51.345997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d244f9c-d259-47ea-9872-180b3cc7bb68 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:51.447771 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d244f9c-d259-47ea-9872-180b3cc7bb68 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:51.463392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:51.487535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bbd02-baa6-487b-b448-d1a7cd1c4773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:51.488175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bbd02-baa6-487b-b448-d1a7cd1c4773 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:51.489150 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bbd02-baa6-487b-b448-d1a7cd1c4773 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:51.489150 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bbd02-baa6-487b-b448-d1a7cd1c4773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:51.496141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bbd02-baa6-487b-b448-d1a7cd1c4773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:51.497624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bbd02-baa6-487b-b448-d1a7cd1c4773 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application [None req-476bbd02-baa6-487b-b448-d1a7cd1c4773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 16:00:51.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:51.510571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:51.511626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 16:00:51.511626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 16:00:51.511626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 16:00:51.511626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 16:00:51.511626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 16:00:51.511626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 16:00:51.511626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 16:00:51.511626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: ERROR keystone.server.flask.application Sep 07 16:00:51.511626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 644/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Sep 7 16:00:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:51.516972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ee6a4-0ca9-4d21-bc7f-8f45be4202a9 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:51.575300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:51.627928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ee6a4-0ca9-4d21-bc7f-8f45be4202a9 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:51.665235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0bb54-ef8a-4dd8-ab5a-84228a62272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:51.665835 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0bb54-ef8a-4dd8-ab5a-84228a62272e None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:51.666111 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0bb54-ef8a-4dd8-ab5a-84228a62272e None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:51.666383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0bb54-ef8a-4dd8-ab5a-84228a62272e None admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:51.667066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0bb54-ef8a-4dd8-ab5a-84228a62272e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:51.667367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0bb54-ef8a-4dd8-ab5a-84228a62272e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:51.668906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0bb54-ef8a-4dd8-ab5a-84228a62272e None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:51.682363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 642/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Sep 7 16:00:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:51.688565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bbd02-baa6-487b-b448-d1a7cd1c4773 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:51.788977 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bbd02-baa6-487b-b448-d1a7cd1c4773 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:51.823421 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c25b85-e5af-4674-b323-a243fe012910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:51.824039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c25b85-e5af-4674-b323-a243fe012910 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:51.824321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c25b85-e5af-4674-b323-a243fe012910 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:51.824594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c25b85-e5af-4674-b323-a243fe012910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:51.825435 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c25b85-e5af-4674-b323-a243fe012910 None admin] RBAC: Adding query filter params (role.id=82a92af3d1d24106b94706aa71c779d5, scope.project.id=983beac5fc784756b6bdf11b07e219ac, user.id=b918da0f83754f3887de1cfa2e4df028) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:51.825691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c25b85-e5af-4674-b323-a243fe012910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:51.827141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c25b85-e5af-4674-b323-a243fe012910 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:51.833898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 645/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Sep 7 16:00:51 2022] GET /identity/v3/role_assignments?user.id=b918da0f83754f3887de1cfa2e4df028&scope.project.id=983beac5fc784756b6bdf11b07e219ac&role.id=82a92af3d1d24106b94706aa71c779d5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:54.021390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5896e-7612-4b20-8f16-9a54a7a0b4ba None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:54.021927 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5896e-7612-4b20-8f16-9a54a7a0b4ba None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:54.021927 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5896e-7612-4b20-8f16-9a54a7a0b4ba None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:54.023243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 643/1288] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:00:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:00:54.028948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e167d1-7ef9-438c-8410-c39e5922c58f None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:54.029369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e167d1-7ef9-438c-8410-c39e5922c58f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:54.029521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e167d1-7ef9-438c-8410-c39e5922c58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:54.051522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-10e167d1-7ef9-438c-8410-c39e5922c58f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:54.052833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-10e167d1-7ef9-438c-8410-c39e5922c58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:54.082885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:54.120773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 646/1289] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:00:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:00:54.397136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5896e-7612-4b20-8f16-9a54a7a0b4ba None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:54.517015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5896e-7612-4b20-8f16-9a54a7a0b4ba None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:54.530718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:54.556499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bcd7a-d170-46b6-9fe0-7b955f1ad9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:54.557186 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bcd7a-d170-46b6-9fe0-7b955f1ad9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:54.557471 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bcd7a-d170-46b6-9fe0-7b955f1ad9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:54.557754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bcd7a-d170-46b6-9fe0-7b955f1ad9d2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:54.558345 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bcd7a-d170-46b6-9fe0-7b955f1ad9d2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:54.559709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bcd7a-d170-46b6-9fe0-7b955f1ad9d2 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-aa7bcd7a-d170-46b6-9fe0-7b955f1ad9d2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:00:54.569809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:00:54.571149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:00:54.572227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:00:54.575910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 644/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Sep 7 16:00:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:00:54.577209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e167d1-7ef9-438c-8410-c39e5922c58f None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:54.685947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e167d1-7ef9-438c-8410-c39e5922c58f None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:54.724629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe46f2-c501-48e8-bf1d-a0410b5a9543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:54.725263 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe46f2-c501-48e8-bf1d-a0410b5a9543 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:54.725542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe46f2-c501-48e8-bf1d-a0410b5a9543 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:54.725813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe46f2-c501-48e8-bf1d-a0410b5a9543 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:54.726444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe46f2-c501-48e8-bf1d-a0410b5a9543 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:54.726747 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe46f2-c501-48e8-bf1d-a0410b5a9543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:54.728127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe46f2-c501-48e8-bf1d-a0410b5a9543 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:54.733111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 647/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Wed Sep 7 16:00:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:54.739606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bcd7a-d170-46b6-9fe0-7b955f1ad9d2 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:54.843816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bcd7a-d170-46b6-9fe0-7b955f1ad9d2 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:54.879716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f028ab-d03a-4658-86f4-940415ab7e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:54.880328 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f028ab-d03a-4658-86f4-940415ab7e8c None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:54.880610 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f028ab-d03a-4658-86f4-940415ab7e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:54.880910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f028ab-d03a-4658-86f4-940415ab7e8c None admin] PATH_INFO: `/v3/services` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:54.881538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f028ab-d03a-4658-86f4-940415ab7e8c None admin] RBAC: Adding query filter params (type=placement) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:54.881841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f028ab-d03a-4658-86f4-940415ab7e8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:54.883213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f028ab-d03a-4658-86f4-940415ab7e8c None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:54.887860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 645/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Wed Sep 7 16:00:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:00:57.067972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf324e-dda7-4a04-af3f-ac65201ff842 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:57.068529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf324e-dda7-4a04-af3f-ac65201ff842 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:57.068529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf324e-dda7-4a04-af3f-ac65201ff842 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:57.069885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 648/1293] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:00:57.076450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e4601-b3ca-4def-b0d7-1abd1704738c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:57.076958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e4601-b3ca-4def-b0d7-1abd1704738c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:57.077088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e4601-b3ca-4def-b0d7-1abd1704738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:57.096021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-df0e4601-b3ca-4def-b0d7-1abd1704738c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:57.097266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-df0e4601-b3ca-4def-b0d7-1abd1704738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:57.128513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:57.168301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 646/1294] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:00:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:00:57.452878 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf324e-dda7-4a04-af3f-ac65201ff842 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:57.492573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:57.578834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf324e-dda7-4a04-af3f-ac65201ff842 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:57.616805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126d95a-d824-4741-a39c-65c0e7786f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:57.617411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126d95a-d824-4741-a39c-65c0e7786f4d None admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:57.617690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126d95a-d824-4741-a39c-65c0e7786f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:57.617962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126d95a-d824-4741-a39c-65c0e7786f4d None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:57.618636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126d95a-d824-4741-a39c-65c0e7786f4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:57.620018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126d95a-d824-4741-a39c-65c0e7786f4d None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:57.636849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 649/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Sep 7 16:00:57 2022] POST /identity/v3/services => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:00:59.852769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008cbcf-af59-49b6-827b-38c8996dd474 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:59.853355 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008cbcf-af59-49b6-827b-38c8996dd474 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:59.853355 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008cbcf-af59-49b6-827b-38c8996dd474 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:59.854631 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 647/1296] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:00:59.860092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8504d6-dd9c-4eea-bb5a-08f6bb5e2ed5 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:59.860508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8504d6-dd9c-4eea-bb5a-08f6bb5e2ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:59.860621 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8504d6-dd9c-4eea-bb5a-08f6bb5e2ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:59.879259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-4d8504d6-dd9c-4eea-bb5a-08f6bb5e2ed5 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:59.880463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4d8504d6-dd9c-4eea-bb5a-08f6bb5e2ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:59.953462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 650/1297] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:00:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:01:00.227013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008cbcf-af59-49b6-827b-38c8996dd474 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:00.329187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008cbcf-af59-49b6-827b-38c8996dd474 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:00.365775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6259d9-9ead-4e52-82a3-186ed2781fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:00.366412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6259d9-9ead-4e52-82a3-186ed2781fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:00.366694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6259d9-9ead-4e52-82a3-186ed2781fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:00.366970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6259d9-9ead-4e52-82a3-186ed2781fd5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:00.367558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6259d9-9ead-4e52-82a3-186ed2781fd5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:00.368956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6259d9-9ead-4e52-82a3-186ed2781fd5 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-2e6259d9-9ead-4e52-82a3-186ed2781fd5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:01:00.377898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:01:00.379729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:01:00.380810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 648/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Sep 7 16:01:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:01:00.385576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8504d6-dd9c-4eea-bb5a-08f6bb5e2ed5 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:00.405226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:00.499876 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8504d6-dd9c-4eea-bb5a-08f6bb5e2ed5 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:00.539075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c48047-9539-42ee-a1dd-835319ad6bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:00.539689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c48047-9539-42ee-a1dd-835319ad6bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:00.539971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c48047-9539-42ee-a1dd-835319ad6bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:00.540242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c48047-9539-42ee-a1dd-835319ad6bd7 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:00.540902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c48047-9539-42ee-a1dd-835319ad6bd7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:01:00.541206 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c48047-9539-42ee-a1dd-835319ad6bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:00.542590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c48047-9539-42ee-a1dd-835319ad6bd7 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:00.547926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 651/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Wed Sep 7 16:01:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:01:00.554091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6259d9-9ead-4e52-82a3-186ed2781fd5 None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:00.587201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:00.657229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6259d9-9ead-4e52-82a3-186ed2781fd5 None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:00.690983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d96c01-767a-487a-80b9-fc297b00c418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:00.692290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d96c01-767a-487a-80b9-fc297b00c418 None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:00.692431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d96c01-767a-487a-80b9-fc297b00c418 None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:00.692749 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d96c01-767a-487a-80b9-fc297b00c418 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:00.693452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d96c01-767a-487a-80b9-fc297b00c418 None admin] RBAC: Adding query filter params (interface=public, service_id=2c806253ecbc448ba6ee8b68beeaa7be, region_id=RegionOne) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:01:00.693760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d96c01-767a-487a-80b9-fc297b00c418 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:00.695124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d96c01-767a-487a-80b9-fc297b00c418 None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:00.700349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 649/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Sep 7 16:01:00 2022] GET /identity/v3/endpoints?service_id=2c806253ecbc448ba6ee8b68beeaa7be&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:01:00.706085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c48047-9539-42ee-a1dd-835319ad6bd7 None admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:00.791444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:00.810541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c48047-9539-42ee-a1dd-835319ad6bd7 None admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:00.850689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb7028-9e76-417e-b62d-9a8ab0e98fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:00.851304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb7028-9e76-417e-b62d-9a8ab0e98fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:00.851587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb7028-9e76-417e-b62d-9a8ab0e98fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:00.851864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb7028-9e76-417e-b62d-9a8ab0e98fc0 None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:00.852475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb7028-9e76-417e-b62d-9a8ab0e98fc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:00.853886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb7028-9e76-417e-b62d-9a8ab0e98fc0 None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:00.861062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 652/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Sep 7 16:01:00 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:03.067430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e385e-918b-46f8-89ac-c7dd16d3adf8 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:03.067952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e385e-918b-46f8-89ac-c7dd16d3adf8 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:03.068045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e385e-918b-46f8-89ac-c7dd16d3adf8 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:03.069357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 650/1302] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:01:03.074550 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9157e8-08aa-4afa-a339-fda1b9cf977c None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:03.074992 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9157e8-08aa-4afa-a339-fda1b9cf977c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:03.075099 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9157e8-08aa-4afa-a339-fda1b9cf977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:03.093778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-7c9157e8-08aa-4afa-a339-fda1b9cf977c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:03.094986 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7c9157e8-08aa-4afa-a339-fda1b9cf977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:03.163724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 653/1303] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:01:03 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 16:01:03.430116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e385e-918b-46f8-89ac-c7dd16d3adf8 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:03.533687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:03.541230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e385e-918b-46f8-89ac-c7dd16d3adf8 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:03.576774 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cedc9-dd84-4185-8b6e-9539088027ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:03.577401 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cedc9-dd84-4185-8b6e-9539088027ba None admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:03.577679 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cedc9-dd84-4185-8b6e-9539088027ba None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:03.577950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cedc9-dd84-4185-8b6e-9539088027ba None admin] PATH_INFO: `/v3/services/placement` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:03.578529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cedc9-dd84-4185-8b6e-9539088027ba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:03.579884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cedc9-dd84-4185-8b6e-9539088027ba None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application [None req-027cedc9-dd84-4185-8b6e-9539088027ba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 16:01:03.589577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 16:01:03.590788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application with Lock( Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self._enter() Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application return self.creator() Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application created_value = creator( Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: ERROR keystone.server.flask.application Sep 07 16:01:03.591999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 651/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Sep 7 16:01:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 16:01:03.597020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9157e8-08aa-4afa-a339-fda1b9cf977c None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:03.681767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:03.706225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9157e8-08aa-4afa-a339-fda1b9cf977c None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:03.741935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adf543-598f-4cd8-9b91-7603049c87ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:03.742537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adf543-598f-4cd8-9b91-7603049c87ec None admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:03.742815 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adf543-598f-4cd8-9b91-7603049c87ec None admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:03.743087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adf543-598f-4cd8-9b91-7603049c87ec None admin] PATH_INFO: `/v3/services` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:03.743723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adf543-598f-4cd8-9b91-7603049c87ec None admin] RBAC: Adding query filter params (name=placement) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:01:03.744025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adf543-598f-4cd8-9b91-7603049c87ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:03.745484 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adf543-598f-4cd8-9b91-7603049c87ec None admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:03.750740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 654/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Wed Sep 7 16:01:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:01:03.757680 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cedc9-dd84-4185-8b6e-9539088027ba None admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:03.863299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cedc9-dd84-4185-8b6e-9539088027ba None admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:03.897947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda7531-41d4-43e0-b5dd-66a99f75dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:03.898554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7531-41d4-43e0-b5dd-66a99f75dfaa None admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:03.898834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7531-41d4-43e0-b5dd-66a99f75dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:03.899106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7531-41d4-43e0-b5dd-66a99f75dfaa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:03.899801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda7531-41d4-43e0-b5dd-66a99f75dfaa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:03.901207 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda7531-41d4-43e0-b5dd-66a99f75dfaa None admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:03.920792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 652/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:13.747703 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=30 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:13.916730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:11.479545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf30f7-2c7d-47c6-a65f-37bf37f89676 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:11.480031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf30f7-2c7d-47c6-a65f-37bf37f89676 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:11.480112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf30f7-2c7d-47c6-a65f-37bf37f89676 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:11.486907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552816-379d-4f63-801b-b8cd51c593d0 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:11.487339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552816-379d-4f63-801b-b8cd51c593d0 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:11.487456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552816-379d-4f63-801b-b8cd51c593d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:11.490664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 655/1307] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:11.609820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-2b552816-379d-4f63-801b-b8cd51c593d0 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:11.611908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2b552816-379d-4f63-801b-b8cd51c593d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:11.757320 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 653/1308] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:02:12.053135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fafad-b22a-4a03-977f-05804b9784c5 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:12.053457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fafad-b22a-4a03-977f-05804b9784c5 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:12.053698 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fafad-b22a-4a03-977f-05804b9784c5 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:12.055217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 656/1309] 10.222.0.43 () {54 vars in 965 bytes} [Wed Sep 7 16:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:12.062584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153f59a-255e-4467-a383-8c30d0abf5ce None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:12.063385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153f59a-255e-4467-a383-8c30d0abf5ce None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:12.064971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153f59a-255e-4467-a383-8c30d0abf5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:12.185340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f153f59a-255e-4467-a383-8c30d0abf5ce None None] MFA Rules not processed for user `e91f048f8885448383f4a361b07dac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:12.186553 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f153f59a-255e-4467-a383-8c30d0abf5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:12.210694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:12.274351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 654/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Wed Sep 7 16:02:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:02:12.284962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fafad-b22a-4a03-977f-05804b9784c5 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:12.287092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-219fafad-b22a-4a03-977f-05804b9784c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:12.429396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fafad-b22a-4a03-977f-05804b9784c5 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:12.521081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07419798-9269-43cf-9ed4-c329f6111dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:12.521717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07419798-9269-43cf-9ed4-c329f6111dda service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:12.521950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07419798-9269-43cf-9ed4-c329f6111dda service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:12.522158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07419798-9269-43cf-9ed4-c329f6111dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:12.523811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-07419798-9269-43cf-9ed4-c329f6111dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:12.597321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:12.682623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07419798-9269-43cf-9ed4-c329f6111dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:12.684518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07419798-9269-43cf-9ed4-c329f6111dda service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:12.712826 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 657/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:15.720061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8800a-0485-4553-8857-5498ff47c999 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.720635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8800a-0485-4553-8857-5498ff47c999 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.720883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8800a-0485-4553-8857-5498ff47c999 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.722219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 655/1312] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:15.727647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84f1fd-8903-4c87-ba76-bb0fb559dddd None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.728083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84f1fd-8903-4c87-ba76-bb0fb559dddd None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.728196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84f1fd-8903-4c87-ba76-bb0fb559dddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.802681 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-bb84f1fd-8903-4c87-ba76-bb0fb559dddd None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:15.803923 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-bb84f1fd-8903-4c87-ba76-bb0fb559dddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:15.906723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 658/1313] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:16.216732 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e223e8-1e94-4519-8a1a-14905dccdb36 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:16.217014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e223e8-1e94-4519-8a1a-14905dccdb36 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:16.217321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e223e8-1e94-4519-8a1a-14905dccdb36 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:16.218757 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 656/1314] 10.222.0.43 () {54 vars in 965 bytes} [Wed Sep 7 16:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:16.227472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163898c-c959-4aa2-84a3-887e8013e442 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:16.227866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163898c-c959-4aa2-84a3-887e8013e442 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:16.228156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163898c-c959-4aa2-84a3-887e8013e442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:16.241750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:16.315679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-2163898c-c959-4aa2-84a3-887e8013e442 None None] MFA Rules not processed for user `e91f048f8885448383f4a361b07dac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:16.316871 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2163898c-c959-4aa2-84a3-887e8013e442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:16.403209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 659/1315] 10.222.0.43 () {58 vars in 1062 bytes} [Wed Sep 7 16:02:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:16.414244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e223e8-1e94-4519-8a1a-14905dccdb36 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:16.416348 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c2e223e8-1e94-4519-8a1a-14905dccdb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:16.528662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e223e8-1e94-4519-8a1a-14905dccdb36 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:16.617742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:16.621807 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1e54b-6838-464b-bed3-a8fc4f350328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:16.622470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1e54b-6838-464b-bed3-a8fc4f350328 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:16.622797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1e54b-6838-464b-bed3-a8fc4f350328 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:16.623195 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1e54b-6838-464b-bed3-a8fc4f350328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:16.624886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9dd1e54b-6838-464b-bed3-a8fc4f350328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:16.773141 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1e54b-6838-464b-bed3-a8fc4f350328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:16.774669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1e54b-6838-464b-bed3-a8fc4f350328 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:16.794939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 657/1316] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:19.663617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9586eb-fca2-4b9c-88f0-b2d9d1d665c4 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:19.664293 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9586eb-fca2-4b9c-88f0-b2d9d1d665c4 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:19.664293 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9586eb-fca2-4b9c-88f0-b2d9d1d665c4 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:19.666127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 660/1317] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:19.671652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89ccd2-b333-4be3-bd0d-2c5ded1f4fa3 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:19.672142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89ccd2-b333-4be3-bd0d-2c5ded1f4fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:19.672241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89ccd2-b333-4be3-bd0d-2c5ded1f4fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:19.744672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-2d89ccd2-b333-4be3-bd0d-2c5ded1f4fa3 None None] MFA Rules not processed for user `b0c8c916f4a849b19484742f9e99bd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:19.745943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2d89ccd2-b333-4be3-bd0d-2c5ded1f4fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:19.799717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:19.847399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 658/1318] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:20.132902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9586eb-fca2-4b9c-88f0-b2d9d1d665c4 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:20.134457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2b9586eb-fca2-4b9c-88f0-b2d9d1d665c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:20.245955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9586eb-fca2-4b9c-88f0-b2d9d1d665c4 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:20.248890 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:20.336253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835d688-9a16-4181-acdd-71412414bffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:20.336801 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835d688-9a16-4181-acdd-71412414bffe service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:20.337079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835d688-9a16-4181-acdd-71412414bffe service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:20.337346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835d688-9a16-4181-acdd-71412414bffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:20.338938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9835d688-9a16-4181-acdd-71412414bffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:20.471562 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835d688-9a16-4181-acdd-71412414bffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:20.473916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835d688-9a16-4181-acdd-71412414bffe service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:20.495283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 661/1319] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:23.271514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0c09-52a8-4297-a5f2-ca7c7fc4f833 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:23.272079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0c09-52a8-4297-a5f2-ca7c7fc4f833 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:23.272079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0c09-52a8-4297-a5f2-ca7c7fc4f833 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:23.273444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 659/1320] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:23.279300 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a53ea3-8b81-41a9-b951-8828bdbcf95c None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:23.279713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a53ea3-8b81-41a9-b951-8828bdbcf95c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:23.279813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a53ea3-8b81-41a9-b951-8828bdbcf95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:23.321562 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:23.349939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-56a53ea3-8b81-41a9-b951-8828bdbcf95c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:23.351158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-56a53ea3-8b81-41a9-b951-8828bdbcf95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:23.452452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 662/1321] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:23.740262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd0c09-52a8-4297-a5f2-ca7c7fc4f833 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:23.741864 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1bcd0c09-52a8-4297-a5f2-ca7c7fc4f833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:23.851384 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd0c09-52a8-4297-a5f2-ca7c7fc4f833 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:23.926843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb41b4-cfa8-466b-9239-d2404dafdced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:23.927447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb41b4-cfa8-466b-9239-d2404dafdced service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:23.927732 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb41b4-cfa8-466b-9239-d2404dafdced service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:23.928007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb41b4-cfa8-466b-9239-d2404dafdced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:23.929666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-adbb41b4-cfa8-466b-9239-d2404dafdced service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:23.937255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:24.047600 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb41b4-cfa8-466b-9239-d2404dafdced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:24.049098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb41b4-cfa8-466b-9239-d2404dafdced service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:24.068045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 660/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:26.966856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943c4e4-9ac0-4cb4-828d-35621319fb61 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:26.967404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943c4e4-9ac0-4cb4-828d-35621319fb61 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:26.967404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943c4e4-9ac0-4cb4-828d-35621319fb61 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:26.968825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 663/1323] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:26.976452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e7c5f-4f70-466d-aa17-e68edf716b4a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:26.977019 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e7c5f-4f70-466d-aa17-e68edf716b4a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:26.977166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e7c5f-4f70-466d-aa17-e68edf716b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:27.051911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-a80e7c5f-4f70-466d-aa17-e68edf716b4a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:27.053142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a80e7c5f-4f70-466d-aa17-e68edf716b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:27.119474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:27.167752 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 661/1324] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:27.452961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943c4e4-9ac0-4cb4-828d-35621319fb61 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:27.454785 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6943c4e4-9ac0-4cb4-828d-35621319fb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:27.581087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943c4e4-9ac0-4cb4-828d-35621319fb61 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:27.594154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:27.669095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dc740-a684-48c9-b4ad-4bbb5a511c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:27.669706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dc740-a684-48c9-b4ad-4bbb5a511c04 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:27.669982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dc740-a684-48c9-b4ad-4bbb5a511c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:27.670254 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dc740-a684-48c9-b4ad-4bbb5a511c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:27.671864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-190dc740-a684-48c9-b4ad-4bbb5a511c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:27.798210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dc740-a684-48c9-b4ad-4bbb5a511c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:27.799695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dc740-a684-48c9-b4ad-4bbb5a511c04 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:27.820823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 664/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:30.085473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf650-7a83-400e-95c0-2c1e59f393bd None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:30.086039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf650-7a83-400e-95c0-2c1e59f393bd None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:30.086039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf650-7a83-400e-95c0-2c1e59f393bd None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:30.087388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 662/1326] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:30.092861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecc706-3dd9-4829-9faf-420058d4fb93 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:30.093314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecc706-3dd9-4829-9faf-420058d4fb93 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:30.093409 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecc706-3dd9-4829-9faf-420058d4fb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:30.151401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:30.174877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-daecc706-3dd9-4829-9faf-420058d4fb93 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:30.176128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-daecc706-3dd9-4829-9faf-420058d4fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:30.283437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 665/1327] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:30.576911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bf650-7a83-400e-95c0-2c1e59f393bd None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:30.579042 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3c0bf650-7a83-400e-95c0-2c1e59f393bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:30.701241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bf650-7a83-400e-95c0-2c1e59f393bd None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:30.779811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ca0ba-7190-4c59-928f-d7c800ad0f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:30.780422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ca0ba-7190-4c59-928f-d7c800ad0f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:30.780721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ca0ba-7190-4c59-928f-d7c800ad0f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:30.780996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ca0ba-7190-4c59-928f-d7c800ad0f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:30.782662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1a4ca0ba-7190-4c59-928f-d7c800ad0f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:30.804414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:30.919545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ca0ba-7190-4c59-928f-d7c800ad0f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:30.921115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ca0ba-7190-4c59-928f-d7c800ad0f7d service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:30.940623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 663/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:02:33.233852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc140db0-08bf-4b77-b4d4-31a450a6668f None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:33.234521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc140db0-08bf-4b77-b4d4-31a450a6668f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:33.234521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc140db0-08bf-4b77-b4d4-31a450a6668f None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:33.236536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 666/1329] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:33.243762 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a689b6-308f-41f0-a96c-a9ead23d6be9 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:33.244205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a689b6-308f-41f0-a96c-a9ead23d6be9 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:33.244444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a689b6-308f-41f0-a96c-a9ead23d6be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:33.321185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-d6a689b6-308f-41f0-a96c-a9ead23d6be9 None None] MFA Rules not processed for user `b0c8c916f4a849b19484742f9e99bd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:33.322338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d6a689b6-308f-41f0-a96c-a9ead23d6be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:33.403595 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:33.461863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 664/1330] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:33.759165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc140db0-08bf-4b77-b4d4-31a450a6668f None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:33.760867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-dc140db0-08bf-4b77-b4d4-31a450a6668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:33.873350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc140db0-08bf-4b77-b4d4-31a450a6668f None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:33.898895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:33.957974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faabec2-4011-4ebb-9c2c-6df4a6e6efdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:33.958583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faabec2-4011-4ebb-9c2c-6df4a6e6efdf service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:33.958864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faabec2-4011-4ebb-9c2c-6df4a6e6efdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:33.959137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faabec2-4011-4ebb-9c2c-6df4a6e6efdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:33.960766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6faabec2-4011-4ebb-9c2c-6df4a6e6efdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:34.074688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faabec2-4011-4ebb-9c2c-6df4a6e6efdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:34.076140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faabec2-4011-4ebb-9c2c-6df4a6e6efdf service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:34.095219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 667/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:36.598585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c15784-f1d9-4dbb-b5c7-e5f0951520d3 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:36.599126 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c15784-f1d9-4dbb-b5c7-e5f0951520d3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:36.599126 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c15784-f1d9-4dbb-b5c7-e5f0951520d3 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:36.600459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 665/1332] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:36.605711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789b1a9-3a00-4dca-9323-8ed3e9efd30e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:36.606098 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789b1a9-3a00-4dca-9323-8ed3e9efd30e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:36.606271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789b1a9-3a00-4dca-9323-8ed3e9efd30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:36.683039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:36.686414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9789b1a9-3a00-4dca-9323-8ed3e9efd30e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:36.687881 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9789b1a9-3a00-4dca-9323-8ed3e9efd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:36.784000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 668/1333] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:37.072822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c15784-f1d9-4dbb-b5c7-e5f0951520d3 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:37.074404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e0c15784-f1d9-4dbb-b5c7-e5f0951520d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:37.196897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c15784-f1d9-4dbb-b5c7-e5f0951520d3 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:37.271293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc50c9f-d3a2-44e3-853d-ab5d8fdf70eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:37.271896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc50c9f-d3a2-44e3-853d-ab5d8fdf70eb service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:37.272167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc50c9f-d3a2-44e3-853d-ab5d8fdf70eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:37.272436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc50c9f-d3a2-44e3-853d-ab5d8fdf70eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:37.274064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0cc50c9f-d3a2-44e3-853d-ab5d8fdf70eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:37.301179 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:37.382284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc50c9f-d3a2-44e3-853d-ab5d8fdf70eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:37.383696 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc50c9f-d3a2-44e3-853d-ab5d8fdf70eb service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:37.401785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 666/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:39.645705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217241d3-4ca0-4121-a32f-3fa9033cc605 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:39.646320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217241d3-4ca0-4121-a32f-3fa9033cc605 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:39.646320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217241d3-4ca0-4121-a32f-3fa9033cc605 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:39.647598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 669/1335] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:39.653161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfec474-ca59-42e2-bf7b-a77315d2acd7 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:39.653604 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfec474-ca59-42e2-bf7b-a77315d2acd7 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:39.653727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfec474-ca59-42e2-bf7b-a77315d2acd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:39.722369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-adfec474-ca59-42e2-bf7b-a77315d2acd7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:39.723604 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-adfec474-ca59-42e2-bf7b-a77315d2acd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:39.799255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:39.821648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 667/1336] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:40.109436 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217241d3-4ca0-4121-a32f-3fa9033cc605 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:40.110975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-217241d3-4ca0-4121-a32f-3fa9033cc605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:40.215594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217241d3-4ca0-4121-a32f-3fa9033cc605 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:40.244882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:40.290975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85e2ea-8147-4fe3-995c-7a4b4414ae03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:40.291493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85e2ea-8147-4fe3-995c-7a4b4414ae03 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:40.291772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85e2ea-8147-4fe3-995c-7a4b4414ae03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:40.292042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85e2ea-8147-4fe3-995c-7a4b4414ae03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:40.293680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8b85e2ea-8147-4fe3-995c-7a4b4414ae03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:40.405367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85e2ea-8147-4fe3-995c-7a4b4414ae03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:40.407009 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85e2ea-8147-4fe3-995c-7a4b4414ae03 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:40.425740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 670/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:43.238408 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c4141-a2b1-4ba2-aefc-95c4c9d2ef68 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:43.239126 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c4141-a2b1-4ba2-aefc-95c4c9d2ef68 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:43.239126 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c4141-a2b1-4ba2-aefc-95c4c9d2ef68 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:43.240272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 668/1338] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:43.245905 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c9d4-c25c-4472-b246-11bba877b76e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:43.246397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c9d4-c25c-4472-b246-11bba877b76e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:43.246495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c9d4-c25c-4472-b246-11bba877b76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:43.317423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-1db9c9d4-c25c-4472-b246-11bba877b76e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:43.318557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1db9c9d4-c25c-4472-b246-11bba877b76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:43.326826 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:43.415332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 671/1339] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:43.697353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c4141-a2b1-4ba2-aefc-95c4c9d2ef68 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:43.698890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6e3c4141-a2b1-4ba2-aefc-95c4c9d2ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:43.804621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c4141-a2b1-4ba2-aefc-95c4c9d2ef68 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:43.885464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d855827-0eb5-48d3-900b-969d1af6d5f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:43.886073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d855827-0eb5-48d3-900b-969d1af6d5f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:43.886358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d855827-0eb5-48d3-900b-969d1af6d5f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:43.886632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d855827-0eb5-48d3-900b-969d1af6d5f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:43.888259 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2d855827-0eb5-48d3-900b-969d1af6d5f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:43.926895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:44.004645 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d855827-0eb5-48d3-900b-969d1af6d5f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:44.006020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d855827-0eb5-48d3-900b-969d1af6d5f7 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:44.024226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 669/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:48.400912 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a87c8e-7cc3-4a25-9979-d07dae28ccea None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:48.401472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a87c8e-7cc3-4a25-9979-d07dae28ccea None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:48.401472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a87c8e-7cc3-4a25-9979-d07dae28ccea None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:48.402724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 672/1341] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:48.409928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676d4c4-4f14-45c9-91be-892729a8cc8d None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:48.410410 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676d4c4-4f14-45c9-91be-892729a8cc8d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:48.410667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676d4c4-4f14-45c9-91be-892729a8cc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:48.485835 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-1676d4c4-4f14-45c9-91be-892729a8cc8d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:48.487000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1676d4c4-4f14-45c9-91be-892729a8cc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:48.577778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:48.590386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 670/1342] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:48.878699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a87c8e-7cc3-4a25-9979-d07dae28ccea None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:48.880257 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d3a87c8e-7cc3-4a25-9979-d07dae28ccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:48.997028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a87c8e-7cc3-4a25-9979-d07dae28ccea None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:49.045421 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:49.091188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51951b45-eec4-415c-a61c-9b893e81a072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:49.092047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951b45-eec4-415c-a61c-9b893e81a072 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:49.092531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951b45-eec4-415c-a61c-9b893e81a072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:49.093051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951b45-eec4-415c-a61c-9b893e81a072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:49.096249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-51951b45-eec4-415c-a61c-9b893e81a072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:49.221554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51951b45-eec4-415c-a61c-9b893e81a072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:49.223013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51951b45-eec4-415c-a61c-9b893e81a072 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:49.252570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 673/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:52.094120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd707f-138a-440c-97bc-523438143232 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:52.094686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd707f-138a-440c-97bc-523438143232 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:52.094686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd707f-138a-440c-97bc-523438143232 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:52.095997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 671/1344] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:52.101542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076f55b-67cf-4d74-8d8c-e8a763f6f834 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:52.102048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076f55b-67cf-4d74-8d8c-e8a763f6f834 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:52.102237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076f55b-67cf-4d74-8d8c-e8a763f6f834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:52.173618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9076f55b-67cf-4d74-8d8c-e8a763f6f834 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:52.174835 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9076f55b-67cf-4d74-8d8c-e8a763f6f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:52.195499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:52.290662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 674/1345] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:52.579708 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd707f-138a-440c-97bc-523438143232 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:52.581279 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-12dd707f-138a-440c-97bc-523438143232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:52.697951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd707f-138a-440c-97bc-523438143232 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:52.787260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d904-b6fd-4a1a-aafe-1e929950b733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:52.787906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d904-b6fd-4a1a-aafe-1e929950b733 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:52.788267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d904-b6fd-4a1a-aafe-1e929950b733 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:52.788793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d904-b6fd-4a1a-aafe-1e929950b733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:52.791004 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-58f5d904-b6fd-4a1a-aafe-1e929950b733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:52.841502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:52.916847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5d904-b6fd-4a1a-aafe-1e929950b733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:52.918295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5d904-b6fd-4a1a-aafe-1e929950b733 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:52.940004 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 672/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:57.474195 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da962374-0731-4b47-ac15-7f1379ce4caf None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:57.474779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da962374-0731-4b47-ac15-7f1379ce4caf None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:57.474779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da962374-0731-4b47-ac15-7f1379ce4caf None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:57.476156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 675/1347] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:02:57.481683 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edd7f6-c518-4d44-a15c-a3171ec101db None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:57.482146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edd7f6-c518-4d44-a15c-a3171ec101db None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:57.482239 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edd7f6-c518-4d44-a15c-a3171ec101db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:57.555353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-78edd7f6-c518-4d44-a15c-a3171ec101db None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:57.556586 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-78edd7f6-c518-4d44-a15c-a3171ec101db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:57.672545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:57.675422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 673/1348] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:57.969699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da962374-0731-4b47-ac15-7f1379ce4caf None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:57.971272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-da962374-0731-4b47-ac15-7f1379ce4caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:58.086116 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da962374-0731-4b47-ac15-7f1379ce4caf None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:58.135638 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:58.162866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee656f-6141-488d-a8fe-4ab7a9547529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:58.163474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee656f-6141-488d-a8fe-4ab7a9547529 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:58.163772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee656f-6141-488d-a8fe-4ab7a9547529 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:58.164031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee656f-6141-488d-a8fe-4ab7a9547529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:58.165692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f4ee656f-6141-488d-a8fe-4ab7a9547529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:58.278966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee656f-6141-488d-a8fe-4ab7a9547529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:58.280518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee656f-6141-488d-a8fe-4ab7a9547529 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:58.304214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 676/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:03.466161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f23e1-7db0-488e-9ee9-5d3d298d4c17 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:03.467079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f23e1-7db0-488e-9ee9-5d3d298d4c17 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:03.467577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f23e1-7db0-488e-9ee9-5d3d298d4c17 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:03.469326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 674/1350] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:03:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:03.475013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f5d4e-d540-47af-85ec-1e7160e03a9d None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:03.475493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f5d4e-d540-47af-85ec-1e7160e03a9d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:03.475644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f5d4e-d540-47af-85ec-1e7160e03a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:03.605175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-d95f5d4e-d540-47af-85ec-1e7160e03a9d None None] MFA Rules not processed for user `b918da0f83754f3887de1cfa2e4df028`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:03.606489 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d95f5d4e-d540-47af-85ec-1e7160e03a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:03.673080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:03.758138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 677/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:08.060599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d65bc-b263-4a11-988b-8646308e1fd9 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:08.062149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d65bc-b263-4a11-988b-8646308e1fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:08.062424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d65bc-b263-4a11-988b-8646308e1fd9 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:08.064090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 675/1352] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:08.069041 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e119e94-16c4-4151-959b-7d5719e68eb4 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:08.069531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e119e94-16c4-4151-959b-7d5719e68eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:08.069626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e119e94-16c4-4151-959b-7d5719e68eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:08.164631 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-0e119e94-16c4-4151-959b-7d5719e68eb4 None None] MFA Rules not processed for user `b918da0f83754f3887de1cfa2e4df028`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:08.165896 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0e119e94-16c4-4151-959b-7d5719e68eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:08.252873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:08.293784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 678/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:03:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:10.033398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911a413-82aa-4140-adda-ff183fe00729 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:10.033935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911a413-82aa-4140-adda-ff183fe00729 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:10.034314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911a413-82aa-4140-adda-ff183fe00729 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:10.035983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 676/1354] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:10.041581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a726bc-6d14-4e38-abf6-a656c7bc7632 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:10.042061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a726bc-6d14-4e38-abf6-a656c7bc7632 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:10.042345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a726bc-6d14-4e38-abf6-a656c7bc7632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:10.144428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-44a726bc-6d14-4e38-abf6-a656c7bc7632 None None] MFA Rules not processed for user `b918da0f83754f3887de1cfa2e4df028`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:10.145711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-44a726bc-6d14-4e38-abf6-a656c7bc7632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:10.272401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 679/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:03:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:13.751448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e645-67ec-4366-b618-99cb7102bfa0 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:13.752277 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e645-67ec-4366-b618-99cb7102bfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:13.752790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e645-67ec-4366-b618-99cb7102bfa0 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:13.754297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 677/1356] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:13.760088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83e974-22b9-48ac-bc4d-0f754a9ac3af None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:13.760972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83e974-22b9-48ac-bc4d-0f754a9ac3af None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:13.761403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83e974-22b9-48ac-bc4d-0f754a9ac3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:13.823418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:13.874277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8d83e974-22b9-48ac-bc4d-0f754a9ac3af None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:13.875773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8d83e974-22b9-48ac-bc4d-0f754a9ac3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:14.035198 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 680/1357] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:14.342391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e2add-3a32-41e6-92ea-43d4f5d2e9b6 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:14.342952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e2add-3a32-41e6-92ea-43d4f5d2e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:14.343460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e2add-3a32-41e6-92ea-43d4f5d2e9b6 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:14.345257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 678/1358] 10.222.0.43 () {54 vars in 962 bytes} [Wed Sep 7 16:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:14.357365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd07be-68f2-4368-b30a-728a27c18da9 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:14.358472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd07be-68f2-4368-b30a-728a27c18da9 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:14.359115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd07be-68f2-4368-b30a-728a27c18da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:14.470949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-80fd07be-68f2-4368-b30a-728a27c18da9 None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:14.472178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-80fd07be-68f2-4368-b30a-728a27c18da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:14.528430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:14.626839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 681/1359] 10.222.0.43 () {58 vars in 1059 bytes} [Wed Sep 7 16:03:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:14.634413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e2add-3a32-41e6-92ea-43d4f5d2e9b6 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:14.636842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ed0e2add-3a32-41e6-92ea-43d4f5d2e9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:14.863704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e2add-3a32-41e6-92ea-43d4f5d2e9b6 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:14.958225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:15.032634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad3218-f840-4917-bf10-11c8f0530070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:15.033291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad3218-f840-4917-bf10-11c8f0530070 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.033580 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad3218-f840-4917-bf10-11c8f0530070 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.033858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad3218-f840-4917-bf10-11c8f0530070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.035606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-47ad3218-f840-4917-bf10-11c8f0530070 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:15.162516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad3218-f840-4917-bf10-11c8f0530070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:15.164143 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad3218-f840-4917-bf10-11c8f0530070 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:15.187399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 679/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:17.690864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f9d30-d8ad-4b85-9be4-8df2a16e754f None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:17.690864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f9d30-d8ad-4b85-9be4-8df2a16e754f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:17.690864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f9d30-d8ad-4b85-9be4-8df2a16e754f None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:17.693183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 682/1361] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:03:17.698673 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba0d58-1768-4d8f-bfde-03967c1daae2 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:17.698673 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba0d58-1768-4d8f-bfde-03967c1daae2 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:17.698673 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba0d58-1768-4d8f-bfde-03967c1daae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:17.776841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-5aba0d58-1768-4d8f-bfde-03967c1daae2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:17.778381 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5aba0d58-1768-4d8f-bfde-03967c1daae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:17.834176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:17.913890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 680/1362] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:18.210651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f9d30-d8ad-4b85-9be4-8df2a16e754f None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:18.212490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b61f9d30-d8ad-4b85-9be4-8df2a16e754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:18.426492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f9d30-d8ad-4b85-9be4-8df2a16e754f None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:18.438115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:18.568882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1284a10-8315-4369-8734-21c04476552a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:18.569486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1284a10-8315-4369-8734-21c04476552a service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:18.569797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1284a10-8315-4369-8734-21c04476552a service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:18.570034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1284a10-8315-4369-8734-21c04476552a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:18.571760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f1284a10-8315-4369-8734-21c04476552a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:18.691863 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1284a10-8315-4369-8734-21c04476552a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:18.693719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1284a10-8315-4369-8734-21c04476552a service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:18.720494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 683/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:21.456500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfa7b4-a0bd-4b8a-b72e-8084b5c88d52 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:21.457454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfa7b4-a0bd-4b8a-b72e-8084b5c88d52 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:21.457454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfa7b4-a0bd-4b8a-b72e-8084b5c88d52 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:21.459433 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 681/1364] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:03:21.465459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf25f62-a6ab-45c0-91b8-c04bbff97c38 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:21.465984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf25f62-a6ab-45c0-91b8-c04bbff97c38 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:21.466080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf25f62-a6ab-45c0-91b8-c04bbff97c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:21.482833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:21.542167 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-6bf25f62-a6ab-45c0-91b8-c04bbff97c38 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:21.543412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6bf25f62-a6ab-45c0-91b8-c04bbff97c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:21.659495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 684/1365] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:21.968150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b80b6-cdbe-4041-b333-081b3cfe6566 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:21.968469 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b80b6-cdbe-4041-b333-081b3cfe6566 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:21.968884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b80b6-cdbe-4041-b333-081b3cfe6566 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:21.970383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 682/1366] 10.222.0.43 () {54 vars in 962 bytes} [Wed Sep 7 16:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:21.976155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6eb68-37fb-4d6e-838f-a93d0127ca27 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:21.976608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6eb68-37fb-4d6e-838f-a93d0127ca27 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:21.977129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6eb68-37fb-4d6e-838f-a93d0127ca27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:22.078087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-6cc6eb68-37fb-4d6e-838f-a93d0127ca27 None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:22.079541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6cc6eb68-37fb-4d6e-838f-a93d0127ca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:22.120704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:22.235039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 685/1367] 10.222.0.43 () {58 vars in 1059 bytes} [Wed Sep 7 16:03:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:22.240852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b80b6-cdbe-4041-b333-081b3cfe6566 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:22.242790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9d6b80b6-cdbe-4041-b333-081b3cfe6566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:22.434369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b80b6-cdbe-4041-b333-081b3cfe6566 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:22.458858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:22.575089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea896-e9e9-415a-99d5-38adefc5dc83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:22.575622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea896-e9e9-415a-99d5-38adefc5dc83 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:22.575904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea896-e9e9-415a-99d5-38adefc5dc83 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:22.576177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea896-e9e9-415a-99d5-38adefc5dc83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:22.579011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5beea896-e9e9-415a-99d5-38adefc5dc83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:22.592776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055233f-ccf0-4231-9fa7-29834a67f4c0 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:22.594038 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055233f-ccf0-4231-9fa7-29834a67f4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:22.594038 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055233f-ccf0-4231-9fa7-29834a67f4c0 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:22.597078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 686/1368] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:03:22.600568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e789527-075b-48e0-be11-f351a7e2bb9c None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:22.600887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e789527-075b-48e0-be11-f351a7e2bb9c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:22.601156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e789527-075b-48e0-be11-f351a7e2bb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:22.685168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-7e789527-075b-48e0-be11-f351a7e2bb9c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:22.687330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7e789527-075b-48e0-be11-f351a7e2bb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:22.688779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beea896-e9e9-415a-99d5-38adefc5dc83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:22.690977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beea896-e9e9-415a-99d5-38adefc5dc83 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:22.720384 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 683/1369] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:22.819244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:22.831004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 687/1370] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:03:23.196897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8269768-06fb-4eef-8c57-9d4094c00d3c None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.196897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8269768-06fb-4eef-8c57-9d4094c00d3c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.197558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8269768-06fb-4eef-8c57-9d4094c00d3c None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.199546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 684/1371] 10.222.0.43 () {54 vars in 964 bytes} [Wed Sep 7 16:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:23.206449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f876d-2512-4063-aaef-2a67a311cfab None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.206865 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f876d-2512-4063-aaef-2a67a311cfab None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.207285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f876d-2512-4063-aaef-2a67a311cfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.299907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9d2f876d-2512-4063-aaef-2a67a311cfab None None] MFA Rules not processed for user `c901e018aa1c429da33b5809873d0aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:23.301342 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9d2f876d-2512-4063-aaef-2a67a311cfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:23.401812 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 688/1372] 10.222.0.43 () {58 vars in 1061 bytes} [Wed Sep 7 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:23.410448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8269768-06fb-4eef-8c57-9d4094c00d3c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:23.411998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c8269768-06fb-4eef-8c57-9d4094c00d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:23.446802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:23.546804 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8269768-06fb-4eef-8c57-9d4094c00d3c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:23.655064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5877f54-f0c4-41fd-9ece-69da261b59c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:23.655738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5877f54-f0c4-41fd-9ece-69da261b59c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.656018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5877f54-f0c4-41fd-9ece-69da261b59c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.656298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5877f54-f0c4-41fd-9ece-69da261b59c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.658081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e5877f54-f0c4-41fd-9ece-69da261b59c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:23.768520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:23.833589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5877f54-f0c4-41fd-9ece-69da261b59c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:23.836244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5877f54-f0c4-41fd-9ece-69da261b59c4 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:23.875115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 685/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:25.024567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc8b79-3f61-44af-bf93-59a7ecc80b3c None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:25.025387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc8b79-3f61-44af-bf93-59a7ecc80b3c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:25.025387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc8b79-3f61-44af-bf93-59a7ecc80b3c None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:25.026715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 689/1374] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:25.033877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6559a-b71d-47b6-87a3-b7e56c30fc72 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:25.034291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6559a-b71d-47b6-87a3-b7e56c30fc72 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:25.034438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6559a-b71d-47b6-87a3-b7e56c30fc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:25.104352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-2fd6559a-b71d-47b6-87a3-b7e56c30fc72 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:25.105601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2fd6559a-b71d-47b6-87a3-b7e56c30fc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:25.209958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 686/1375] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:25.516949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc8b79-3f61-44af-bf93-59a7ecc80b3c None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:25.518695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-72dc8b79-3f61-44af-bf93-59a7ecc80b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:25.616421 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:25.688886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc8b79-3f61-44af-bf93-59a7ecc80b3c None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:25.823145 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02482e-c0d7-4525-9a8a-14e7d0c28414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:25.823763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02482e-c0d7-4525-9a8a-14e7d0c28414 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:25.824041 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02482e-c0d7-4525-9a8a-14e7d0c28414 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:25.824311 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02482e-c0d7-4525-9a8a-14e7d0c28414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:25.826086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-de02482e-c0d7-4525-9a8a-14e7d0c28414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:25.883419 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:25.937552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02482e-c0d7-4525-9a8a-14e7d0c28414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:25.939202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02482e-c0d7-4525-9a8a-14e7d0c28414 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:25.959703 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 690/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:28.336496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a603f-0359-4208-830a-123cb7fc70b9 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:28.337168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a603f-0359-4208-830a-123cb7fc70b9 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:28.337168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a603f-0359-4208-830a-123cb7fc70b9 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:28.338607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 687/1377] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:28.346143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0613ea-c59c-4972-b983-5e7e2e0e5134 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:28.346678 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0613ea-c59c-4972-b983-5e7e2e0e5134 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:28.346678 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0613ea-c59c-4972-b983-5e7e2e0e5134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:28.433602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-1e0613ea-c59c-4972-b983-5e7e2e0e5134 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:28.434818 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1e0613ea-c59c-4972-b983-5e7e2e0e5134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:28.570442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 691/1378] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:28.885963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a603f-0359-4208-830a-123cb7fc70b9 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:28.887806 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-242a603f-0359-4208-830a-123cb7fc70b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:28.934365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:29.084655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a603f-0359-4208-830a-123cb7fc70b9 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:29.219997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:29.228094 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bf698-ab0d-44d6-9521-eae2d6df54fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:29.228728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bf698-ab0d-44d6-9521-eae2d6df54fd service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:29.229395 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bf698-ab0d-44d6-9521-eae2d6df54fd service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:29.230058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bf698-ab0d-44d6-9521-eae2d6df54fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:29.231729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2e4bf698-ab0d-44d6-9521-eae2d6df54fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:29.345801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bf698-ab0d-44d6-9521-eae2d6df54fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:29.347423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bf698-ab0d-44d6-9521-eae2d6df54fd service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:29.367861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 688/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:31.675761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129b50b-c63c-466d-bde9-96ebaf1aa1e6 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:31.676343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129b50b-c63c-466d-bde9-96ebaf1aa1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:31.676443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129b50b-c63c-466d-bde9-96ebaf1aa1e6 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:31.678063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 692/1380] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:31.685116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a7f9b-55a7-4a62-bc62-464615477d18 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:31.685633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a7f9b-55a7-4a62-bc62-464615477d18 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:31.685728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a7f9b-55a7-4a62-bc62-464615477d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:31.764569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-1c1a7f9b-55a7-4a62-bc62-464615477d18 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:31.765834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1c1a7f9b-55a7-4a62-bc62-464615477d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:31.837593 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:31.877113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 689/1381] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:03:32.180975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129b50b-c63c-466d-bde9-96ebaf1aa1e6 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:32.182856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6129b50b-c63c-466d-bde9-96ebaf1aa1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:32.220428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:32.362924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129b50b-c63c-466d-bde9-96ebaf1aa1e6 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:32.480667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:32.499213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b55870-2340-4c1c-a054-dab371f2044b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:32.499861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55870-2340-4c1c-a054-dab371f2044b service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:32.500202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55870-2340-4c1c-a054-dab371f2044b service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:32.500418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55870-2340-4c1c-a054-dab371f2044b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:32.502193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c9b55870-2340-4c1c-a054-dab371f2044b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:32.614573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b55870-2340-4c1c-a054-dab371f2044b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:32.616130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b55870-2340-4c1c-a054-dab371f2044b service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:32.637112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 693/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:34.946794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f39ce-1c5f-4ee9-92f2-18c1219dd4ea None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:34.947398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f39ce-1c5f-4ee9-92f2-18c1219dd4ea None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:34.947957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f39ce-1c5f-4ee9-92f2-18c1219dd4ea None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:34.949790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 690/1383] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:03:34.957299 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166275-c700-4360-a51f-380a6d45de0b None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:34.958052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166275-c700-4360-a51f-380a6d45de0b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:34.958052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166275-c700-4360-a51f-380a6d45de0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:35.052387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-86166275-c700-4360-a51f-380a6d45de0b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:35.054566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-86166275-c700-4360-a51f-380a6d45de0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:35.137330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:35.190731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 694/1384] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:35.490595 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f39ce-1c5f-4ee9-92f2-18c1219dd4ea None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:35.492594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e72f39ce-1c5f-4ee9-92f2-18c1219dd4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:35.689913 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f39ce-1c5f-4ee9-92f2-18c1219dd4ea None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:35.756153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:35.829382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046280a-d40e-4731-ba94-dff03a5e73df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:35.830095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046280a-d40e-4731-ba94-dff03a5e73df service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:35.830490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046280a-d40e-4731-ba94-dff03a5e73df service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:35.830840 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046280a-d40e-4731-ba94-dff03a5e73df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:35.832878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b046280a-d40e-4731-ba94-dff03a5e73df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:35.944938 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046280a-d40e-4731-ba94-dff03a5e73df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:35.946667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046280a-d40e-4731-ba94-dff03a5e73df service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:35.965591 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 691/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:38.312236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43dc8e-ebde-4e0a-b65a-574328a35533 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:38.314179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43dc8e-ebde-4e0a-b65a-574328a35533 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:38.314179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43dc8e-ebde-4e0a-b65a-574328a35533 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:38.316809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 695/1386] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:38.322653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c0d15-bf87-4cc6-8fa1-992717e17de2 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:38.323174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c0d15-bf87-4cc6-8fa1-992717e17de2 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:38.323258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c0d15-bf87-4cc6-8fa1-992717e17de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:38.403888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-737c0d15-bf87-4cc6-8fa1-992717e17de2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:38.405151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-737c0d15-bf87-4cc6-8fa1-992717e17de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:38.414373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:38.511576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 692/1387] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:38.816570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43dc8e-ebde-4e0a-b65a-574328a35533 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:38.818161 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-5e43dc8e-ebde-4e0a-b65a-574328a35533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:38.992313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43dc8e-ebde-4e0a-b65a-574328a35533 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:39.045794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:39.121079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5c341-fd32-4c7a-982b-7bf978cdad9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:39.121752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5c341-fd32-4c7a-982b-7bf978cdad9a service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:39.122103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5c341-fd32-4c7a-982b-7bf978cdad9a service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:39.122445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5c341-fd32-4c7a-982b-7bf978cdad9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:39.124171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f0b5c341-fd32-4c7a-982b-7bf978cdad9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:39.223715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5c341-fd32-4c7a-982b-7bf978cdad9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:39.225393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5c341-fd32-4c7a-982b-7bf978cdad9a service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:39.247828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 696/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:39.501896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca040dff-61c9-4a07-9ec8-89a03875821c None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:39.502466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca040dff-61c9-4a07-9ec8-89a03875821c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:39.502466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca040dff-61c9-4a07-9ec8-89a03875821c None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:39.503849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 693/1389] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:39.510084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22ac21-49f8-4695-ac00-37b8cd5a5bec None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:39.510608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22ac21-49f8-4695-ac00-37b8cd5a5bec None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:39.510702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22ac21-49f8-4695-ac00-37b8cd5a5bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:39.579341 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:39.582895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-ec22ac21-49f8-4695-ac00-37b8cd5a5bec None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:39.585074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ec22ac21-49f8-4695-ac00-37b8cd5a5bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:39.692372 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 697/1390] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:40.003028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c0145-76d1-4df5-a7f7-b8ae69977e87 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:40.003303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c0145-76d1-4df5-a7f7-b8ae69977e87 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:40.003629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c0145-76d1-4df5-a7f7-b8ae69977e87 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:40.005039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 694/1391] 10.222.0.43 () {54 vars in 961 bytes} [Wed Sep 7 16:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:40.011246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36440b-6937-41df-aa0d-98c2ad97b520 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:40.011636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36440b-6937-41df-aa0d-98c2ad97b520 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:40.011984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36440b-6937-41df-aa0d-98c2ad97b520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:40.105600 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-dd36440b-6937-41df-aa0d-98c2ad97b520 None None] MFA Rules not processed for user `bc71e3a41ac644ff8a908b766495b5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:40.106869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-dd36440b-6937-41df-aa0d-98c2ad97b520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:40.187398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:40.194548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 698/1392] 10.222.0.43 () {58 vars in 1058 bytes} [Wed Sep 7 16:03:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:40.204113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c0145-76d1-4df5-a7f7-b8ae69977e87 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:40.205891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1e0c0145-76d1-4df5-a7f7-b8ae69977e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:40.320780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c0145-76d1-4df5-a7f7-b8ae69977e87 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:40.367919 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:40.407080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980f19a-f0d3-41d8-acad-411562b31a7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc71e3a41ac644ff8a908b766495b5f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:40.407687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980f19a-f0d3-41d8-acad-411562b31a7f service glance] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:40.407961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980f19a-f0d3-41d8-acad-411562b31a7f service glance] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:40.408236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980f19a-f0d3-41d8-acad-411562b31a7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:40.409922 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e980f19a-f0d3-41d8-acad-411562b31a7f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:40.538104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980f19a-f0d3-41d8-acad-411562b31a7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:40.539566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980f19a-f0d3-41d8-acad-411562b31a7f service glance] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:40.559082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 695/1393] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:41.352807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559e527-cc10-4bfe-b670-7b9aaef7756e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:41.353364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559e527-cc10-4bfe-b670-7b9aaef7756e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:41.353473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559e527-cc10-4bfe-b670-7b9aaef7756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:41.431676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f559e527-cc10-4bfe-b670-7b9aaef7756e None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:41.432962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f559e527-cc10-4bfe-b670-7b9aaef7756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:41.536829 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 699/1394] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:41.541230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f41e-b386-4588-9a75-93c9063dc834 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:41.541230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f41e-b386-4588-9a75-93c9063dc834 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:41.541848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f41e-b386-4588-9a75-93c9063dc834 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:41.542734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 696/1395] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:41.550519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d812e3-57a4-4595-ba6b-887dd9939bf3 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:41.551220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d812e3-57a4-4595-ba6b-887dd9939bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:41.551220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d812e3-57a4-4595-ba6b-887dd9939bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:41.590339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928caa7b-170c-471a-bd84-b7fc9f712ce0 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:41.590551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928caa7b-170c-471a-bd84-b7fc9f712ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:41.590823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928caa7b-170c-471a-bd84-b7fc9f712ce0 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:41.592247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 697/1396] 10.222.0.43 () {54 vars in 943 bytes} [Wed Sep 7 16:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:41.598993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a09f8-737f-4e39-a5f1-b8453ecfc857 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:41.599287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a09f8-737f-4e39-a5f1-b8453ecfc857 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:41.599569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a09f8-737f-4e39-a5f1-b8453ecfc857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:41.628712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f6d812e3-57a4-4595-ba6b-887dd9939bf3 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:41.629940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f6d812e3-57a4-4595-ba6b-887dd9939bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:41.672285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:41.685935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-6c9a09f8-737f-4e39-a5f1-b8453ecfc857 None None] MFA Rules not processed for user `d853bab10d9d4060809476bfc44d3822`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:41.688915 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6c9a09f8-737f-4e39-a5f1-b8453ecfc857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:41.702057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:41.745968 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 700/1397] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:41.813915 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 698/1398] 10.222.0.43 () {58 vars in 1040 bytes} [Wed Sep 7 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:03:41.823211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d812e3-57a4-4595-ba6b-887dd9939bf3 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:41.824530 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f6d812e3-57a4-4595-ba6b-887dd9939bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:41.938513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d812e3-57a4-4595-ba6b-887dd9939bf3 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:42.005496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:42.048803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a09f8-737f-4e39-a5f1-b8453ecfc857 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:42.050213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6c9a09f8-737f-4e39-a5f1-b8453ecfc857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:42.057068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be3c5f-9499-4bfa-af9a-e87d8e743f48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:42.057693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be3c5f-9499-4bfa-af9a-e87d8e743f48 service swift] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:42.057977 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be3c5f-9499-4bfa-af9a-e87d8e743f48 service swift] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:42.058252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be3c5f-9499-4bfa-af9a-e87d8e743f48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:42.059948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-80be3c5f-9499-4bfa-af9a-e87d8e743f48 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:42.177778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a09f8-737f-4e39-a5f1-b8453ecfc857 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:42.216646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:42.277652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be3c5f-9499-4bfa-af9a-e87d8e743f48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:42.279287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be3c5f-9499-4bfa-af9a-e87d8e743f48 service swift] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:42.290159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 701/1399] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:03:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 16:03:42.307570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74471c61-51b5-45eb-9c32-7f903c8def87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:42.308187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74471c61-51b5-45eb-9c32-7f903c8def87 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:42.308460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74471c61-51b5-45eb-9c32-7f903c8def87 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:42.308759 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74471c61-51b5-45eb-9c32-7f903c8def87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:42.310403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-74471c61-51b5-45eb-9c32-7f903c8def87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:42.411738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74471c61-51b5-45eb-9c32-7f903c8def87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:42.414422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74471c61-51b5-45eb-9c32-7f903c8def87 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:42.436213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 699/1400] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:03:44.766844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb6d6c-8630-4ea8-9aa9-75a5d66dda8f None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:44.767666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb6d6c-8630-4ea8-9aa9-75a5d66dda8f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:44.767666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb6d6c-8630-4ea8-9aa9-75a5d66dda8f None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:44.773399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 702/1401] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:44.774610 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd996b-2f1d-4711-8a92-89a20ffed65f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:44.775300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd996b-2f1d-4711-8a92-89a20ffed65f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:44.775300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd996b-2f1d-4711-8a92-89a20ffed65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:44.827131 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:44.857327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-32fd996b-2f1d-4711-8a92-89a20ffed65f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:44.858567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-32fd996b-2f1d-4711-8a92-89a20ffed65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:44.992326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 700/1402] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:03:45.318394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb6d6c-8630-4ea8-9aa9-75a5d66dda8f None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:45.319957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-caeb6d6c-8630-4ea8-9aa9-75a5d66dda8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:45.436632 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:45.515114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb6d6c-8630-4ea8-9aa9-75a5d66dda8f None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:45.719279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaff1d-d933-4bb3-a55f-094c26de924e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:45.720015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaff1d-d933-4bb3-a55f-094c26de924e service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:45.720190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaff1d-d933-4bb3-a55f-094c26de924e service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:45.720528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaff1d-d933-4bb3-a55f-094c26de924e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:45.722302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-22aaff1d-d933-4bb3-a55f-094c26de924e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:45.797944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:45.831144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaff1d-d933-4bb3-a55f-094c26de924e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:45.832848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaff1d-d933-4bb3-a55f-094c26de924e service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:45.860395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 703/1403] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:48.158573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99463f6c-60d1-4d07-ad06-e027c4720af5 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:48.159160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99463f6c-60d1-4d07-ad06-e027c4720af5 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:48.159160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99463f6c-60d1-4d07-ad06-e027c4720af5 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:48.160575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 701/1404] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:48.167956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843b19a-ac27-4fbe-b0fd-2684834027fa None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:48.167956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843b19a-ac27-4fbe-b0fd-2684834027fa None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:48.167956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843b19a-ac27-4fbe-b0fd-2684834027fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:48.257862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-2843b19a-ac27-4fbe-b0fd-2684834027fa None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:48.259120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2843b19a-ac27-4fbe-b0fd-2684834027fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:48.386576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 704/1405] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:48.691290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99463f6c-60d1-4d07-ad06-e027c4720af5 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:48.692870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-99463f6c-60d1-4d07-ad06-e027c4720af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:48.827016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:48.873199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99463f6c-60d1-4d07-ad06-e027c4720af5 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:49.042775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3e1db-ac29-45e8-8288-d4d4002ccaa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:49.043387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3e1db-ac29-45e8-8288-d4d4002ccaa8 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:49.043666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3e1db-ac29-45e8-8288-d4d4002ccaa8 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:49.044075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3e1db-ac29-45e8-8288-d4d4002ccaa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:49.046328 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-94e3e1db-ac29-45e8-8288-d4d4002ccaa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:49.161309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:49.178212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3e1db-ac29-45e8-8288-d4d4002ccaa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:49.179816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3e1db-ac29-45e8-8288-d4d4002ccaa8 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:49.205904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 702/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:51.587019 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd160c72-26eb-4b59-8b72-74e873ed59ce None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:51.587546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd160c72-26eb-4b59-8b72-74e873ed59ce None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:51.587546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd160c72-26eb-4b59-8b72-74e873ed59ce None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:51.588839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 705/1407] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:03:51.595089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b183c9-5871-4b64-bd51-1571a0427b31 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:51.595791 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b183c9-5871-4b64-bd51-1571a0427b31 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:51.595791 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b183c9-5871-4b64-bd51-1571a0427b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:51.683978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-e4b183c9-5871-4b64-bd51-1571a0427b31 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:51.685274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e4b183c9-5871-4b64-bd51-1571a0427b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:51.809790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 703/1408] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:52.122238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd160c72-26eb-4b59-8b72-74e873ed59ce None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:52.123783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-bd160c72-26eb-4b59-8b72-74e873ed59ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:52.171841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:52.334978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd160c72-26eb-4b59-8b72-74e873ed59ce None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:52.471411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:52.479237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63a62f-d202-40df-a044-dff50fbcb791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:52.480124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63a62f-d202-40df-a044-dff50fbcb791 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:52.480598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63a62f-d202-40df-a044-dff50fbcb791 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:52.481143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63a62f-d202-40df-a044-dff50fbcb791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:52.483028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7e63a62f-d202-40df-a044-dff50fbcb791 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:52.591415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63a62f-d202-40df-a044-dff50fbcb791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:52.593232 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63a62f-d202-40df-a044-dff50fbcb791 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:52.620927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 706/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:01.807520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=76 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:02.615515 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=46 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:05.785250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a3227-4553-4d78-9540-e95fec61cae1 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:05.786021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a3227-4553-4d78-9540-e95fec61cae1 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:05.786021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a3227-4553-4d78-9540-e95fec61cae1 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:05.787117 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 704/1410] 10.222.0.43 () {54 vars in 918 bytes} [Wed Sep 7 16:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:05.793189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f29b0-3762-4702-bdd0-274f56e5e6dd None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:05.793903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f29b0-3762-4702-bdd0-274f56e5e6dd None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:05.793903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f29b0-3762-4702-bdd0-274f56e5e6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:05.878078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-0e1f29b0-3762-4702-bdd0-274f56e5e6dd None None] MFA Rules not processed for user `b918da0f83754f3887de1cfa2e4df028`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:05.879229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0e1f29b0-3762-4702-bdd0-274f56e5e6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:05.990136 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 707/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Sep 7 16:04:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:04:06.004803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f1fc3-d1e2-4954-b30b-0cd749e72cf3 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:06.005112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f1fc3-d1e2-4954-b30b-0cd749e72cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:06.005417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f1fc3-d1e2-4954-b30b-0cd749e72cf3 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:06.006766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 705/1412] 10.222.0.43 () {54 vars in 918 bytes} [Wed Sep 7 16:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:06.011683 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d421e8-15fb-4b56-a52b-123ed59033d7 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:06.011970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d421e8-15fb-4b56-a52b-123ed59033d7 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:06.012243 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d421e8-15fb-4b56-a52b-123ed59033d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:06.100183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:06.102963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-88d421e8-15fb-4b56-a52b-123ed59033d7 None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:06.104813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-88d421e8-15fb-4b56-a52b-123ed59033d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:06.227803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 708/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Sep 7 16:04:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:08.887954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fc79d-6cdd-415c-96ae-04576eadd8a8 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:08.888503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fc79d-6cdd-415c-96ae-04576eadd8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:08.888503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fc79d-6cdd-415c-96ae-04576eadd8a8 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:08.889844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:08.896200 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4d161-a3a9-49c3-ad54-0dbe2fe0a534 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:08.896757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4d161-a3a9-49c3-ad54-0dbe2fe0a534 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:08.896757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4d161-a3a9-49c3-ad54-0dbe2fe0a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:08.966349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-a8e4d161-a3a9-49c3-ad54-0dbe2fe0a534 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:08.967544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-a8e4d161-a3a9-49c3-ad54-0dbe2fe0a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:09.025143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:09.071398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:09.382894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fc79d-6cdd-415c-96ae-04576eadd8a8 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:09.384567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-220fc79d-6cdd-415c-96ae-04576eadd8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:09.544879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fc79d-6cdd-415c-96ae-04576eadd8a8 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:09.622001 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:09.665502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026614fd-52b4-4038-9b20-9f4440ffc236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:09.666115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026614fd-52b4-4038-9b20-9f4440ffc236 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:09.666398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026614fd-52b4-4038-9b20-9f4440ffc236 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:09.666671 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026614fd-52b4-4038-9b20-9f4440ffc236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:09.668357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-026614fd-52b4-4038-9b20-9f4440ffc236 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:09.759950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026614fd-52b4-4038-9b20-9f4440ffc236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:09.761485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026614fd-52b4-4038-9b20-9f4440ffc236 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:09.788633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 707/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:10.956417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ad546-eec4-4733-97da-fe3dc676f920 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:10.957001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ad546-eec4-4733-97da-fe3dc676f920 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:10.957001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ad546-eec4-4733-97da-fe3dc676f920 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:10.958397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:10.965104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5338bd1-bb37-421b-9f57-27142efc1086 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:10.965602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5338bd1-bb37-421b-9f57-27142efc1086 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:10.965703 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5338bd1-bb37-421b-9f57-27142efc1086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:11.047670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-a5338bd1-bb37-421b-9f57-27142efc1086 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:11.049040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a5338bd1-bb37-421b-9f57-27142efc1086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:11.078443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:11.156045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:11.309111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ad546-eec4-4733-97da-fe3dc676f920 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:11.310592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c86ad546-eec4-4733-97da-fe3dc676f920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:11.468295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ad546-eec4-4733-97da-fe3dc676f920 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:11.510111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:11.594094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ec9a0-98b1-4393-8750-141d2d5a9d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:11.594675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ec9a0-98b1-4393-8750-141d2d5a9d21 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:11.595544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ec9a0-98b1-4393-8750-141d2d5a9d21 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:11.596549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ec9a0-98b1-4393-8750-141d2d5a9d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:11.598284 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-612ec9a0-98b1-4393-8750-141d2d5a9d21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:11.701658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ec9a0-98b1-4393-8750-141d2d5a9d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:11.703276 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ec9a0-98b1-4393-8750-141d2d5a9d21 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:11.722261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 711/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:12.876285 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba714ce-46e6-4dd3-96fb-c2514a9b8b57 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:12.876932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba714ce-46e6-4dd3-96fb-c2514a9b8b57 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:12.876932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba714ce-46e6-4dd3-96fb-c2514a9b8b57 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:12.878277 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:12.884918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128c243-389e-48dd-a3e9-889b692f8d5c None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:12.885355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128c243-389e-48dd-a3e9-889b692f8d5c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:12.885473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128c243-389e-48dd-a3e9-889b692f8d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:12.942640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:12.968919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f128c243-389e-48dd-a3e9-889b692f8d5c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:12.970822 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f128c243-389e-48dd-a3e9-889b692f8d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:13.088070 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:13.242606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba714ce-46e6-4dd3-96fb-c2514a9b8b57 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:13.245089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4ba714ce-46e6-4dd3-96fb-c2514a9b8b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:13.400697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba714ce-46e6-4dd3-96fb-c2514a9b8b57 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:13.413348 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:13.519716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751a548-6c30-411c-a826-6874e2b0b4dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:13.520236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751a548-6c30-411c-a826-6874e2b0b4dd service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:13.520517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751a548-6c30-411c-a826-6874e2b0b4dd service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:13.520821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751a548-6c30-411c-a826-6874e2b0b4dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:13.522470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1751a548-6c30-411c-a826-6874e2b0b4dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:13.619773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751a548-6c30-411c-a826-6874e2b0b4dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:13.621426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751a548-6c30-411c-a826-6874e2b0b4dd service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:13.640094 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 710/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:14.803115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c76543-ad88-4550-b2b7-cb60306654bc None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:14.803677 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c76543-ad88-4550-b2b7-cb60306654bc None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:14.803677 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c76543-ad88-4550-b2b7-cb60306654bc None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:14.805045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:14.812456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd1702-1839-48c3-95f6-1e2ab5e6c283 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:14.813055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd1702-1839-48c3-95f6-1e2ab5e6c283 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:14.813055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd1702-1839-48c3-95f6-1e2ab5e6c283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:14.839355 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:14.910559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-9ffd1702-1839-48c3-95f6-1e2ab5e6c283 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:14.912506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9ffd1702-1839-48c3-95f6-1e2ab5e6c283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:15.023504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:15.177930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c76543-ad88-4550-b2b7-cb60306654bc None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:15.179470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-39c76543-ad88-4550-b2b7-cb60306654bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:15.315221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:15.358354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c76543-ad88-4550-b2b7-cb60306654bc None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:15.484722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968d379-ef17-4d14-a51a-8d61d45f15da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:15.485271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968d379-ef17-4d14-a51a-8d61d45f15da service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:15.485540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968d379-ef17-4d14-a51a-8d61d45f15da service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:15.485859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968d379-ef17-4d14-a51a-8d61d45f15da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:15.487519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-5968d379-ef17-4d14-a51a-8d61d45f15da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:15.571088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:15.586657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968d379-ef17-4d14-a51a-8d61d45f15da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:15.588284 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968d379-ef17-4d14-a51a-8d61d45f15da service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:15.607427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 714/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:16.760550 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f7ee8-7211-4480-a44e-3372a8f24098 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:16.761252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f7ee8-7211-4480-a44e-3372a8f24098 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:16.761252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f7ee8-7211-4480-a44e-3372a8f24098 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:16.762517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:16.770294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c638e74-2372-4d1d-a94d-f5edb4b91765 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:16.770871 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c638e74-2372-4d1d-a94d-f5edb4b91765 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:16.770871 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c638e74-2372-4d1d-a94d-f5edb4b91765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:16.852469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-7c638e74-2372-4d1d-a94d-f5edb4b91765 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:16.853738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7c638e74-2372-4d1d-a94d-f5edb4b91765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:16.953789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:17.106447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f7ee8-7211-4480-a44e-3372a8f24098 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:17.107965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1b5f7ee8-7211-4480-a44e-3372a8f24098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:17.195895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:17.272363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f7ee8-7211-4480-a44e-3372a8f24098 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:17.409010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5bf6a-2b37-421d-a243-7b8d7e688d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:17.409537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5bf6a-2b37-421d-a243-7b8d7e688d76 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:17.410748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5bf6a-2b37-421d-a243-7b8d7e688d76 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:17.410748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5bf6a-2b37-421d-a243-7b8d7e688d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:17.411812 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-79b5bf6a-2b37-421d-a243-7b8d7e688d76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:17.470335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:17.518737 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5bf6a-2b37-421d-a243-7b8d7e688d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:17.520609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5bf6a-2b37-421d-a243-7b8d7e688d76 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:17.544013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 713/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:18.651989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34155c17-e786-4663-9dc9-81e90e176d17 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:18.652601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34155c17-e786-4663-9dc9-81e90e176d17 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:18.652601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34155c17-e786-4663-9dc9-81e90e176d17 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:18.653914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:18.661456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d4cf6-4579-42e3-826a-df01b4038771 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:18.661996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d4cf6-4579-42e3-826a-df01b4038771 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:18.661996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d4cf6-4579-42e3-826a-df01b4038771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:18.744959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-1c8d4cf6-4579-42e3-826a-df01b4038771 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:18.746185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1c8d4cf6-4579-42e3-826a-df01b4038771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:18.847735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:19.002680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34155c17-e786-4663-9dc9-81e90e176d17 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:19.004210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-34155c17-e786-4663-9dc9-81e90e176d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:19.058548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:19.162448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34155c17-e786-4663-9dc9-81e90e176d17 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:19.282660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dcf64-17fc-4322-8b31-038db127fd33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:19.283473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dcf64-17fc-4322-8b31-038db127fd33 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:19.283933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dcf64-17fc-4322-8b31-038db127fd33 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:19.284346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dcf64-17fc-4322-8b31-038db127fd33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:19.286209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-803dcf64-17fc-4322-8b31-038db127fd33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:19.293753 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:19.382906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dcf64-17fc-4322-8b31-038db127fd33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:19.384518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dcf64-17fc-4322-8b31-038db127fd33 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:19.403527 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 717/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:20.481924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba69b6-9562-4884-a169-207c537f17e3 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:20.482515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba69b6-9562-4884-a169-207c537f17e3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:20.482515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba69b6-9562-4884-a169-207c537f17e3 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:20.483797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:20.491450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69d673-5a33-4203-87b8-b54457ee37d8 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:20.491995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69d673-5a33-4203-87b8-b54457ee37d8 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:20.491995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69d673-5a33-4203-87b8-b54457ee37d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:20.570919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-ab69d673-5a33-4203-87b8-b54457ee37d8 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:20.572145 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ab69d673-5a33-4203-87b8-b54457ee37d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:20.646093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:20.677531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:20.831092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba69b6-9562-4884-a169-207c537f17e3 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:20.832568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0eba69b6-9562-4884-a169-207c537f17e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:20.851144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:20.992340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba69b6-9562-4884-a169-207c537f17e3 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:21.089244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:21.116848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef20d7-3f9a-40e1-8c7a-ef51948014d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:21.117454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef20d7-3f9a-40e1-8c7a-ef51948014d1 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:21.117736 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef20d7-3f9a-40e1-8c7a-ef51948014d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:21.118013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef20d7-3f9a-40e1-8c7a-ef51948014d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:21.119636 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-87ef20d7-3f9a-40e1-8c7a-ef51948014d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:21.211577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef20d7-3f9a-40e1-8c7a-ef51948014d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:21.213223 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef20d7-3f9a-40e1-8c7a-ef51948014d1 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:21.232199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 716/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:22.348091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb601e1-2bee-48d9-b8ea-a7bb640bf8b4 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:22.348656 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb601e1-2bee-48d9-b8ea-a7bb640bf8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:22.348656 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb601e1-2bee-48d9-b8ea-a7bb640bf8b4 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:22.349945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:22.356848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a67fe-4fe3-441a-971c-fc2707ea48c5 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:22.357362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a67fe-4fe3-441a-971c-fc2707ea48c5 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:22.357486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a67fe-4fe3-441a-971c-fc2707ea48c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:22.438624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f19a67fe-4fe3-441a-971c-fc2707ea48c5 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:22.440130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f19a67fe-4fe3-441a-971c-fc2707ea48c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:22.484606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:22.543141 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:22.700331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb601e1-2bee-48d9-b8ea-a7bb640bf8b4 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:22.701923 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-fdb601e1-2bee-48d9-b8ea-a7bb640bf8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:22.866203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb601e1-2bee-48d9-b8ea-a7bb640bf8b4 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:22.922762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:22.984097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c51cf-3346-449b-9854-c5e387e8670b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:22.984624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c51cf-3346-449b-9854-c5e387e8670b service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:22.984933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c51cf-3346-449b-9854-c5e387e8670b service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:22.985203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c51cf-3346-449b-9854-c5e387e8670b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:22.987390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-676c51cf-3346-449b-9854-c5e387e8670b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:23.086487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c51cf-3346-449b-9854-c5e387e8670b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:23.088122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c51cf-3346-449b-9854-c5e387e8670b service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:23.107302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 720/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:04:24.213670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52d0bd-1d9c-4678-9f95-b05361d7fad3 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:24.214240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52d0bd-1d9c-4678-9f95-b05361d7fad3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:24.214240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52d0bd-1d9c-4678-9f95-b05361d7fad3 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:24.215506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:24.222366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952177-2caa-47af-9f7c-feb512b7bd10 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:24.222853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952177-2caa-47af-9f7c-feb512b7bd10 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:24.222969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa952177-2caa-47af-9f7c-feb512b7bd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:24.308555 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-fa952177-2caa-47af-9f7c-feb512b7bd10 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:24.309816 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-fa952177-2caa-47af-9f7c-feb512b7bd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:24.311891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:24.410826 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:24.566401 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52d0bd-1d9c-4678-9f95-b05361d7fad3 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:24.567525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-de52d0bd-1d9c-4678-9f95-b05361d7fad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:24.750377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52d0bd-1d9c-4678-9f95-b05361d7fad3 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:24.778068 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:24.866364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbff3a-5c97-4db3-a704-abba4bc51723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:24.867020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbff3a-5c97-4db3-a704-abba4bc51723 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:24.867416 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbff3a-5c97-4db3-a704-abba4bc51723 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:24.867799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbff3a-5c97-4db3-a704-abba4bc51723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:24.869588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-74fbff3a-5c97-4db3-a704-abba4bc51723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:24.972533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbff3a-5c97-4db3-a704-abba4bc51723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:24.974234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbff3a-5c97-4db3-a704-abba4bc51723 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:24.994281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 719/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:27.096091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6b9f4-d526-4396-975e-f2ba0aa32a04 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:27.096675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6b9f4-d526-4396-975e-f2ba0aa32a04 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:27.096675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6b9f4-d526-4396-975e-f2ba0aa32a04 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:27.098020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:27.103679 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17fca3-3fb1-4bf0-b13d-4c1f5dec8b07 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:27.104131 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17fca3-3fb1-4bf0-b13d-4c1f5dec8b07 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:27.104243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17fca3-3fb1-4bf0-b13d-4c1f5dec8b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:27.152385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:27.183276 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-3d17fca3-3fb1-4bf0-b13d-4c1f5dec8b07 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:27.184557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3d17fca3-3fb1-4bf0-b13d-4c1f5dec8b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:27.284587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:27.579942 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6b9f4-d526-4396-975e-f2ba0aa32a04 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:27.582033 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0cc6b9f4-d526-4396-975e-f2ba0aa32a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:27.687305 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6b9f4-d526-4396-975e-f2ba0aa32a04 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:27.729155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:27.773236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec5fca-de50-41a3-b510-41dd8b8e3c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:27.773849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec5fca-de50-41a3-b510-41dd8b8e3c38 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:27.774130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec5fca-de50-41a3-b510-41dd8b8e3c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:27.774403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec5fca-de50-41a3-b510-41dd8b8e3c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:27.776020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-51ec5fca-de50-41a3-b510-41dd8b8e3c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:27.887567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec5fca-de50-41a3-b510-41dd8b8e3c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:27.888952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec5fca-de50-41a3-b510-41dd8b8e3c38 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:27.908082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 723/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:30.347973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8292237-a04c-4f72-87b7-541cb59b9b78 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:30.348516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8292237-a04c-4f72-87b7-541cb59b9b78 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:30.348516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8292237-a04c-4f72-87b7-541cb59b9b78 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:30.349803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:04:30.355291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6321c32-7070-4bff-ab25-60aae230f5be None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:30.355780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6321c32-7070-4bff-ab25-60aae230f5be None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:30.355885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6321c32-7070-4bff-ab25-60aae230f5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:30.430371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b6321c32-7070-4bff-ab25-60aae230f5be None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:30.431610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b6321c32-7070-4bff-ab25-60aae230f5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:30.445846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:30.539616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:30.832310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8292237-a04c-4f72-87b7-541cb59b9b78 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:30.833902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c8292237-a04c-4f72-87b7-541cb59b9b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:30.947249 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8292237-a04c-4f72-87b7-541cb59b9b78 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:30.960754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:31.025907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e9ac6-5b8f-42c4-b0d4-ed4410c1c9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:31.026519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e9ac6-5b8f-42c4-b0d4-ed4410c1c9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:31.026796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e9ac6-5b8f-42c4-b0d4-ed4410c1c9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:31.027072 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e9ac6-5b8f-42c4-b0d4-ed4410c1c9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:31.028795 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5f6e9ac6-5b8f-42c4-b0d4-ed4410c1c9c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:31.149472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e9ac6-5b8f-42c4-b0d4-ed4410c1c9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:31.150823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e9ac6-5b8f-42c4-b0d4-ed4410c1c9c2 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:31.169944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 722/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:33.702967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8412204-1d3a-4615-8031-c80b9bb798a2 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:33.703546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8412204-1d3a-4615-8031-c80b9bb798a2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:33.703546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8412204-1d3a-4615-8031-c80b9bb798a2 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:33.704884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:33.711351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010abc3-1faa-48d3-ab65-09c3a4828b2b None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:33.711848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010abc3-1faa-48d3-ab65-09c3a4828b2b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:33.711947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010abc3-1faa-48d3-ab65-09c3a4828b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:33.763577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:33.784662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b010abc3-1faa-48d3-ab65-09c3a4828b2b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:33.785938 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b010abc3-1faa-48d3-ab65-09c3a4828b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:33.888842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:34.180632 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8412204-1d3a-4615-8031-c80b9bb798a2 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:34.182206 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f8412204-1d3a-4615-8031-c80b9bb798a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:34.297213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8412204-1d3a-4615-8031-c80b9bb798a2 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:34.342646 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:34.379472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499aab4-5a50-4aa2-b7e6-a2cbe281d49c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:34.380081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499aab4-5a50-4aa2-b7e6-a2cbe281d49c service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:34.380355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499aab4-5a50-4aa2-b7e6-a2cbe281d49c service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:34.380621 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499aab4-5a50-4aa2-b7e6-a2cbe281d49c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:34.382263 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c499aab4-5a50-4aa2-b7e6-a2cbe281d49c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:34.498874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499aab4-5a50-4aa2-b7e6-a2cbe281d49c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:34.500314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499aab4-5a50-4aa2-b7e6-a2cbe281d49c service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:34.519205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 726/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:36.863704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23344b-5760-4ec8-85bb-88a1524220ca None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:36.864286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23344b-5760-4ec8-85bb-88a1524220ca None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:36.864286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23344b-5760-4ec8-85bb-88a1524220ca None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:36.865592 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:36.871232 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0eb384-fa84-44e7-8715-06d7b2836f89 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:36.871701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0eb384-fa84-44e7-8715-06d7b2836f89 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:36.871809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0eb384-fa84-44e7-8715-06d7b2836f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:36.941797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-dc0eb384-fa84-44e7-8715-06d7b2836f89 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:36.943010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-dc0eb384-fa84-44e7-8715-06d7b2836f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:36.965442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:37.065374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:37.355642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23344b-5760-4ec8-85bb-88a1524220ca None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:37.357257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3c23344b-5760-4ec8-85bb-88a1524220ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:37.478052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23344b-5760-4ec8-85bb-88a1524220ca None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:37.499232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:37.554800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c0a8f-683d-4dd5-bf38-59d060935314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:37.555414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c0a8f-683d-4dd5-bf38-59d060935314 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:37.555695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c0a8f-683d-4dd5-bf38-59d060935314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:37.555970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c0a8f-683d-4dd5-bf38-59d060935314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:37.557720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7e8c0a8f-683d-4dd5-bf38-59d060935314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:37.670843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c0a8f-683d-4dd5-bf38-59d060935314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:37.672294 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c0a8f-683d-4dd5-bf38-59d060935314 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:37.693146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 725/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:39.992001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ab976-f8ca-4de9-b823-4f36716a4740 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:39.992730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ab976-f8ca-4de9-b823-4f36716a4740 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:39.992730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ab976-f8ca-4de9-b823-4f36716a4740 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:39.993955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:39.999605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ee13-78c0-4cdb-92ec-b34757e59fcc None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:40.000104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ee13-78c0-4cdb-92ec-b34757e59fcc None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:40.000201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ee13-78c0-4cdb-92ec-b34757e59fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:40.072718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:40.074499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b5d4ee13-78c0-4cdb-92ec-b34757e59fcc None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:40.076140 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b5d4ee13-78c0-4cdb-92ec-b34757e59fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:40.185127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:40.484179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ab976-f8ca-4de9-b823-4f36716a4740 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:40.485756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0e0ab976-f8ca-4de9-b823-4f36716a4740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:40.596394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ab976-f8ca-4de9-b823-4f36716a4740 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:40.647060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:40.671525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ef950-5903-43e0-84e7-f2aca0491556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:40.672123 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ef950-5903-43e0-84e7-f2aca0491556 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:40.672397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ef950-5903-43e0-84e7-f2aca0491556 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:40.672663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ef950-5903-43e0-84e7-f2aca0491556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:40.674849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-362ef950-5903-43e0-84e7-f2aca0491556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:40.788890 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ef950-5903-43e0-84e7-f2aca0491556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:40.790163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ef950-5903-43e0-84e7-f2aca0491556 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:40.809309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 729/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:43.172918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879c2c-4f7e-415d-9776-300733926044 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:43.173452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879c2c-4f7e-415d-9776-300733926044 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:43.173452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879c2c-4f7e-415d-9776-300733926044 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:43.174839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:43.180790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f56945-d0aa-4123-af01-ee7c2517df42 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:43.181353 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f56945-d0aa-4123-af01-ee7c2517df42 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:43.181353 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f56945-d0aa-4123-af01-ee7c2517df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:43.253710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-60f56945-d0aa-4123-af01-ee7c2517df42 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:43.255069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-60f56945-d0aa-4123-af01-ee7c2517df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:43.291465 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:43.360610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:43.648837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d879c2c-4f7e-415d-9776-300733926044 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:43.650449 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5d879c2c-4f7e-415d-9776-300733926044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:43.761938 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d879c2c-4f7e-415d-9776-300733926044 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:43.795215 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:43.844627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e874586-69a5-4043-9376-2ec9eff24085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:43.845258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e874586-69a5-4043-9376-2ec9eff24085 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:43.845537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e874586-69a5-4043-9376-2ec9eff24085 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:43.845810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e874586-69a5-4043-9376-2ec9eff24085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:43.847957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3e874586-69a5-4043-9376-2ec9eff24085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:43.962729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e874586-69a5-4043-9376-2ec9eff24085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:43.964235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e874586-69a5-4043-9376-2ec9eff24085 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:43.983445 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 728/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:46.236889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77afd4-8cdf-4260-a3e3-65850dff760f None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:46.237618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77afd4-8cdf-4260-a3e3-65850dff760f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:46.237922 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77afd4-8cdf-4260-a3e3-65850dff760f None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:46.239348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:46.245296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df00be-0a71-4c59-899a-96b655c23eda None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:46.245750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df00be-0a71-4c59-899a-96b655c23eda None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:46.245869 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df00be-0a71-4c59-899a-96b655c23eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:46.321173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-a7df00be-0a71-4c59-899a-96b655c23eda None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:46.322323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a7df00be-0a71-4c59-899a-96b655c23eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:46.331398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:46.425743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:46.719648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77afd4-8cdf-4260-a3e3-65850dff760f None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:46.721860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3a77afd4-8cdf-4260-a3e3-65850dff760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:46.828781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77afd4-8cdf-4260-a3e3-65850dff760f None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:46.893144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:46.914165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f5752-8c84-41e9-8563-9db852ba073b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:46.914784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f5752-8c84-41e9-8563-9db852ba073b service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:46.915065 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f5752-8c84-41e9-8563-9db852ba073b service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:46.915337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f5752-8c84-41e9-8563-9db852ba073b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:46.917383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0b0f5752-8c84-41e9-8563-9db852ba073b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:47.037757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f5752-8c84-41e9-8563-9db852ba073b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:47.039241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f5752-8c84-41e9-8563-9db852ba073b service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:47.057991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 732/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:49.321474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1afb-7cda-4bc8-8e4c-71b5101c569e None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:49.322368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1afb-7cda-4bc8-8e4c-71b5101c569e None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:49.322368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1afb-7cda-4bc8-8e4c-71b5101c569e None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:49.323914 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:49.329651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4776bd8-a1d7-4e57-823e-98b995f6d3ca None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:49.330158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4776bd8-a1d7-4e57-823e-98b995f6d3ca None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:49.330266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4776bd8-a1d7-4e57-823e-98b995f6d3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:49.406176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f4776bd8-a1d7-4e57-823e-98b995f6d3ca None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:49.407418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f4776bd8-a1d7-4e57-823e-98b995f6d3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:49.450920 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:49.514688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:49.806164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb1afb-7cda-4bc8-8e4c-71b5101c569e None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:49.807718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ebfb1afb-7cda-4bc8-8e4c-71b5101c569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:49.915858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb1afb-7cda-4bc8-8e4c-71b5101c569e None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:49.954284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:49.993513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c57115-0cc4-4f4e-9025-41644c8055cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:49.994130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c57115-0cc4-4f4e-9025-41644c8055cd service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:49.994409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c57115-0cc4-4f4e-9025-41644c8055cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:49.994682 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c57115-0cc4-4f4e-9025-41644c8055cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:49.996331 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c8c57115-0cc4-4f4e-9025-41644c8055cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:50.112286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c57115-0cc4-4f4e-9025-41644c8055cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:50.114041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c57115-0cc4-4f4e-9025-41644c8055cd service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:50.133694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 731/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:52.418911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db136c0b-885f-409f-ae59-88abf64fa784 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:52.419465 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db136c0b-885f-409f-ae59-88abf64fa784 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:52.419465 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db136c0b-885f-409f-ae59-88abf64fa784 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:52.420830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:52.427008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf780f-5e44-406a-8d23-8e46ee0c6579 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:52.427501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf780f-5e44-406a-8d23-8e46ee0c6579 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:52.427602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf780f-5e44-406a-8d23-8e46ee0c6579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:52.497060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-fdbf780f-5e44-406a-8d23-8e46ee0c6579 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:52.498304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-fdbf780f-5e44-406a-8d23-8e46ee0c6579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:52.518049 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:52.604386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:52.892217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db136c0b-885f-409f-ae59-88abf64fa784 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:52.894762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-db136c0b-885f-409f-ae59-88abf64fa784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:53.009596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db136c0b-885f-409f-ae59-88abf64fa784 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:53.078771 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:53.086621 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999f9dd-bd1d-4055-8304-c05e598e087d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:53.087175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f9dd-bd1d-4055-8304-c05e598e087d service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:53.087461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f9dd-bd1d-4055-8304-c05e598e087d service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:53.087729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f9dd-bd1d-4055-8304-c05e598e087d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:53.089381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c999f9dd-bd1d-4055-8304-c05e598e087d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:53.207997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999f9dd-bd1d-4055-8304-c05e598e087d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:53.209520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999f9dd-bd1d-4055-8304-c05e598e087d service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:53.229120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 735/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:55.499353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98082ac1-ae13-46d6-9824-d8b152176476 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:55.499945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98082ac1-ae13-46d6-9824-d8b152176476 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:55.499945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98082ac1-ae13-46d6-9824-d8b152176476 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:55.505638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:04:55.507718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f171a01-499c-4cd7-bf41-856a3d636eb2 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:55.508174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f171a01-499c-4cd7-bf41-856a3d636eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:55.508277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f171a01-499c-4cd7-bf41-856a3d636eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:55.578779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8f171a01-499c-4cd7-bf41-856a3d636eb2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:55.580023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8f171a01-499c-4cd7-bf41-856a3d636eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:55.631431 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:55.689841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:55.981240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98082ac1-ae13-46d6-9824-d8b152176476 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:55.982803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-98082ac1-ae13-46d6-9824-d8b152176476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:56.094152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98082ac1-ae13-46d6-9824-d8b152176476 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:56.150252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:56.178027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891697ad-5233-457b-beff-dc64ca04204b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:56.178634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891697ad-5233-457b-beff-dc64ca04204b service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:56.178912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891697ad-5233-457b-beff-dc64ca04204b service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:56.179180 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891697ad-5233-457b-beff-dc64ca04204b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:56.180832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-891697ad-5233-457b-beff-dc64ca04204b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:56.299767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891697ad-5233-457b-beff-dc64ca04204b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:56.301298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891697ad-5233-457b-beff-dc64ca04204b service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:56.320499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 734/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:05.687817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=22 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:06.318188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=66 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:16.803975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9537eeb-9ea5-4c85-b6b8-11059756c99b None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:16.804557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9537eeb-9ea5-4c85-b6b8-11059756c99b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:16.804557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9537eeb-9ea5-4c85-b6b8-11059756c99b None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:16.805919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 737/1471] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:05:16.811413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607fedc-87f3-4534-80dd-8e003f858f7f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:16.811878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607fedc-87f3-4534-80dd-8e003f858f7f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:16.811971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607fedc-87f3-4534-80dd-8e003f858f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:16.884603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-e607fedc-87f3-4534-80dd-8e003f858f7f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:16.885871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e607fedc-87f3-4534-80dd-8e003f858f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:16.987051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 735/1472] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:17.286997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e8e21-d96a-4fe3-a6b1-2dd9f1390693 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:17.287305 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e8e21-d96a-4fe3-a6b1-2dd9f1390693 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:17.287578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e8e21-d96a-4fe3-a6b1-2dd9f1390693 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:17.288996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 738/1473] 10.222.0.43 () {54 vars in 961 bytes} [Wed Sep 7 16:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:05:17.294133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d22d5d-c843-4657-90e7-c86f703bf826 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:17.294422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d22d5d-c843-4657-90e7-c86f703bf826 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:17.294697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d22d5d-c843-4657-90e7-c86f703bf826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:17.374238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-d1d22d5d-c843-4657-90e7-c86f703bf826 None None] MFA Rules not processed for user `bc71e3a41ac644ff8a908b766495b5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:17.375468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d1d22d5d-c843-4657-90e7-c86f703bf826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:17.397299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:17.455500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 736/1474] 10.222.0.43 () {58 vars in 1058 bytes} [Wed Sep 7 16:05:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:17.464009 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e8e21-d96a-4fe3-a6b1-2dd9f1390693 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:17.465611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d63e8e21-d96a-4fe3-a6b1-2dd9f1390693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:17.576303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e8e21-d96a-4fe3-a6b1-2dd9f1390693 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:17.664903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bab0b9-8e3e-4a3f-a465-839472d69044 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc71e3a41ac644ff8a908b766495b5f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:17.665528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bab0b9-8e3e-4a3f-a465-839472d69044 service glance] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:17.665885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bab0b9-8e3e-4a3f-a465-839472d69044 service glance] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:17.666061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bab0b9-8e3e-4a3f-a465-839472d69044 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:17.667713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-67bab0b9-8e3e-4a3f-a465-839472d69044 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:17.725368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:17.788316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bab0b9-8e3e-4a3f-a465-839472d69044 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:17.789890 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bab0b9-8e3e-4a3f-a465-839472d69044 service glance] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:17.811995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 739/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:20.120699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98248d42-ee28-49fa-b2aa-abea23e55c75 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:20.121293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98248d42-ee28-49fa-b2aa-abea23e55c75 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:20.121293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98248d42-ee28-49fa-b2aa-abea23e55c75 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:20.122612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 737/1476] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:05:20.128611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f795319-cf49-44de-a5aa-484b5752d285 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:20.129127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f795319-cf49-44de-a5aa-484b5752d285 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:20.129309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f795319-cf49-44de-a5aa-484b5752d285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:20.195201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-1f795319-cf49-44de-a5aa-484b5752d285 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:20.196408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1f795319-cf49-44de-a5aa-484b5752d285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:20.295176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 740/1477] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:20.571035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98248d42-ee28-49fa-b2aa-abea23e55c75 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:20.572507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-98248d42-ee28-49fa-b2aa-abea23e55c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:20.739384 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98248d42-ee28-49fa-b2aa-abea23e55c75 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:20.790771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:20.954697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e3c22-2003-4355-b568-31a257fd551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:20.955306 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e3c22-2003-4355-b568-31a257fd551d admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:20.955589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e3c22-2003-4355-b568-31a257fd551d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:20.955857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e3c22-2003-4355-b568-31a257fd551d admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:20.957057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e3c22-2003-4355-b568-31a257fd551d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:20.958801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: WARNING py.warnings [None req-630e3c22-2003-4355-b568-31a257fd551d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:05:20.958801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: warnings.warn(msg) Sep 07 16:05:20.958801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: Sep 07 16:05:20.959935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e3c22-2003-4355-b568-31a257fd551d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:20.979675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 738/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Sep 7 16:05:20 2022] GET /identity/v3/projects => generated 2553 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:05:23.265571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00635dbd-24a4-4d19-b545-f9e79315d4e5 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:23.266149 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00635dbd-24a4-4d19-b545-f9e79315d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:23.266394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00635dbd-24a4-4d19-b545-f9e79315d4e5 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:23.268627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 741/1479] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:05:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:05:23.275076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a192935-a12b-45eb-8361-1685dffb8767 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:23.275562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a192935-a12b-45eb-8361-1685dffb8767 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:23.275901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a192935-a12b-45eb-8361-1685dffb8767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:23.350164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-6a192935-a12b-45eb-8361-1685dffb8767 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:23.351338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6a192935-a12b-45eb-8361-1685dffb8767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:23.457222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 739/1480] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:23.766306 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00635dbd-24a4-4d19-b545-f9e79315d4e5 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:23.767895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-00635dbd-24a4-4d19-b545-f9e79315d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:23.777897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:23.921525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00635dbd-24a4-4d19-b545-f9e79315d4e5 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:24.009008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:24.043475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68935149-9c14-45d9-92f6-0853dc76039b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:24.044087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68935149-9c14-45d9-92f6-0853dc76039b service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:24.044370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68935149-9c14-45d9-92f6-0853dc76039b service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:24.044645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68935149-9c14-45d9-92f6-0853dc76039b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:24.046298 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-68935149-9c14-45d9-92f6-0853dc76039b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:24.141462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68935149-9c14-45d9-92f6-0853dc76039b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:24.143094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68935149-9c14-45d9-92f6-0853dc76039b service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:24.163826 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 742/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:26.633855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e97113-4a08-43ef-b0bf-4eb13374b5f3 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:26.634619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e97113-4a08-43ef-b0bf-4eb13374b5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:26.634619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e97113-4a08-43ef-b0bf-4eb13374b5f3 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:26.635732 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 740/1482] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:05:26.641339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3c710-54ee-4eee-8618-bed68b113115 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:26.641773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3c710-54ee-4eee-8618-bed68b113115 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:26.641883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3c710-54ee-4eee-8618-bed68b113115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:26.707845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-5ae3c710-54ee-4eee-8618-bed68b113115 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:26.709111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-5ae3c710-54ee-4eee-8618-bed68b113115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:26.754546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:26.804413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 743/1483] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:27.097548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e97113-4a08-43ef-b0bf-4eb13374b5f3 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:27.099088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-18e97113-4a08-43ef-b0bf-4eb13374b5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:27.123112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:27.205079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e97113-4a08-43ef-b0bf-4eb13374b5f3 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:27.293136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcaeb5-fb39-4607-b1b8-d9de0025a49f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:27.293662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcaeb5-fb39-4607-b1b8-d9de0025a49f service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:27.293942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcaeb5-fb39-4607-b1b8-d9de0025a49f service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:27.294212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcaeb5-fb39-4607-b1b8-d9de0025a49f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:27.295868 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0dfcaeb5-fb39-4607-b1b8-d9de0025a49f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:27.377163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:27.424440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcaeb5-fb39-4607-b1b8-d9de0025a49f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:27.426082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcaeb5-fb39-4607-b1b8-d9de0025a49f service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:27.445876 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 741/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:05:29.702011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13df61-15f2-462f-a70e-d558b83e3df7 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:29.702565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13df61-15f2-462f-a70e-d558b83e3df7 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:29.702565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13df61-15f2-462f-a70e-d558b83e3df7 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:29.703931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 744/1485] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:05:29.709457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f890b98-755f-46e9-b4cd-c29bb7b82376 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:29.709946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f890b98-755f-46e9-b4cd-c29bb7b82376 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:29.710049 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f890b98-755f-46e9-b4cd-c29bb7b82376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:29.776430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-1f890b98-755f-46e9-b4cd-c29bb7b82376 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:29.777678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1f890b98-755f-46e9-b4cd-c29bb7b82376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:29.873409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 742/1486] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:30.167978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13df61-15f2-462f-a70e-d558b83e3df7 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:30.169597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-dc13df61-15f2-462f-a70e-d558b83e3df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:30.278355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13df61-15f2-462f-a70e-d558b83e3df7 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:30.353724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:30.355508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b171a5-d61d-4975-8651-535eb76d8e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:30.356139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b171a5-d61d-4975-8651-535eb76d8e23 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:30.356616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b171a5-d61d-4975-8651-535eb76d8e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:30.357119 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b171a5-d61d-4975-8651-535eb76d8e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:30.358967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-05b171a5-d61d-4975-8651-535eb76d8e23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:30.469182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b171a5-d61d-4975-8651-535eb76d8e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:30.470693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b171a5-d61d-4975-8651-535eb76d8e23 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:30.490044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 745/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:32.851006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d8227-a694-40f6-8a68-03e631b6edb4 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:32.851549 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d8227-a694-40f6-8a68-03e631b6edb4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:32.851549 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d8227-a694-40f6-8a68-03e631b6edb4 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:32.852899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 743/1488] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:05:32.858078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e80635-64bb-4349-8623-9203a87ba82a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:32.858473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e80635-64bb-4349-8623-9203a87ba82a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:32.858632 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e80635-64bb-4349-8623-9203a87ba82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:32.926803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-49e80635-64bb-4349-8623-9203a87ba82a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:32.928020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-49e80635-64bb-4349-8623-9203a87ba82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:32.980906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:33.031567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 746/1489] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:33.337357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d8227-a694-40f6-8a68-03e631b6edb4 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:33.338904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-493d8227-a694-40f6-8a68-03e631b6edb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:33.376164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:33.446636 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d8227-a694-40f6-8a68-03e631b6edb4 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:33.522772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ce812-a68e-4832-ab52-7927ada93356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:33.523295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ce812-a68e-4832-ab52-7927ada93356 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:33.523576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ce812-a68e-4832-ab52-7927ada93356 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:33.524146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ce812-a68e-4832-ab52-7927ada93356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:33.525888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-252ce812-a68e-4832-ab52-7927ada93356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:33.607427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:33.636073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ce812-a68e-4832-ab52-7927ada93356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:33.637518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ce812-a68e-4832-ab52-7927ada93356 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:33.656612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 744/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:36.033598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935d76c-b805-44f7-aa76-f2a46a065011 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:36.034043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935d76c-b805-44f7-aa76-f2a46a065011 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:36.034140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935d76c-b805-44f7-aa76-f2a46a065011 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:36.036100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 747/1491] 10.222.0.43 () {54 vars in 927 bytes} [Wed Sep 7 16:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:05:36.041590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49674bf4-e4f7-49f1-a433-f0d5dc2cf811 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:36.042012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49674bf4-e4f7-49f1-a433-f0d5dc2cf811 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:36.042120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49674bf4-e4f7-49f1-a433-f0d5dc2cf811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:36.108258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-49674bf4-e4f7-49f1-a433-f0d5dc2cf811 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:36.109504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-49674bf4-e4f7-49f1-a433-f0d5dc2cf811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:36.207061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 745/1492] 10.222.0.43 () {58 vars in 1024 bytes} [Wed Sep 7 16:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:36.493798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935d76c-b805-44f7-aa76-f2a46a065011 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:36.495323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4935d76c-b805-44f7-aa76-f2a46a065011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:36.605525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935d76c-b805-44f7-aa76-f2a46a065011 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:36.678096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a3d3a-481a-43cd-8cef-2b08c62a8238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:36.678692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a3d3a-481a-43cd-8cef-2b08c62a8238 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:36.678969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a3d3a-481a-43cd-8cef-2b08c62a8238 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:36.679239 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a3d3a-481a-43cd-8cef-2b08c62a8238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:36.680884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0f8a3d3a-481a-43cd-8cef-2b08c62a8238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:36.690265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:36.791333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a3d3a-481a-43cd-8cef-2b08c62a8238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:36.792706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a3d3a-481a-43cd-8cef-2b08c62a8238 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:36.810187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 748/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:46.205333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=82 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:46.807943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=50 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:53.081445 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6620aa-11d5-4b64-80c3-6ab4ea7e8e38 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:53.082017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6620aa-11d5-4b64-80c3-6ab4ea7e8e38 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:53.082017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6620aa-11d5-4b64-80c3-6ab4ea7e8e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:53.158399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-8d6620aa-11d5-4b64-80c3-6ab4ea7e8e38 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:53.159621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8d6620aa-11d5-4b64-80c3-6ab4ea7e8e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:53.270062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 746/1494] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:53.278722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2a39a-6f4b-48dd-b39f-009ff874bb1e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:53.279380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2a39a-6f4b-48dd-b39f-009ff874bb1e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:53.279380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2a39a-6f4b-48dd-b39f-009ff874bb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:53.356722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-59b2a39a-6f4b-48dd-b39f-009ff874bb1e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:53.357925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-59b2a39a-6f4b-48dd-b39f-009ff874bb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:53.460144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 749/1495] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:53.464895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6620aa-11d5-4b64-80c3-6ab4ea7e8e38 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:53.466120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8d6620aa-11d5-4b64-80c3-6ab4ea7e8e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:53.477831 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6620aa-11d5-4b64-80c3-6ab4ea7e8e38 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:53.540244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:53.575325 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676d46-bed4-4d3c-9eee-15cd1b2989a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:53.575916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676d46-bed4-4d3c-9eee-15cd1b2989a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:53.576189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676d46-bed4-4d3c-9eee-15cd1b2989a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:53.576456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676d46-bed4-4d3c-9eee-15cd1b2989a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:53.577120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5676d46-bed4-4d3c-9eee-15cd1b2989a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:06:53.577416 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5676d46-bed4-4d3c-9eee-15cd1b2989a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:53.578399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: WARNING py.warnings [None req-d5676d46-bed4-4d3c-9eee-15cd1b2989a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:06:53.578399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: warnings.warn(msg) Sep 07 16:06:53.578399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: Sep 07 16:06:53.579264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5676d46-bed4-4d3c-9eee-15cd1b2989a7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:53.590383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 747/1496] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:06:53.599344 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2a39a-6f4b-48dd-b39f-009ff874bb1e None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:53.609069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2a39a-6f4b-48dd-b39f-009ff874bb1e None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:53.672040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:53.706060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af4c5-534c-420b-a0f7-e2c12e4818fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:53.706696 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af4c5-534c-420b-a0f7-e2c12e4818fb admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:53.706969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af4c5-534c-420b-a0f7-e2c12e4818fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:53.707238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af4c5-534c-420b-a0f7-e2c12e4818fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:53.707885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af4c5-534c-420b-a0f7-e2c12e4818fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:53.710182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: WARNING py.warnings [None req-b56af4c5-534c-420b-a0f7-e2c12e4818fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:06:53.710182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: warnings.warn(msg) Sep 07 16:06:53.710182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: Sep 07 16:06:53.711362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af4c5-534c-420b-a0f7-e2c12e4818fb admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:53.767570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 750/1497] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:06:53 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:06:53.772654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676d46-bed4-4d3c-9eee-15cd1b2989a7 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:53.774282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d5676d46-bed4-4d3c-9eee-15cd1b2989a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:53.808315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676d46-bed4-4d3c-9eee-15cd1b2989a7 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:53.905233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d99a-9501-4f3c-8501-79c121169f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:53.905862 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d99a-9501-4f3c-8501-79c121169f3d admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:53.906139 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d99a-9501-4f3c-8501-79c121169f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:53.906406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d99a-9501-4f3c-8501-79c121169f3d admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:53.907041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9d99a-9501-4f3c-8501-79c121169f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:53.908043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: WARNING py.warnings [None req-3bc9d99a-9501-4f3c-8501-79c121169f3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:06:53.908043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: warnings.warn(msg) Sep 07 16:06:53.908043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: Sep 07 16:06:53.909285 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9d99a-9501-4f3c-8501-79c121169f3d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:53.954930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 748/1498] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:06:53 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:06:53.958825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af4c5-534c-420b-a0f7-e2c12e4818fb admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:53.960365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b56af4c5-534c-420b-a0f7-e2c12e4818fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:54.022348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af4c5-534c-420b-a0f7-e2c12e4818fb admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:54.113844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:54.126174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8daef-4ab4-4eb0-a2d9-9fbd38e1bb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:54.126786 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8daef-4ab4-4eb0-a2d9-9fbd38e1bb48 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:54.127064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8daef-4ab4-4eb0-a2d9-9fbd38e1bb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:54.127333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8daef-4ab4-4eb0-a2d9-9fbd38e1bb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:54.127976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8daef-4ab4-4eb0-a2d9-9fbd38e1bb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:54.129017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: WARNING py.warnings [None req-f5b8daef-4ab4-4eb0-a2d9-9fbd38e1bb48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:06:54.129017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: warnings.warn(msg) Sep 07 16:06:54.129017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: Sep 07 16:06:54.129897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8daef-4ab4-4eb0-a2d9-9fbd38e1bb48 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:54.143295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 751/1499] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:06:54.147496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d99a-9501-4f3c-8501-79c121169f3d admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:54.149046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3bc9d99a-9501-4f3c-8501-79c121169f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:54.160589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d99a-9501-4f3c-8501-79c121169f3d admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:54.187660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:54.266765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b512b1-9d81-41ad-b7a6-921db5f101c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:54.267370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b512b1-9d81-41ad-b7a6-921db5f101c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:54.267642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b512b1-9d81-41ad-b7a6-921db5f101c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:54.268183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b512b1-9d81-41ad-b7a6-921db5f101c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:54.268857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b512b1-9d81-41ad-b7a6-921db5f101c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:54.269865 dv-cinder-856174-1-smb devstack@keystone.service[81621]: WARNING py.warnings [None req-a9b512b1-9d81-41ad-b7a6-921db5f101c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:06:54.269865 dv-cinder-856174-1-smb devstack@keystone.service[81621]: warnings.warn(msg) Sep 07 16:06:54.269865 dv-cinder-856174-1-smb devstack@keystone.service[81621]: Sep 07 16:06:54.270821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b512b1-9d81-41ad-b7a6-921db5f101c5 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:54.285861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 749/1500] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:06:54.292328 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8daef-4ab4-4eb0-a2d9-9fbd38e1bb48 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:54.294170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f5b8daef-4ab4-4eb0-a2d9-9fbd38e1bb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:54.331261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8daef-4ab4-4eb0-a2d9-9fbd38e1bb48 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:54.429274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc371d-5707-44bf-827b-f5dc84f905e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:54.429967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc371d-5707-44bf-827b-f5dc84f905e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:54.430249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc371d-5707-44bf-827b-f5dc84f905e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:54.430524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc371d-5707-44bf-827b-f5dc84f905e3 admin admin] PATH_INFO: `/v3/projects/98e50884fa7a4c3bade9daf56d4af90a/users/59c193908cba4785b17d983249cf0b2c/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:54.453553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc371d-5707-44bf-827b-f5dc84f905e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98e50884fa7a4c3bade9daf56d4af90a, user_id=59c193908cba4785b17d983249cf0b2c, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:54.454584 dv-cinder-856174-1-smb devstack@keystone.service[81620]: WARNING py.warnings [None req-cdfc371d-5707-44bf-827b-f5dc84f905e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:06:54.454584 dv-cinder-856174-1-smb devstack@keystone.service[81620]: warnings.warn(msg) Sep 07 16:06:54.454584 dv-cinder-856174-1-smb devstack@keystone.service[81620]: Sep 07 16:06:54.456530 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc371d-5707-44bf-827b-f5dc84f905e3 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:54.481328 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 752/1501] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:06:54 2022] PUT /identity/v3/projects/98e50884fa7a4c3bade9daf56d4af90a/users/59c193908cba4785b17d983249cf0b2c/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:54.494428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e27a22-7b5e-4e84-9741-123c88ceae49 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:54.494729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e27a22-7b5e-4e84-9741-123c88ceae49 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:54.495009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e27a22-7b5e-4e84-9741-123c88ceae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:54.562422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-e5e27a22-7b5e-4e84-9741-123c88ceae49 None None] MFA Rules not processed for user `59c193908cba4785b17d983249cf0b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:54.563649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e5e27a22-7b5e-4e84-9741-123c88ceae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:54.640263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 750/1502] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:06:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:54.654380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d1a1d-a0f1-4c78-a132-aa0ee2dbc014 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:54.654670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d1a1d-a0f1-4c78-a132-aa0ee2dbc014 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:54.654944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d1a1d-a0f1-4c78-a132-aa0ee2dbc014 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:54.656290 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 753/1503] 10.222.0.43 () {54 vars in 964 bytes} [Wed Sep 7 16:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:06:54.661460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7f2d8-e5f6-47c3-9ea5-ec57b3bce011 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:54.662214 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7f2d8-e5f6-47c3-9ea5-ec57b3bce011 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:54.662679 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7f2d8-e5f6-47c3-9ea5-ec57b3bce011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:54.694240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:54.742722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-a1b7f2d8-e5f6-47c3-9ea5-ec57b3bce011 None None] MFA Rules not processed for user `c901e018aa1c429da33b5809873d0aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:54.743952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a1b7f2d8-e5f6-47c3-9ea5-ec57b3bce011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:54.820885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 751/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Wed Sep 7 16:06:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:54.828575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d1a1d-a0f1-4c78-a132-aa0ee2dbc014 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:54.830145 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c94d1a1d-a0f1-4c78-a132-aa0ee2dbc014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:54.882500 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:54.944414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d1a1d-a0f1-4c78-a132-aa0ee2dbc014 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:55.018401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab701d-27a1-4e82-afc0-be41c39ed527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:55.019008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab701d-27a1-4e82-afc0-be41c39ed527 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:55.019288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab701d-27a1-4e82-afc0-be41c39ed527 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:55.019565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab701d-27a1-4e82-afc0-be41c39ed527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:55.022224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-74ab701d-27a1-4e82-afc0-be41c39ed527 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:55.132012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab701d-27a1-4e82-afc0-be41c39ed527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:55.133486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab701d-27a1-4e82-afc0-be41c39ed527 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:55.137025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:55.153288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 754/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:06:55.199353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392da66-4598-4faf-a7e3-e94fa8c1472b None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:55.199778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392da66-4598-4faf-a7e3-e94fa8c1472b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:55.199900 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392da66-4598-4faf-a7e3-e94fa8c1472b None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:55.201228 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 752/1506] 10.222.0.43 () {52 vars in 830 bytes} [Wed Sep 7 16:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:06:55.204831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab701d-27a1-4e82-afc0-be41c39ed527 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:55.206049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-74ab701d-27a1-4e82-afc0-be41c39ed527 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:55.308821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab701d-27a1-4e82-afc0-be41c39ed527 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:55.408323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:55.408973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:55.409249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:55.409521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] PATH_INFO: `/v3/users/59c193908cba4785b17d983249cf0b2c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:55.422691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c193908cba4785b17d983249cf0b2c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:55.423729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: WARNING py.warnings [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:06:55.423729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: warnings.warn(msg) Sep 07 16:06:55.423729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: Sep 07 16:06:55.424968 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:55.436019 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:55.499296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c193908cba4785b17d983249cf0b2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:55.509408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c193908cba4785b17d983249cf0b2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:55.532191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c193908cba4785b17d983249cf0b2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:55.532759 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c193908cba4785b17d983249cf0b2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:55.533249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c193908cba4785b17d983249cf0b2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:55.553689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 755/1507] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:06:55 2022] DELETE /identity/v3/users/59c193908cba4785b17d983249cf0b2c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:55.559110 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46a4cb-c8fc-4f89-a722-d25fba2d29ca None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:55.559392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46a4cb-c8fc-4f89-a722-d25fba2d29ca None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:55.559666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46a4cb-c8fc-4f89-a722-d25fba2d29ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:55.621466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-ce46a4cb-c8fc-4f89-a722-d25fba2d29ca None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:55.622706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ce46a4cb-c8fc-4f89-a722-d25fba2d29ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:55.707194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:55.720267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 753/1508] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:55.730617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:55.731852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:55.831983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bb21c-5e4b-4a74-b189-72bc8f83011e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:55.886464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:55.909595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81754bc1-ef37-485e-b45d-9db3b270ed1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:55.910450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81754bc1-ef37-485e-b45d-9db3b270ed1a service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:55.910926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81754bc1-ef37-485e-b45d-9db3b270ed1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:55.911277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81754bc1-ef37-485e-b45d-9db3b270ed1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:55.914278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-81754bc1-ef37-485e-b45d-9db3b270ed1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:56.030997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81754bc1-ef37-485e-b45d-9db3b270ed1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:56.032447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81754bc1-ef37-485e-b45d-9db3b270ed1a service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:56.051136 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 756/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:06:56.406162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46a4cb-c8fc-4f89-a722-d25fba2d29ca None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:56.407707 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ce46a4cb-c8fc-4f89-a722-d25fba2d29ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:56.419869 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46a4cb-c8fc-4f89-a722-d25fba2d29ca None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:56.519577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:56.520204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:56.521718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:56.521990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] PATH_INFO: `/v3/projects/98e50884fa7a4c3bade9daf56d4af90a` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:56.532147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=98e50884fa7a4c3bade9daf56d4af90a)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:56.533217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: WARNING py.warnings [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:06:56.533217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: warnings.warn(msg) Sep 07 16:06:56.533217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: Sep 07 16:06:56.535382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:56.594388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98e50884fa7a4c3bade9daf56d4af90a', 'request_id': 'req-47b2694c-d78e-439c-b75b-2f6556827c8c'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:56.605621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98e50884fa7a4c3bade9daf56d4af90a', 'request_id': 'req-47b2694c-d78e-439c-b75b-2f6556827c8c'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:56.613051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98e50884fa7a4c3bade9daf56d4af90a', 'request_id': 'req-47b2694c-d78e-439c-b75b-2f6556827c8c'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:56.645179 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] The token cache is being invalidate because project 98e50884fa7a4c3bade9daf56d4af90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:06:56.645474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:56.646675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47b2694c-d78e-439c-b75b-2f6556827c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:56.648095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 754/1510] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:06:56 2022] DELETE /identity/v3/projects/98e50884fa7a4c3bade9daf56d4af90a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:07:06.048894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=62 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:07:06.643079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:31.818126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eb77e-e290-4d02-a519-28fc10ff84ae None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:31.818745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eb77e-e290-4d02-a519-28fc10ff84ae None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:31.818745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eb77e-e290-4d02-a519-28fc10ff84ae None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:31.820026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:08:31.825179 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2566c9-15b8-4047-873b-5cb89a62fa2d None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:31.825668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2566c9-15b8-4047-873b-5cb89a62fa2d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:31.825825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2566c9-15b8-4047-873b-5cb89a62fa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:31.906648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-dc2566c9-15b8-4047-873b-5cb89a62fa2d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:08:31.907863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-dc2566c9-15b8-4047-873b-5cb89a62fa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:32.010198 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:08:32.176885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eb77e-e290-4d02-a519-28fc10ff84ae None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:08:32.179004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1b6eb77e-e290-4d02-a519-28fc10ff84ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:32.300927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eb77e-e290-4d02-a519-28fc10ff84ae None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:08:32.306297 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02890d82-12da-4c32-b343-7e262e8a1dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:08:32.306889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02890d82-12da-4c32-b343-7e262e8a1dbf service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:32.307170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02890d82-12da-4c32-b343-7e262e8a1dbf service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:32.307443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02890d82-12da-4c32-b343-7e262e8a1dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:32.315378 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02890d82-12da-4c32-b343-7e262e8a1dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:08:32.316995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02890d82-12da-4c32-b343-7e262e8a1dbf service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:08:32.326085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 758/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:08:33.421633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8666c-3d4f-4a0c-8214-4724b852f94f None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:33.422194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8666c-3d4f-4a0c-8214-4724b852f94f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:33.422194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8666c-3d4f-4a0c-8214-4724b852f94f None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:33.423570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:08:33.431082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cccaa0-6557-4b8a-9bcb-0a8e8f5ab1cd None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:33.431556 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cccaa0-6557-4b8a-9bcb-0a8e8f5ab1cd None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:33.431664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cccaa0-6557-4b8a-9bcb-0a8e8f5ab1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:33.451511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-43cccaa0-6557-4b8a-9bcb-0a8e8f5ab1cd None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:08:33.452823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-43cccaa0-6557-4b8a-9bcb-0a8e8f5ab1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:33.461783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:08:33.619190 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8666c-3d4f-4a0c-8214-4724b852f94f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:08:33.634121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8666c-3d4f-4a0c-8214-4724b852f94f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:08:33.639428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc6c88-2607-4cbf-898a-136c31c13928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:08:33.640011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc6c88-2607-4cbf-898a-136c31c13928 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:33.640288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc6c88-2607-4cbf-898a-136c31c13928 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:33.640556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc6c88-2607-4cbf-898a-136c31c13928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:33.648456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc6c88-2607-4cbf-898a-136c31c13928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:08:33.650076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc6c88-2607-4cbf-898a-136c31c13928 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:08:33.659564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 757/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:08:33.913623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6292b-2072-4000-8131-530ec2ec62f9 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:33.913818 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6292b-2072-4000-8131-530ec2ec62f9 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:33.914102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6292b-2072-4000-8131-530ec2ec62f9 None None] PATH_INFO: `/v3` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:33.915376 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 760/1517] 10.222.0.20 () {54 vars in 925 bytes} [Wed Sep 7 16:08:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:08:33.921484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24476a6-1818-4883-9763-3e7b4aba1bdf None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:33.921773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24476a6-1818-4883-9763-3e7b4aba1bdf None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:33.922052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24476a6-1818-4883-9763-3e7b4aba1bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:33.984160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b24476a6-1818-4883-9763-3e7b4aba1bdf None None] MFA Rules not processed for user `b918da0f83754f3887de1cfa2e4df028`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:08:33.985420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b24476a6-1818-4883-9763-3e7b4aba1bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:34.003114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:34.058993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 758/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Sep 7 16:08:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:08:37.609203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4549b-791f-4aaa-8cf9-5b8a3f12288a None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:37.609683 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4549b-791f-4aaa-8cf9-5b8a3f12288a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:37.609783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4549b-791f-4aaa-8cf9-5b8a3f12288a None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:37.611140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 761/1519] 10.222.0.43 () {54 vars in 961 bytes} [Wed Sep 7 16:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:08:37.616419 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf22f2-57e6-488e-8580-304595883a0c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:37.616875 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf22f2-57e6-488e-8580-304595883a0c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:37.617031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf22f2-57e6-488e-8580-304595883a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:37.637432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-6ccf22f2-57e6-488e-8580-304595883a0c None None] MFA Rules not processed for user `b918da0f83754f3887de1cfa2e4df028`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:08:37.638647 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6ccf22f2-57e6-488e-8580-304595883a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:37.648406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 759/1520] 10.222.0.43 () {58 vars in 1058 bytes} [Wed Sep 7 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:08:37.656611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4549b-791f-4aaa-8cf9-5b8a3f12288a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:08:37.670840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4549b-791f-4aaa-8cf9-5b8a3f12288a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:08:37.676829 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b841321-ecfe-4fff-8f08-c48ff1de5d54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b918da0f83754f3887de1cfa2e4df028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:08:37.677442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b841321-ecfe-4fff-8f08-c48ff1de5d54 service placement] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:37.677726 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b841321-ecfe-4fff-8f08-c48ff1de5d54 service placement] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:37.678000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b841321-ecfe-4fff-8f08-c48ff1de5d54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:37.686579 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b841321-ecfe-4fff-8f08-c48ff1de5d54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:08:37.688172 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b841321-ecfe-4fff-8f08-c48ff1de5d54 service placement] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:08:37.698638 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 762/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:08:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:08:45.179590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b565c-3b83-4eba-8da9-137ee6ceea7a None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:45.180159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b565c-3b83-4eba-8da9-137ee6ceea7a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:45.180159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b565c-3b83-4eba-8da9-137ee6ceea7a None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:45.181517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:08:45.187856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aff52-7e51-429f-82f7-04373bd6698b None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:45.188302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aff52-7e51-429f-82f7-04373bd6698b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:45.188397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aff52-7e51-429f-82f7-04373bd6698b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:45.208952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-3e3aff52-7e51-429f-82f7-04373bd6698b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:08:45.210153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3e3aff52-7e51-429f-82f7-04373bd6698b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:45.217894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:08:45.377282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b565c-3b83-4eba-8da9-137ee6ceea7a None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:08:45.392314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b565c-3b83-4eba-8da9-137ee6ceea7a None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:08:45.397757 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589a6b7-4d91-45dc-8933-15fe7b270a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:08:45.398353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589a6b7-4d91-45dc-8933-15fe7b270a7c service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:45.398635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589a6b7-4d91-45dc-8933-15fe7b270a7c service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:45.398924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589a6b7-4d91-45dc-8933-15fe7b270a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:45.407127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589a6b7-4d91-45dc-8933-15fe7b270a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:08:45.408731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589a6b7-4d91-45dc-8933-15fe7b270a7c service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:08:45.418514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 761/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:08:46.496188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57788f-225e-4d8c-b53a-f575c469ea14 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:46.496796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57788f-225e-4d8c-b53a-f575c469ea14 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:46.496796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57788f-225e-4d8c-b53a-f575c469ea14 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:46.498118 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 16:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:08:46.504587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f95c30-4302-4c1e-ab7c-f576477d474d None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:46.505060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f95c30-4302-4c1e-ab7c-f576477d474d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:46.505169 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f95c30-4302-4c1e-ab7c-f576477d474d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:46.524521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-70f95c30-4302-4c1e-ab7c-f576477d474d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:08:46.525753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-70f95c30-4302-4c1e-ab7c-f576477d474d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:46.533715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 16:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:08:46.688036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57788f-225e-4d8c-b53a-f575c469ea14 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:08:46.702526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57788f-225e-4d8c-b53a-f575c469ea14 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:08:46.708621 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d073acf-566e-41ac-af53-3a88e17c0732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:08:46.709245 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d073acf-566e-41ac-af53-3a88e17c0732 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:46.709526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d073acf-566e-41ac-af53-3a88e17c0732 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:46.709803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d073acf-566e-41ac-af53-3a88e17c0732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:46.717891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d073acf-566e-41ac-af53-3a88e17c0732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:08:46.719483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d073acf-566e-41ac-af53-3a88e17c0732 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:08:46.729701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 765/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:08:50.770512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0c36c-9157-45d0-9eca-8a380f9c7e19 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:50.771121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0c36c-9157-45d0-9eca-8a380f9c7e19 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:50.771121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0c36c-9157-45d0-9eca-8a380f9c7e19 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:50.772368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:08:50.777650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69314925-4ded-4a5c-ad6a-18415d1bc296 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:50.778063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69314925-4ded-4a5c-ad6a-18415d1bc296 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:50.778204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69314925-4ded-4a5c-ad6a-18415d1bc296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:50.798321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-69314925-4ded-4a5c-ad6a-18415d1bc296 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:08:50.799513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-69314925-4ded-4a5c-ad6a-18415d1bc296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:50.807836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:08:51.101183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0c36c-9157-45d0-9eca-8a380f9c7e19 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:08:51.102863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f5e0c36c-9157-45d0-9eca-8a380f9c7e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:51.185945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0c36c-9157-45d0-9eca-8a380f9c7e19 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:08:51.189595 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794217f-57c8-4f9d-8524-1f1a33f5eccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:08:51.190199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794217f-57c8-4f9d-8524-1f1a33f5eccf service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:51.190974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794217f-57c8-4f9d-8524-1f1a33f5eccf service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:51.191284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794217f-57c8-4f9d-8524-1f1a33f5eccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:51.200265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794217f-57c8-4f9d-8524-1f1a33f5eccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:08:51.201724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794217f-57c8-4f9d-8524-1f1a33f5eccf service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:08:51.211730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 764/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:08:53.365085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d14d2a-af0c-4487-9084-7774c1124a71 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:53.365664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d14d2a-af0c-4487-9084-7774c1124a71 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:53.365664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d14d2a-af0c-4487-9084-7774c1124a71 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:53.366990 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:08:53.372157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cc492-543a-4c62-b55d-072278f0d359 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:53.372607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cc492-543a-4c62-b55d-072278f0d359 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:53.372738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cc492-543a-4c62-b55d-072278f0d359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:53.391655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-744cc492-543a-4c62-b55d-072278f0d359 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:08:53.392867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-744cc492-543a-4c62-b55d-072278f0d359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:53.401087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:08:53.700057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d14d2a-af0c-4487-9084-7774c1124a71 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:08:53.711407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d14d2a-af0c-4487-9084-7774c1124a71 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:08:53.714879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951c0b-7191-4c0d-96c7-17eb4e5bac83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:08:53.715471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951c0b-7191-4c0d-96c7-17eb4e5bac83 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:53.715755 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951c0b-7191-4c0d-96c7-17eb4e5bac83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:53.716034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951c0b-7191-4c0d-96c7-17eb4e5bac83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:53.725411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951c0b-7191-4c0d-96c7-17eb4e5bac83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:08:53.726845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951c0b-7191-4c0d-96c7-17eb4e5bac83 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:08:53.736327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 768/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:08:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:08:57.331580 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088de51-8064-4537-bd65-920e847230ce None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:57.332039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088de51-8064-4537-bd65-920e847230ce None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:57.332201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088de51-8064-4537-bd65-920e847230ce None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:57.333578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:08:57.338713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be650-1e40-4cd7-92ab-c66cbc22aac0 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:57.339170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be650-1e40-4cd7-92ab-c66cbc22aac0 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:57.339285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be650-1e40-4cd7-92ab-c66cbc22aac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:57.347558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=81 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:57.360401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-4f4be650-1e40-4cd7-92ab-c66cbc22aac0 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:08:57.361632 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4f4be650-1e40-4cd7-92ab-c66cbc22aac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:57.369566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:08:57.676643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088de51-8064-4537-bd65-920e847230ce None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:08:57.678415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6088de51-8064-4537-bd65-920e847230ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:57.744088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:57.758857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088de51-8064-4537-bd65-920e847230ce None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:08:57.762445 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98cf17-7796-41da-ae83-75806a8914ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:08:57.763056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98cf17-7796-41da-ae83-75806a8914ef service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:57.763336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98cf17-7796-41da-ae83-75806a8914ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:57.763612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98cf17-7796-41da-ae83-75806a8914ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:57.778424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98cf17-7796-41da-ae83-75806a8914ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:08:57.780121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98cf17-7796-41da-ae83-75806a8914ef service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:08:57.789696 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 767/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:08:59.952636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10066541-46f5-4e0d-8d1d-0e9cb8a36f23 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:59.953229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10066541-46f5-4e0d-8d1d-0e9cb8a36f23 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:59.953229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10066541-46f5-4e0d-8d1d-0e9cb8a36f23 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:59.954550 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 16:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:08:59.959873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8915d-a7c6-4b74-875f-396709f46203 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:08:59.960288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8915d-a7c6-4b74-875f-396709f46203 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:08:59.960422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8915d-a7c6-4b74-875f-396709f46203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:08:59.980131 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-d0c8915d-a7c6-4b74-875f-396709f46203 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:08:59.981360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d0c8915d-a7c6-4b74-875f-396709f46203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:08:59.989680 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 16:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:09:00.302136 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10066541-46f5-4e0d-8d1d-0e9cb8a36f23 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:09:00.303895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-10066541-46f5-4e0d-8d1d-0e9cb8a36f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:09:00.317498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10066541-46f5-4e0d-8d1d-0e9cb8a36f23 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:09:00.320978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471c4c7-e918-4884-b7b1-782d5559ea52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:09:00.321577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c4c7-e918-4884-b7b1-782d5559ea52 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:09:00.322116 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c4c7-e918-4884-b7b1-782d5559ea52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:09:00.322401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c4c7-e918-4884-b7b1-782d5559ea52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:09:00.331156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471c4c7-e918-4884-b7b1-782d5559ea52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:09:00.332583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471c4c7-e918-4884-b7b1-782d5559ea52 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:09:00.342047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 771/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:09:09.975392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=11 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:09:10.338152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=8 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:27.405779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838eabb-0b97-451f-b2cb-3cf33e6b7258 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.407157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838eabb-0b97-451f-b2cb-3cf33e6b7258 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.407157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838eabb-0b97-451f-b2cb-3cf33e6b7258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.445874 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-0838eabb-0b97-451f-b2cb-3cf33e6b7258 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:27.447322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0838eabb-0b97-451f-b2cb-3cf33e6b7258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:27.457558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 769/1540] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:10:27.467976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c86531-0322-4874-ab46-492e5cca4750 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.468628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c86531-0322-4874-ab46-492e5cca4750 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.468628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c86531-0322-4874-ab46-492e5cca4750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.474308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741560d-70ba-424d-97c1-4717f0839815 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.474651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741560d-70ba-424d-97c1-4717f0839815 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.474865 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741560d-70ba-424d-97c1-4717f0839815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.502189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e3c86531-0322-4874-ab46-492e5cca4750 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:27.503416 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e3c86531-0322-4874-ab46-492e5cca4750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:27.506020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-2741560d-70ba-424d-97c1-4717f0839815 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:27.508024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2741560d-70ba-424d-97c1-4717f0839815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:27.515526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 772/1541] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:27.519811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 770/1542] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:27.520038 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c86531-0322-4874-ab46-492e5cca4750 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:27.530071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c86531-0322-4874-ab46-492e5cca4750 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:27.541346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcd0ee-f227-47dd-adfc-9214e9fc6576 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.541648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcd0ee-f227-47dd-adfc-9214e9fc6576 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.541918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcd0ee-f227-47dd-adfc-9214e9fc6576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.545549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f517c-a823-4cb2-b2dd-67bc3d71628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:27.546179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f517c-a823-4cb2-b2dd-67bc3d71628c admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.546461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f517c-a823-4cb2-b2dd-67bc3d71628c admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.546733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f517c-a823-4cb2-b2dd-67bc3d71628c admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.547392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f517c-a823-4cb2-b2dd-67bc3d71628c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:27.547694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f517c-a823-4cb2-b2dd-67bc3d71628c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:27.548827 dv-cinder-856174-1-smb devstack@keystone.service[81620]: WARNING py.warnings [None req-144f517c-a823-4cb2-b2dd-67bc3d71628c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:10:27.548827 dv-cinder-856174-1-smb devstack@keystone.service[81620]: warnings.warn(msg) Sep 07 16:10:27.548827 dv-cinder-856174-1-smb devstack@keystone.service[81620]: Sep 07 16:10:27.549626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f517c-a823-4cb2-b2dd-67bc3d71628c admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:27.572717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 773/1543] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:27.574115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ab969-8c87-4c7c-818c-31dd98bc1a0a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.574402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ab969-8c87-4c7c-818c-31dd98bc1a0a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.574677 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ab969-8c87-4c7c-818c-31dd98bc1a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.576888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b0bcd0ee-f227-47dd-adfc-9214e9fc6576 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:27.578233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b0bcd0ee-f227-47dd-adfc-9214e9fc6576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:27.593623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 771/1544] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:27.594454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcd0ee-f227-47dd-adfc-9214e9fc6576 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:27.605947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-026ab969-8c87-4c7c-818c-31dd98bc1a0a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:27.607203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-026ab969-8c87-4c7c-818c-31dd98bc1a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:27.611718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcd0ee-f227-47dd-adfc-9214e9fc6576 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:27.617713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aae6d-4938-4478-aa24-7f3169b6c11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:27.618516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aae6d-4938-4478-aa24-7f3169b6c11a admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.618801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aae6d-4938-4478-aa24-7f3169b6c11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.619079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aae6d-4938-4478-aa24-7f3169b6c11a admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.619727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996aae6d-4938-4478-aa24-7f3169b6c11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:27.620792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: WARNING py.warnings [None req-996aae6d-4938-4478-aa24-7f3169b6c11a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:10:27.620792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: warnings.warn(msg) Sep 07 16:10:27.620792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: Sep 07 16:10:27.621996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996aae6d-4938-4478-aa24-7f3169b6c11a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:27.624566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 774/1545] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:27.625297 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ab969-8c87-4c7c-818c-31dd98bc1a0a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:27.638298 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ab969-8c87-4c7c-818c-31dd98bc1a0a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:27.649375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fa781-1933-4257-9031-e6a2ae3da26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:27.650001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fa781-1933-4257-9031-e6a2ae3da26d admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.650282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fa781-1933-4257-9031-e6a2ae3da26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.650552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fa781-1933-4257-9031-e6a2ae3da26d admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.651212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fa781-1933-4257-9031-e6a2ae3da26d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:27.651514 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fa781-1933-4257-9031-e6a2ae3da26d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:27.653162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fa781-1933-4257-9031-e6a2ae3da26d admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:27.680595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 775/1546] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:27.681901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323a6ea-294a-48ad-895e-d88334203252 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.682188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323a6ea-294a-48ad-895e-d88334203252 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.682462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323a6ea-294a-48ad-895e-d88334203252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.696502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 772/1547] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:27.697370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aae6d-4938-4478-aa24-7f3169b6c11a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:27.714153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-6323a6ea-294a-48ad-895e-d88334203252 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:27.715363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6323a6ea-294a-48ad-895e-d88334203252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:27.826256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aae6d-4938-4478-aa24-7f3169b6c11a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:27.829788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 776/1548] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:27.830622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323a6ea-294a-48ad-895e-d88334203252 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:27.835870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df9fd8-ef17-4fea-9a2c-bb8fffa60064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:27.836584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9fd8-ef17-4fea-9a2c-bb8fffa60064 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.836974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9fd8-ef17-4fea-9a2c-bb8fffa60064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.837343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9fd8-ef17-4fea-9a2c-bb8fffa60064 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.838069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df9fd8-ef17-4fea-9a2c-bb8fffa60064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:27.840106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df9fd8-ef17-4fea-9a2c-bb8fffa60064 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:27.840784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323a6ea-294a-48ad-895e-d88334203252 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:27.845494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17d377-d0c7-40f2-8fc8-3887dfd5c6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:27.846445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17d377-d0c7-40f2-8fc8-3887dfd5c6bd admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.846725 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17d377-d0c7-40f2-8fc8-3887dfd5c6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.846999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17d377-d0c7-40f2-8fc8-3887dfd5c6bd admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.847635 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17d377-d0c7-40f2-8fc8-3887dfd5c6bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:27.848660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: WARNING py.warnings [None req-0b17d377-d0c7-40f2-8fc8-3887dfd5c6bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:10:27.848660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: warnings.warn(msg) Sep 07 16:10:27.848660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: Sep 07 16:10:27.849888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17d377-d0c7-40f2-8fc8-3887dfd5c6bd admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:27.871040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 773/1549] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:27.872357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82931f54-bc95-4006-8d0e-a9ebf8515f03 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.872772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82931f54-bc95-4006-8d0e-a9ebf8515f03 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.873083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82931f54-bc95-4006-8d0e-a9ebf8515f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.879759 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 777/1550] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:27.881045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50106972-6636-444e-8793-186062e65513 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.881339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50106972-6636-444e-8793-186062e65513 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.882438 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50106972-6636-444e-8793-186062e65513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.893579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-82931f54-bc95-4006-8d0e-a9ebf8515f03 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:27.894785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-82931f54-bc95-4006-8d0e-a9ebf8515f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:27.901483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-50106972-6636-444e-8793-186062e65513 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:27.902672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-50106972-6636-444e-8793-186062e65513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:27.957626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 774/1551] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:27.958956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3029a8-974b-4b3b-a2ed-d60de96c40ba None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.959240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3029a8-974b-4b3b-a2ed-d60de96c40ba None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.959571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3029a8-974b-4b3b-a2ed-d60de96c40ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.968903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 778/1552] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:27.970924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329ca10-b823-4edb-9bc0-6e9cf18cfa80 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:27.971218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329ca10-b823-4edb-9bc0-6e9cf18cfa80 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:27.971493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329ca10-b823-4edb-9bc0-6e9cf18cfa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:27.980415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-fa3029a8-974b-4b3b-a2ed-d60de96c40ba None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:27.981646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-fa3029a8-974b-4b3b-a2ed-d60de96c40ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:27.989687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 775/1553] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:27.993621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3029a8-974b-4b3b-a2ed-d60de96c40ba None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:27.999627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c329ca10-b823-4edb-9bc0-6e9cf18cfa80 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:28.000904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c329ca10-b823-4edb-9bc0-6e9cf18cfa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:28.003369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3029a8-974b-4b3b-a2ed-d60de96c40ba None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.007957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea7a4a-302d-427a-8065-29805a881854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.008551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7a4a-302d-427a-8065-29805a881854 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.008867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7a4a-302d-427a-8065-29805a881854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.009018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 779/1554] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:28.009158 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7a4a-302d-427a-8065-29805a881854 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.009826 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea7a4a-302d-427a-8065-29805a881854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:28.010071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf7c7-49c4-4011-8e9a-f647bc69a79e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.010184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea7a4a-302d-427a-8065-29805a881854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.010352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf7c7-49c4-4011-8e9a-f647bc69a79e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.010626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf7c7-49c4-4011-8e9a-f647bc69a79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.011721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea7a4a-302d-427a-8065-29805a881854 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.028782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 776/1555] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:28.028782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea7a4a-302d-427a-8065-29805a881854 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.037252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea7a4a-302d-427a-8065-29805a881854 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.039862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-dabcf7c7-49c4-4011-8e9a-f647bc69a79e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:28.041100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-dabcf7c7-49c4-4011-8e9a-f647bc69a79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:28.042409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f042c8e-d08f-4914-a766-c1644a1619ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.043000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f042c8e-d08f-4914-a766-c1644a1619ac admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.043275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f042c8e-d08f-4914-a766-c1644a1619ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.043544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f042c8e-d08f-4914-a766-c1644a1619ac admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.044171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f042c8e-d08f-4914-a766-c1644a1619ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.046099 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f042c8e-d08f-4914-a766-c1644a1619ac admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.048984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 780/1556] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:28.054170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf7c7-49c4-4011-8e9a-f647bc69a79e None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.063492 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:28.067035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf7c7-49c4-4011-8e9a-f647bc69a79e None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.072468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ed141-86cd-4c71-8612-60164069e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.073117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ed141-86cd-4c71-8612-60164069e8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.073281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 777/1557] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/users => generated 303 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.073388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ed141-86cd-4c71-8612-60164069e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.073657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ed141-86cd-4c71-8612-60164069e8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.074302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ed141-86cd-4c71-8612-60164069e8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.074862 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232320d-a878-4c7b-af64-722b3ada54cb None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.075278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232320d-a878-4c7b-af64-722b3ada54cb None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.075558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232320d-a878-4c7b-af64-722b3ada54cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.076162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ed141-86cd-4c71-8612-60164069e8c0 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.087096 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 781/1558] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:28.088317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df279730-c276-4a8b-8997-9c91ec5632c8 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.088607 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df279730-c276-4a8b-8997-9c91ec5632c8 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.088910 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df279730-c276-4a8b-8997-9c91ec5632c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.096253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-c232320d-a878-4c7b-af64-722b3ada54cb None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:28.097505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c232320d-a878-4c7b-af64-722b3ada54cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:28.106039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 778/1559] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:28.107304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17798cf-afcc-4ece-82c9-ede38d8cbe3c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.107585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17798cf-afcc-4ece-82c9-ede38d8cbe3c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.107857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17798cf-afcc-4ece-82c9-ede38d8cbe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.111363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-df279730-c276-4a8b-8997-9c91ec5632c8 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:28.112565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-df279730-c276-4a8b-8997-9c91ec5632c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:28.122665 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 782/1560] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:28.123619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39abb94-8b5d-43cc-b47c-12ff3714d1e7 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.123891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39abb94-8b5d-43cc-b47c-12ff3714d1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.124151 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39abb94-8b5d-43cc-b47c-12ff3714d1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.127794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f17798cf-afcc-4ece-82c9-ede38d8cbe3c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:28.129026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f17798cf-afcc-4ece-82c9-ede38d8cbe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:28.137562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 779/1561] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:28.138381 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17798cf-afcc-4ece-82c9-ede38d8cbe3c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.143474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b39abb94-8b5d-43cc-b47c-12ff3714d1e7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:28.144652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b39abb94-8b5d-43cc-b47c-12ff3714d1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:28.148613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17798cf-afcc-4ece-82c9-ede38d8cbe3c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.152715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 783/1562] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:28.154396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e16f5-a142-4a42-925f-338dc7d699c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.154548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d653ad-11b9-4d7f-8e59-f248f31c7f6c None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.154651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e16f5-a142-4a42-925f-338dc7d699c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.154748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d653ad-11b9-4d7f-8e59-f248f31c7f6c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.154839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e16f5-a142-4a42-925f-338dc7d699c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.154927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d653ad-11b9-4d7f-8e59-f248f31c7f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.155003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e16f5-a142-4a42-925f-338dc7d699c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.155234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e16f5-a142-4a42-925f-338dc7d699c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.157453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e16f5-a142-4a42-925f-338dc7d699c6 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.169376 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:28.175137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-82d653ad-11b9-4d7f-8e59-f248f31c7f6c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:28.176899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-82d653ad-11b9-4d7f-8e59-f248f31c7f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:28.185954 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 784/1563] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:28.186741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d653ad-11b9-4d7f-8e59-f248f31c7f6c None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.187582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 780/1564] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.188466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e16f5-a142-4a42-925f-338dc7d699c6 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.199480 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d653ad-11b9-4d7f-8e59-f248f31c7f6c None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.251857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e16f5-a142-4a42-925f-338dc7d699c6 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.255773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e34db7-d402-47bb-aa2f-c4b1fc760f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.256385 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e34db7-d402-47bb-aa2f-c4b1fc760f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.257143 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a9d85-61d0-4434-9f44-e9ed0fbced99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.257772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e34db7-d402-47bb-aa2f-c4b1fc760f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.257908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a9d85-61d0-4434-9f44-e9ed0fbced99 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.258059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e34db7-d402-47bb-aa2f-c4b1fc760f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.258166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a9d85-61d0-4434-9f44-e9ed0fbced99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.258354 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a9d85-61d0-4434-9f44-e9ed0fbced99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.258712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e34db7-d402-47bb-aa2f-c4b1fc760f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.258993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a9d85-61d0-4434-9f44-e9ed0fbced99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.260314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e34db7-d402-47bb-aa2f-c4b1fc760f59 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.260579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a9d85-61d0-4434-9f44-e9ed0fbced99 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.270476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 781/1565] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:28.271318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a9d85-61d0-4434-9f44-e9ed0fbced99 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.275560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 785/1566] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:28.275560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e34db7-d402-47bb-aa2f-c4b1fc760f59 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.283577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e34db7-d402-47bb-aa2f-c4b1fc760f59 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.285159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a9d85-61d0-4434-9f44-e9ed0fbced99 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.289033 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa8bc3-7d75-45f0-8134-9fc038a78896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.289630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa8bc3-7d75-45f0-8134-9fc038a78896 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.289911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa8bc3-7d75-45f0-8134-9fc038a78896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.290189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa8bc3-7d75-45f0-8134-9fc038a78896 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.290408 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2a63e-303c-4439-984a-bbe1c6fcd629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.290820 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa8bc3-7d75-45f0-8134-9fc038a78896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:28.291000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2a63e-303c-4439-984a-bbe1c6fcd629 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.291106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa8bc3-7d75-45f0-8134-9fc038a78896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.291281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2a63e-303c-4439-984a-bbe1c6fcd629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.291556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2a63e-303c-4439-984a-bbe1c6fcd629 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.292189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2a63e-303c-4439-984a-bbe1c6fcd629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:28.292493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2a63e-303c-4439-984a-bbe1c6fcd629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.292719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa8bc3-7d75-45f0-8134-9fc038a78896 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.294092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2a63e-303c-4439-984a-bbe1c6fcd629 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.306388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 786/1567] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:28.307199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa8bc3-7d75-45f0-8134-9fc038a78896 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.313705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 782/1568] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:28.314569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2a63e-303c-4439-984a-bbe1c6fcd629 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.317854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa8bc3-7d75-45f0-8134-9fc038a78896 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.323675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5b480-fabe-4b30-97ac-8d3bc76e1a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.324270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5b480-fabe-4b30-97ac-8d3bc76e1a05 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.324549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5b480-fabe-4b30-97ac-8d3bc76e1a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.324857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5b480-fabe-4b30-97ac-8d3bc76e1a05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.325090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2a63e-303c-4439-984a-bbe1c6fcd629 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.325505 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5b480-fabe-4b30-97ac-8d3bc76e1a05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:28.325805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5b480-fabe-4b30-97ac-8d3bc76e1a05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.327393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5b480-fabe-4b30-97ac-8d3bc76e1a05 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.329659 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d6859-b449-413b-a72f-d048b70a5df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.330250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d6859-b449-413b-a72f-d048b70a5df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.330532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d6859-b449-413b-a72f-d048b70a5df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.330805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d6859-b449-413b-a72f-d048b70a5df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.331441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d6859-b449-413b-a72f-d048b70a5df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:28.331742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d6859-b449-413b-a72f-d048b70a5df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.333338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d6859-b449-413b-a72f-d048b70a5df0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.339950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 787/1569] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:28.340842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5b480-fabe-4b30-97ac-8d3bc76e1a05 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.350077 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5b480-fabe-4b30-97ac-8d3bc76e1a05 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.350706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 783/1570] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:28.353579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d6859-b449-413b-a72f-d048b70a5df0 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.361830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d742e11-df61-4829-92d5-52ed9edfe7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.362458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d742e11-df61-4829-92d5-52ed9edfe7dc admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.362736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d742e11-df61-4829-92d5-52ed9edfe7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.363001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d742e11-df61-4829-92d5-52ed9edfe7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.363203 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d6859-b449-413b-a72f-d048b70a5df0 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.363653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d742e11-df61-4829-92d5-52ed9edfe7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:28.363958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d742e11-df61-4829-92d5-52ed9edfe7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.365702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d742e11-df61-4829-92d5-52ed9edfe7dc admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.368413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bf440-dff8-495d-90aa-740530d84825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.369029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf440-dff8-495d-90aa-740530d84825 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.369314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf440-dff8-495d-90aa-740530d84825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.369590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf440-dff8-495d-90aa-740530d84825 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.370216 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bf440-dff8-495d-90aa-740530d84825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.372112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bf440-dff8-495d-90aa-740530d84825 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.379260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 788/1571] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:28.380289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d742e11-df61-4829-92d5-52ed9edfe7dc admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.392402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d742e11-df61-4829-92d5-52ed9edfe7dc admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.400411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b42ce7-52ea-4e16-b02d-61b7076b4a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.400619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 784/1572] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/users => generated 301 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.401109 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b42ce7-52ea-4e16-b02d-61b7076b4a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.401397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b42ce7-52ea-4e16-b02d-61b7076b4a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.401571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bf440-dff8-495d-90aa-740530d84825 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.401677 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b42ce7-52ea-4e16-b02d-61b7076b4a1e admin admin] PATH_INFO: `/v3/projects/2ecff0ddcede49f68a64f0ba57048847/users/e181e79d294845dd88c91a9dff2831f2/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.413271 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bf440-dff8-495d-90aa-740530d84825 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.417997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c96d8e-ae47-4b5c-84a1-fcaf554a7c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.418553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b42ce7-52ea-4e16-b02d-61b7076b4a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ecff0ddcede49f68a64f0ba57048847, user_id=e181e79d294845dd88c91a9dff2831f2, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.418669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c96d8e-ae47-4b5c-84a1-fcaf554a7c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.418950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c96d8e-ae47-4b5c-84a1-fcaf554a7c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.419221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c96d8e-ae47-4b5c-84a1-fcaf554a7c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.419911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c96d8e-ae47-4b5c-84a1-fcaf554a7c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.421263 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b42ce7-52ea-4e16-b02d-61b7076b4a1e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.421521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c96d8e-ae47-4b5c-84a1-fcaf554a7c6d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.432729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 785/1573] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:28.433513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c96d8e-ae47-4b5c-84a1-fcaf554a7c6d admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.436078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 789/1574] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:28 2022] PUT /identity/v3/projects/2ecff0ddcede49f68a64f0ba57048847/users/e181e79d294845dd88c91a9dff2831f2/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:28.436892 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b42ce7-52ea-4e16-b02d-61b7076b4a1e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.445004 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c96d8e-ae47-4b5c-84a1-fcaf554a7c6d admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.500020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b42ce7-52ea-4e16-b02d-61b7076b4a1e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.502564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23beab-eb38-4041-8daa-c03e9b97a9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.503178 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23beab-eb38-4041-8daa-c03e9b97a9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.503459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23beab-eb38-4041-8daa-c03e9b97a9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.503737 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23beab-eb38-4041-8daa-c03e9b97a9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.504372 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23beab-eb38-4041-8daa-c03e9b97a9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.504911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2dd1c-5f1e-4add-a442-7eed221cd291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.505516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2dd1c-5f1e-4add-a442-7eed221cd291 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.505796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2dd1c-5f1e-4add-a442-7eed221cd291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.506069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2dd1c-5f1e-4add-a442-7eed221cd291 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.506311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23beab-eb38-4041-8daa-c03e9b97a9c5 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.506779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2dd1c-5f1e-4add-a442-7eed221cd291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.508696 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2dd1c-5f1e-4add-a442-7eed221cd291 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.517122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:28.537329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 790/1575] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.540988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 786/1576] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.541140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2dd1c-5f1e-4add-a442-7eed221cd291 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.541228 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23beab-eb38-4041-8daa-c03e9b97a9c5 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.561904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:28.604715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23beab-eb38-4041-8daa-c03e9b97a9c5 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.605686 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2dd1c-5f1e-4add-a442-7eed221cd291 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.609556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a5ee7-548f-48e3-bec1-6259f0bf1bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.610164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a5ee7-548f-48e3-bec1-6259f0bf1bfd admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.610294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c691d-582d-4523-be99-e6f534fb59c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.610467 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a5ee7-548f-48e3-bec1-6259f0bf1bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.610766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c691d-582d-4523-be99-e6f534fb59c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.610867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a5ee7-548f-48e3-bec1-6259f0bf1bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.611046 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c691d-582d-4523-be99-e6f534fb59c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.611317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c691d-582d-4523-be99-e6f534fb59c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.611464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a5ee7-548f-48e3-bec1-6259f0bf1bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.611938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c691d-582d-4523-be99-e6f534fb59c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.613431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a5ee7-548f-48e3-bec1-6259f0bf1bfd admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.613857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c691d-582d-4523-be99-e6f534fb59c6 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.641694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 791/1577] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.642028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 787/1578] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.642728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c691d-582d-4523-be99-e6f534fb59c6 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.643371 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a5ee7-548f-48e3-bec1-6259f0bf1bfd admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.707978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a5ee7-548f-48e3-bec1-6259f0bf1bfd admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.709040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c691d-582d-4523-be99-e6f534fb59c6 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.712901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab877e5e-ca90-46a0-8c79-87245e9302b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.713509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab877e5e-ca90-46a0-8c79-87245e9302b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.713798 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab877e5e-ca90-46a0-8c79-87245e9302b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.714077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab877e5e-ca90-46a0-8c79-87245e9302b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.714193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7a435-b090-451a-9987-db3be9b754c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.714720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab877e5e-ca90-46a0-8c79-87245e9302b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.714919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7a435-b090-451a-9987-db3be9b754c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.715053 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7a435-b090-451a-9987-db3be9b754c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.715335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7a435-b090-451a-9987-db3be9b754c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.715995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7a435-b090-451a-9987-db3be9b754c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.716312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab877e5e-ca90-46a0-8c79-87245e9302b5 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.717920 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7a435-b090-451a-9987-db3be9b754c0 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.726838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 788/1579] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:28.727627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab877e5e-ca90-46a0-8c79-87245e9302b5 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.738352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab877e5e-ca90-46a0-8c79-87245e9302b5 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.744890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1d410-7903-4c26-b6bb-4b5c08701518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.745551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1d410-7903-4c26-b6bb-4b5c08701518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.745866 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1d410-7903-4c26-b6bb-4b5c08701518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.746101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1d410-7903-4c26-b6bb-4b5c08701518 admin admin] PATH_INFO: `/v3/projects/d791ee9517ba4d90a600825d27214d37/users/ccab69ee603d48ba9126c9ef4532a40f/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.751103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 792/1580] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/projects => generated 361 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.752926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e684be-a163-4993-a4de-b7748eb8a1b0 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.753215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e684be-a163-4993-a4de-b7748eb8a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.753487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e684be-a163-4993-a4de-b7748eb8a1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.763015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1d410-7903-4c26-b6bb-4b5c08701518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d791ee9517ba4d90a600825d27214d37, user_id=ccab69ee603d48ba9126c9ef4532a40f, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.764059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: WARNING py.warnings [None req-90f1d410-7903-4c26-b6bb-4b5c08701518 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:10:28.764059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: warnings.warn(msg) Sep 07 16:10:28.764059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: Sep 07 16:10:28.766625 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1d410-7903-4c26-b6bb-4b5c08701518 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.772093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-96e684be-a163-4993-a4de-b7748eb8a1b0 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:28.774143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-96e684be-a163-4993-a4de-b7748eb8a1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:28.781853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 789/1581] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:28 2022] PUT /identity/v3/projects/d791ee9517ba4d90a600825d27214d37/users/ccab69ee603d48ba9126c9ef4532a40f/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:28.786409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1d410-7903-4c26-b6bb-4b5c08701518 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.835149 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 793/1582] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:28.836188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e684be-a163-4993-a4de-b7748eb8a1b0 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.836547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:28.847735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e684be-a163-4993-a4de-b7748eb8a1b0 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.853668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1b8c9-00d7-416a-92af-b9bd1a90dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.854273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1b8c9-00d7-416a-92af-b9bd1a90dc1c admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.854556 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1b8c9-00d7-416a-92af-b9bd1a90dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.854859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1b8c9-00d7-416a-92af-b9bd1a90dc1c admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.854964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1d410-7903-4c26-b6bb-4b5c08701518 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.855502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1b8c9-00d7-416a-92af-b9bd1a90dc1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.857496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1b8c9-00d7-416a-92af-b9bd1a90dc1c admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.859545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0642-402a-4243-ab37-c0abf2a51f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.860200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0642-402a-4243-ab37-c0abf2a51f7b admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.860512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0642-402a-4243-ab37-c0abf2a51f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.860815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0642-402a-4243-ab37-c0abf2a51f7b admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.861443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f0642-402a-4243-ab37-c0abf2a51f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.863365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f0642-402a-4243-ab37-c0abf2a51f7b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.883893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 794/1583] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/users => generated 282 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.883893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1b8c9-00d7-416a-92af-b9bd1a90dc1c admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.888372 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 790/1584] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.888372 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0642-402a-4243-ab37-c0abf2a51f7b admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.893738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1b8c9-00d7-416a-92af-b9bd1a90dc1c admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.895801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0642-402a-4243-ab37-c0abf2a51f7b admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.902002 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f1d08-4a40-4b4b-937d-0d57dbef3a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.902588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f1d08-4a40-4b4b-937d-0d57dbef3a7a admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.902786 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2580e80-cc95-469d-8992-bf037cb65d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.902906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f1d08-4a40-4b4b-937d-0d57dbef3a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.903159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f1d08-4a40-4b4b-937d-0d57dbef3a7a admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.903490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2580e80-cc95-469d-8992-bf037cb65d01 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.903776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2580e80-cc95-469d-8992-bf037cb65d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.903888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f1d08-4a40-4b4b-937d-0d57dbef3a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.904053 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2580e80-cc95-469d-8992-bf037cb65d01 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.904709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2580e80-cc95-469d-8992-bf037cb65d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.905742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f1d08-4a40-4b4b-937d-0d57dbef3a7a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.906917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2580e80-cc95-469d-8992-bf037cb65d01 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.917635 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:28.928540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 791/1585] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.932549 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f1d08-4a40-4b4b-937d-0d57dbef3a7a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.934227 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 795/1586] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/users => generated 290 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.935142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2580e80-cc95-469d-8992-bf037cb65d01 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.942655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f1d08-4a40-4b4b-937d-0d57dbef3a7a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.947242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2580e80-cc95-469d-8992-bf037cb65d01 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:28.948113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4fa90-460d-4db6-a684-04d22fca6575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.948745 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4fa90-460d-4db6-a684-04d22fca6575 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.949037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4fa90-460d-4db6-a684-04d22fca6575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.949310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4fa90-460d-4db6-a684-04d22fca6575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.949951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4fa90-460d-4db6-a684-04d22fca6575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.951549 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4fa90-460d-4db6-a684-04d22fca6575 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.952453 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22853d-a6c3-405e-bd2c-6629c997eb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:28.953310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22853d-a6c3-405e-bd2c-6629c997eb0c admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.953696 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22853d-a6c3-405e-bd2c-6629c997eb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.954075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22853d-a6c3-405e-bd2c-6629c997eb0c admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.954706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22853d-a6c3-405e-bd2c-6629c997eb0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:28.956666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22853d-a6c3-405e-bd2c-6629c997eb0c admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:28.962684 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 792/1587] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:28.963886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa231c3-d819-4cb0-a49e-29aff8860825 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:28.964175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa231c3-d819-4cb0-a49e-29aff8860825 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:28.964455 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa231c3-d819-4cb0-a49e-29aff8860825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:28.984389 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 796/1588] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/users => generated 281 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:28.984389 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22853d-a6c3-405e-bd2c-6629c997eb0c admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:28.984389 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2b22853d-a6c3-405e-bd2c-6629c997eb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:28.984837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-bfa231c3-d819-4cb0-a49e-29aff8860825 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:28.985686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-bfa231c3-d819-4cb0-a49e-29aff8860825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:28.994630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 793/1589] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:28.995288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa231c3-d819-4cb0-a49e-29aff8860825 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.004812 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa231c3-d819-4cb0-a49e-29aff8860825 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.010181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d365ade-944b-433c-99ad-35f2dc0d5163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.010788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d365ade-944b-433c-99ad-35f2dc0d5163 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.011195 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d365ade-944b-433c-99ad-35f2dc0d5163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.011477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d365ade-944b-433c-99ad-35f2dc0d5163 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.012142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d365ade-944b-433c-99ad-35f2dc0d5163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.013819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d365ade-944b-433c-99ad-35f2dc0d5163 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.026042 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 794/1590] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:29.027023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d365ade-944b-433c-99ad-35f2dc0d5163 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.037240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d365ade-944b-433c-99ad-35f2dc0d5163 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.043014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdbfca-0971-4cb4-b78b-300a5e480378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.043612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdbfca-0971-4cb4-b78b-300a5e480378 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.043925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdbfca-0971-4cb4-b78b-300a5e480378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.044247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdbfca-0971-4cb4-b78b-300a5e480378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.044929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdbfca-0971-4cb4-b78b-300a5e480378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.046339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22853d-a6c3-405e-bd2c-6629c997eb0c admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.046552 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdbfca-0971-4cb4-b78b-300a5e480378 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.050413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7f064-c090-4766-9f23-a1dbf1bb646d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.051039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7f064-c090-4766-9f23-a1dbf1bb646d service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.051313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7f064-c090-4766-9f23-a1dbf1bb646d service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.051590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7f064-c090-4766-9f23-a1dbf1bb646d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.059282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 795/1591] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:29.060846 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdbfca-0971-4cb4-b78b-300a5e480378 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.062469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7f064-c090-4766-9f23-a1dbf1bb646d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.063931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7f064-c090-4766-9f23-a1dbf1bb646d service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.071052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdbfca-0971-4cb4-b78b-300a5e480378 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.074955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 797/1592] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:29.075867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7f064-c090-4766-9f23-a1dbf1bb646d service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.077756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327416da-3f79-4e1d-84f4-a43ec98295f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.078702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327416da-3f79-4e1d-84f4-a43ec98295f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.078990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327416da-3f79-4e1d-84f4-a43ec98295f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.079264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327416da-3f79-4e1d-84f4-a43ec98295f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.079906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327416da-3f79-4e1d-84f4-a43ec98295f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.081807 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327416da-3f79-4e1d-84f4-a43ec98295f0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.086074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7f064-c090-4766-9f23-a1dbf1bb646d service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.091204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea8a85-ee1c-4219-b5aa-86b72bcdaa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.092170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea8a85-ee1c-4219-b5aa-86b72bcdaa9e admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.092471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea8a85-ee1c-4219-b5aa-86b72bcdaa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.092765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea8a85-ee1c-4219-b5aa-86b72bcdaa9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.093423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea8a85-ee1c-4219-b5aa-86b72bcdaa9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.095224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea8a85-ee1c-4219-b5aa-86b72bcdaa9e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.096142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 796/1593] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:29.100200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327416da-3f79-4e1d-84f4-a43ec98295f0 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.110580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 798/1594] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:29.110580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea8a85-ee1c-4219-b5aa-86b72bcdaa9e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.112832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327416da-3f79-4e1d-84f4-a43ec98295f0 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.118670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a686c5-344b-402f-8995-492016a3f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.118844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea8a85-ee1c-4219-b5aa-86b72bcdaa9e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.119377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a686c5-344b-402f-8995-492016a3f1e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.119801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a686c5-344b-402f-8995-492016a3f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.120082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a686c5-344b-402f-8995-492016a3f1e3 admin admin] PATH_INFO: `/v3/projects/b8283e3e5acc4a4e885e1ab4c11fffac/users/822be3c971414ebab25b25f7d1229fae/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.123938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325c783-9b3e-4cfd-a90a-2801880b9281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.124557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325c783-9b3e-4cfd-a90a-2801880b9281 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.124874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325c783-9b3e-4cfd-a90a-2801880b9281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.125154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325c783-9b3e-4cfd-a90a-2801880b9281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.125804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325c783-9b3e-4cfd-a90a-2801880b9281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.127437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325c783-9b3e-4cfd-a90a-2801880b9281 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.137609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a686c5-344b-402f-8995-492016a3f1e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8283e3e5acc4a4e885e1ab4c11fffac, user_id=822be3c971414ebab25b25f7d1229fae, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.138205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 799/1595] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:29.138855 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325c783-9b3e-4cfd-a90a-2801880b9281 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.143159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a686c5-344b-402f-8995-492016a3f1e3 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.150005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325c783-9b3e-4cfd-a90a-2801880b9281 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.154039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3c43e-2be8-4c73-9348-b8745800d3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.154832 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c43e-2be8-4c73-9348-b8745800d3ee service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.154960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c43e-2be8-4c73-9348-b8745800d3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.155247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3c43e-2be8-4c73-9348-b8745800d3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.160777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 797/1596] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:29 2022] PUT /identity/v3/projects/b8283e3e5acc4a4e885e1ab4c11fffac/users/822be3c971414ebab25b25f7d1229fae/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:29.161845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a686c5-344b-402f-8995-492016a3f1e3 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.176801 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3c43e-2be8-4c73-9348-b8745800d3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.178520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3c43e-2be8-4c73-9348-b8745800d3ee service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.190427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 800/1597] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:29.191233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3c43e-2be8-4c73-9348-b8745800d3ee service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.200725 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3c43e-2be8-4c73-9348-b8745800d3ee service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.243592 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a686c5-344b-402f-8995-492016a3f1e3 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.248854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa548a-8747-4ea9-bfab-69398c63fe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.249557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa548a-8747-4ea9-bfab-69398c63fe70 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.249896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa548a-8747-4ea9-bfab-69398c63fe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.250268 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa548a-8747-4ea9-bfab-69398c63fe70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.251319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa548a-8747-4ea9-bfab-69398c63fe70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.252710 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa548a-8747-4ea9-bfab-69398c63fe70 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.266962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 798/1598] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:29.267977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa548a-8747-4ea9-bfab-69398c63fe70 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.268156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d0119-8476-408f-ae40-d6fa661c1e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.268634 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0119-8476-408f-ae40-d6fa661c1e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.269523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0119-8476-408f-ae40-d6fa661c1e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.269808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0119-8476-408f-ae40-d6fa661c1e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.270469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d0119-8476-408f-ae40-d6fa661c1e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.272776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d0119-8476-408f-ae40-d6fa661c1e7e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.279988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa548a-8747-4ea9-bfab-69398c63fe70 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.285268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 801/1599] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:29.285424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b28db-3c2d-4adc-adba-09ad77d7a534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.285860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b28db-3c2d-4adc-adba-09ad77d7a534 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.285969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d0119-8476-408f-ae40-d6fa661c1e7e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.286264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b28db-3c2d-4adc-adba-09ad77d7a534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.286501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b28db-3c2d-4adc-adba-09ad77d7a534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.287134 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b28db-3c2d-4adc-adba-09ad77d7a534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.289594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b28db-3c2d-4adc-adba-09ad77d7a534 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.297473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d0119-8476-408f-ae40-d6fa661c1e7e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.301998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 799/1600] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:29.301998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b28db-3c2d-4adc-adba-09ad77d7a534 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.306428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d8d37-4ff2-48c8-a422-2db2a7129519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.307150 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d8d37-4ff2-48c8-a422-2db2a7129519 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.307542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d8d37-4ff2-48c8-a422-2db2a7129519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.307944 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d8d37-4ff2-48c8-a422-2db2a7129519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.308896 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d8d37-4ff2-48c8-a422-2db2a7129519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.311734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d8d37-4ff2-48c8-a422-2db2a7129519 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.314234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b28db-3c2d-4adc-adba-09ad77d7a534 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.320652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269028b-4cc2-4cc5-94ad-429a94bc660c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.320860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269028b-4cc2-4cc5-94ad-429a94bc660c admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.321178 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269028b-4cc2-4cc5-94ad-429a94bc660c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.321511 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269028b-4cc2-4cc5-94ad-429a94bc660c admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.322304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269028b-4cc2-4cc5-94ad-429a94bc660c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.324089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269028b-4cc2-4cc5-94ad-429a94bc660c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.325549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 802/1601] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:29.327133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f2513-fed1-4c65-a258-6a00be1ed8cd None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.327423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f2513-fed1-4c65-a258-6a00be1ed8cd None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.327736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f2513-fed1-4c65-a258-6a00be1ed8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.337867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 800/1602] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:29.339048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269028b-4cc2-4cc5-94ad-429a94bc660c admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.353274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269028b-4cc2-4cc5-94ad-429a94bc660c admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.363373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b7c48-5edc-4f6f-9a48-5f83a8084ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.364436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b7c48-5edc-4f6f-9a48-5f83a8084ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.364984 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b7c48-5edc-4f6f-9a48-5f83a8084ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.365670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b7c48-5edc-4f6f-9a48-5f83a8084ff9 admin admin] PATH_INFO: `/v3/projects/ed6f4338045b412da87fafecc1289f0a/users/47c1cec893a440d7acef2516b5d6a587/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.366705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f39f2513-fed1-4c65-a258-6a00be1ed8cd None None] MFA Rules not processed for user `822be3c971414ebab25b25f7d1229fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:29.368846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f39f2513-fed1-4c65-a258-6a00be1ed8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:29.389531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:29.391483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b7c48-5edc-4f6f-9a48-5f83a8084ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6f4338045b412da87fafecc1289f0a, user_id=47c1cec893a440d7acef2516b5d6a587, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.394943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b7c48-5edc-4f6f-9a48-5f83a8084ff9 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.399853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:29.424775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 801/1603] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:29 2022] PUT /identity/v3/projects/ed6f4338045b412da87fafecc1289f0a/users/47c1cec893a440d7acef2516b5d6a587/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:29.430157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b7c48-5edc-4f6f-9a48-5f83a8084ff9 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.494051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 803/1604] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:29.498563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f2513-fed1-4c65-a258-6a00be1ed8cd None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.510069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b7c48-5edc-4f6f-9a48-5f83a8084ff9 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.511187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f2513-fed1-4c65-a258-6a00be1ed8cd None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.515252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b68e2-3e2b-4c6b-8c4b-6998f8fc4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.516075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b68e2-3e2b-4c6b-8c4b-6998f8fc4c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.516202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4880e-e883-4eb7-bc5c-2068abb902c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.516373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b68e2-3e2b-4c6b-8c4b-6998f8fc4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.516780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4880e-e883-4eb7-bc5c-2068abb902c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.516896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b68e2-3e2b-4c6b-8c4b-6998f8fc4c0c admin admin] PATH_INFO: `/v3/projects/2ef0175bf6234bcaa8d5cd28faaed9ad/users/813248aa4fa34ea28f049dde1ffebd50/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.517060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4880e-e883-4eb7-bc5c-2068abb902c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.517345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4880e-e883-4eb7-bc5c-2068abb902c6 admin admin] PATH_INFO: `/v3/projects/9229025e7cfd412caee76c1154f1b15e/users/6ddf97a836074da89dacb0d8029e2165/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.535105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b68e2-3e2b-4c6b-8c4b-6998f8fc4c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef0175bf6234bcaa8d5cd28faaed9ad, user_id=813248aa4fa34ea28f049dde1ffebd50, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.535807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4880e-e883-4eb7-bc5c-2068abb902c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9229025e7cfd412caee76c1154f1b15e, user_id=6ddf97a836074da89dacb0d8029e2165, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.538847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b68e2-3e2b-4c6b-8c4b-6998f8fc4c0c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.539816 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4880e-e883-4eb7-bc5c-2068abb902c6 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.555734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 802/1605] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:29 2022] PUT /identity/v3/projects/2ef0175bf6234bcaa8d5cd28faaed9ad/users/813248aa4fa34ea28f049dde1ffebd50/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:29.556462 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b68e2-3e2b-4c6b-8c4b-6998f8fc4c0c admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.557308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 804/1606] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:29 2022] PUT /identity/v3/projects/9229025e7cfd412caee76c1154f1b15e/users/6ddf97a836074da89dacb0d8029e2165/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:29.557992 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4880e-e883-4eb7-bc5c-2068abb902c6 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.635948 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b68e2-3e2b-4c6b-8c4b-6998f8fc4c0c admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.636145 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4880e-e883-4eb7-bc5c-2068abb902c6 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.641198 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4ccc1-98bf-4862-b7f7-b67134443458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.641341 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5a417-0df7-484c-befc-478a58ec4e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.641748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4ccc1-98bf-4862-b7f7-b67134443458 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.642065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5a417-0df7-484c-befc-478a58ec4e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.642185 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4ccc1-98bf-4862-b7f7-b67134443458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.642695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5a417-0df7-484c-befc-478a58ec4e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.642802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4ccc1-98bf-4862-b7f7-b67134443458 admin admin] PATH_INFO: `/v3/projects/f7d7979b33b74bf4ad50d65f6e0d72a1/users/4183249aa90b4d42937d336e629dd5f9/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.642895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5a417-0df7-484c-befc-478a58ec4e53 admin admin] PATH_INFO: `/v3/projects/3ad402b5380b4f2da2137bf09fb23783/users/a82ffedb9d854ad0a5044c5cbec62ca4/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.662241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5a417-0df7-484c-befc-478a58ec4e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad402b5380b4f2da2137bf09fb23783, user_id=a82ffedb9d854ad0a5044c5cbec62ca4, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.666932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5a417-0df7-484c-befc-478a58ec4e53 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.667351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4ccc1-98bf-4862-b7f7-b67134443458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d7979b33b74bf4ad50d65f6e0d72a1, user_id=4183249aa90b4d42937d336e629dd5f9, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.670570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4ccc1-98bf-4862-b7f7-b67134443458 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.684886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 803/1607] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:29 2022] PUT /identity/v3/projects/3ad402b5380b4f2da2137bf09fb23783/users/a82ffedb9d854ad0a5044c5cbec62ca4/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:29.686746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 805/1608] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:29 2022] PUT /identity/v3/projects/f7d7979b33b74bf4ad50d65f6e0d72a1/users/4183249aa90b4d42937d336e629dd5f9/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:29.687252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b843f8-f307-44cb-9e01-04be89be8e4d None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.687727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b843f8-f307-44cb-9e01-04be89be8e4d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.687841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4ccc1-98bf-4862-b7f7-b67134443458 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:29.688506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b843f8-f307-44cb-9e01-04be89be8e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.726566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-25b843f8-f307-44cb-9e01-04be89be8e4d None None] MFA Rules not processed for user `47c1cec893a440d7acef2516b5d6a587`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:29.727907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-25b843f8-f307-44cb-9e01-04be89be8e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:29.782842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4ccc1-98bf-4862-b7f7-b67134443458 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:29.802961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8879380-654b-42e8-aa47-24892c36bcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:29.804607 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8879380-654b-42e8-aa47-24892c36bcfd admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.805968 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8879380-654b-42e8-aa47-24892c36bcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.806380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8879380-654b-42e8-aa47-24892c36bcfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.808706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8879380-654b-42e8-aa47-24892c36bcfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:29.809728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:29.818482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8879380-654b-42e8-aa47-24892c36bcfd admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:29.835637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 804/1609] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:29.837482 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc797d-4f4f-43d3-a871-c10e06b21c2a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.837877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc797d-4f4f-43d3-a871-c10e06b21c2a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.838259 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc797d-4f4f-43d3-a871-c10e06b21c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.866563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-d5cc797d-4f4f-43d3-a871-c10e06b21c2a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:29.868319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d5cc797d-4f4f-43d3-a871-c10e06b21c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:29.879379 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 806/1610] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:29 2022] POST /identity/v3/projects => generated 403 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:29.880080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 805/1611] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:29.882730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b1d2-b495-4671-bd2d-fa8ddca08524 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.883121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b1d2-b495-4671-bd2d-fa8ddca08524 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.883541 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b1d2-b495-4671-bd2d-fa8ddca08524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.885546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebfb93-b3b3-400e-87d2-74cf2279c634 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:29.885828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebfb93-b3b3-400e-87d2-74cf2279c634 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:29.886109 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebfb93-b3b3-400e-87d2-74cf2279c634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:29.907061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:29.915539 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b2b4b1d2-b495-4671-bd2d-fa8ddca08524 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:29.919206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b2b4b1d2-b495-4671-bd2d-fa8ddca08524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:29.955660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-0aebfb93-b3b3-400e-87d2-74cf2279c634 None None] MFA Rules not processed for user `813248aa4fa34ea28f049dde1ffebd50`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:29.956916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0aebfb93-b3b3-400e-87d2-74cf2279c634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:30.068410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 807/1612] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:30.072815 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0615c0f-6d57-47bd-a8a2-384b3cad174d None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.074500 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0615c0f-6d57-47bd-a8a2-384b3cad174d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.075421 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0615c0f-6d57-47bd-a8a2-384b3cad174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.078457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 806/1613] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:30.079374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4b1d2-b495-4671-bd2d-fa8ddca08524 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:30.091424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4b1d2-b495-4671-bd2d-fa8ddca08524 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:30.096510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3177c-060e-43c3-9ce0-5c0c7932c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:30.097235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3177c-060e-43c3-9ce0-5c0c7932c8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.097521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3177c-060e-43c3-9ce0-5c0c7932c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.097819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3177c-060e-43c3-9ce0-5c0c7932c8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.098469 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3177c-060e-43c3-9ce0-5c0c7932c8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:30.101751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3177c-060e-43c3-9ce0-5c0c7932c8a7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:30.122179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b0615c0f-6d57-47bd-a8a2-384b3cad174d None None] MFA Rules not processed for user `4183249aa90b4d42937d336e629dd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:30.124057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b0615c0f-6d57-47bd-a8a2-384b3cad174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:30.155867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 807/1614] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:30 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:30.157204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3177c-060e-43c3-9ce0-5c0c7932c8a7 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:30.223683 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 808/1615] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:30.224629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0615c0f-6d57-47bd-a8a2-384b3cad174d None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:30.272744 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3177c-060e-43c3-9ce0-5c0c7932c8a7 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:30.280067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab60cc2-378b-4c32-912d-59696409e2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:30.281386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab60cc2-378b-4c32-912d-59696409e2db admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.281765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab60cc2-378b-4c32-912d-59696409e2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.282136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab60cc2-378b-4c32-912d-59696409e2db admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.283195 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab60cc2-378b-4c32-912d-59696409e2db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:30.286204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab60cc2-378b-4c32-912d-59696409e2db admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:30.325753 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0615c0f-6d57-47bd-a8a2-384b3cad174d None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:30.326637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 808/1616] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:30 2022] POST /identity/v3/users => generated 308 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:30.330921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab60cc2-378b-4c32-912d-59696409e2db admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:30.350001 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab60cc2-378b-4c32-912d-59696409e2db admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:30.370258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96b773-4d65-46c2-a335-d05bb52b5c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:30.371912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96b773-4d65-46c2-a335-d05bb52b5c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.373538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96b773-4d65-46c2-a335-d05bb52b5c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.374704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96b773-4d65-46c2-a335-d05bb52b5c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.376959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96b773-4d65-46c2-a335-d05bb52b5c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:30.384039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96b773-4d65-46c2-a335-d05bb52b5c53 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:30.398503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:30.426441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4ea9-0edd-4d14-91ad-89d0f4847e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:30.427198 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4ea9-0edd-4d14-91ad-89d0f4847e0b service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.427564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4ea9-0edd-4d14-91ad-89d0f4847e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.428060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4ea9-0edd-4d14-91ad-89d0f4847e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.431598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 809/1617] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:30 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:30.433805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96b773-4d65-46c2-a335-d05bb52b5c53 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:30.442780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c4ea9-0edd-4d14-91ad-89d0f4847e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:30.446245 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c4ea9-0edd-4d14-91ad-89d0f4847e0b service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:30.464649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 809/1618] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:30.466334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4ea9-0edd-4d14-91ad-89d0f4847e0b service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:30.473829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:30.491991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4ea9-0edd-4d14-91ad-89d0f4847e0b service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:30.520872 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96b773-4d65-46c2-a335-d05bb52b5c53 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:30.525775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633e12f-a3c7-42ba-b6bc-996f67dafb04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:30.526455 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633e12f-a3c7-42ba-b6bc-996f67dafb04 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.526736 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633e12f-a3c7-42ba-b6bc-996f67dafb04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.527010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633e12f-a3c7-42ba-b6bc-996f67dafb04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.580078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba583199-bb1a-412b-86b8-4048275b19f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:30.580864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba583199-bb1a-412b-86b8-4048275b19f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.581225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba583199-bb1a-412b-86b8-4048275b19f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.582077 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba583199-bb1a-412b-86b8-4048275b19f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.582809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba583199-bb1a-412b-86b8-4048275b19f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:30.586181 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba583199-bb1a-412b-86b8-4048275b19f2 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:30.612848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633e12f-a3c7-42ba-b6bc-996f67dafb04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:30.614153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 810/1619] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:30 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:30.614656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633e12f-a3c7-42ba-b6bc-996f67dafb04 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:30.615039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba583199-bb1a-412b-86b8-4048275b19f2 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:30.626029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 810/1620] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:30.638885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633e12f-a3c7-42ba-b6bc-996f67dafb04 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:30.662478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633e12f-a3c7-42ba-b6bc-996f67dafb04 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:30.675043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce83fc-1ca1-413f-8122-805113101ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:30.677484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce83fc-1ca1-413f-8122-805113101ebb admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.678087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce83fc-1ca1-413f-8122-805113101ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.679721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce83fc-1ca1-413f-8122-805113101ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.680698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce83fc-1ca1-413f-8122-805113101ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:30.686516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce83fc-1ca1-413f-8122-805113101ebb admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:30.705854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba583199-bb1a-412b-86b8-4048275b19f2 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:30.718201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 811/1621] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:30.718201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2525c4-ffff-4761-ac77-12cc7dce2f42 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.718201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2525c4-ffff-4761-ac77-12cc7dce2f42 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.718201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2525c4-ffff-4761-ac77-12cc7dce2f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.719307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d229a1-e138-45d4-85a8-da39c1cb98d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:30.719951 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d229a1-e138-45d4-85a8-da39c1cb98d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.720264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d229a1-e138-45d4-85a8-da39c1cb98d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.721330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d229a1-e138-45d4-85a8-da39c1cb98d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.770100 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-6b2525c4-ffff-4761-ac77-12cc7dce2f42 None None] MFA Rules not processed for user `ccab69ee603d48ba9126c9ef4532a40f`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:30.774375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6b2525c4-ffff-4761-ac77-12cc7dce2f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:30.826370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d229a1-e138-45d4-85a8-da39c1cb98d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:30.828958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d229a1-e138-45d4-85a8-da39c1cb98d1 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:30.844559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 811/1622] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:30.847676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d229a1-e138-45d4-85a8-da39c1cb98d1 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:30.865983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d229a1-e138-45d4-85a8-da39c1cb98d1 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:30.876756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf38a74-4066-4eb2-b142-f27f61320cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:30.877451 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf38a74-4066-4eb2-b142-f27f61320cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.877969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf38a74-4066-4eb2-b142-f27f61320cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.878715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf38a74-4066-4eb2-b142-f27f61320cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.879392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf38a74-4066-4eb2-b142-f27f61320cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:30.881506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 812/1623] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:30.881917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf38a74-4066-4eb2-b142-f27f61320cf9 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:30.883365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2525c4-ffff-4761-ac77-12cc7dce2f42 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:30.900364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2525c4-ffff-4761-ac77-12cc7dce2f42 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:30.906698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b86887-e44d-4f16-bb3c-d319a9c51fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:30.907681 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b86887-e44d-4f16-bb3c-d319a9c51fea admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.908381 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b86887-e44d-4f16-bb3c-d319a9c51fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.909021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b86887-e44d-4f16-bb3c-d319a9c51fea admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.910248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b86887-e44d-4f16-bb3c-d319a9c51fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:30.911956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b86887-e44d-4f16-bb3c-d319a9c51fea admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:30.921202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 812/1624] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:30 2022] POST /identity/v3/users => generated 303 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:30.922609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf38a74-4066-4eb2-b142-f27f61320cf9 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:30.934286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 813/1625] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:30.935337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b86887-e44d-4f16-bb3c-d319a9c51fea admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:30.947917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf38a74-4066-4eb2-b142-f27f61320cf9 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:30.955626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b86887-e44d-4f16-bb3c-d319a9c51fea admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:30.961043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382bba2-27b4-434c-9bd2-93dd0da2098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:30.961934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382bba2-27b4-434c-9bd2-93dd0da2098b admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.962507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382bba2-27b4-434c-9bd2-93dd0da2098b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.963374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382bba2-27b4-434c-9bd2-93dd0da2098b admin admin] PATH_INFO: `/v3/projects/24dad6e072a5490797b3da13d39ea831/users/d8e6005671a84f009e7a2896eca509fa/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.969061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c15d3-d11a-4fa7-90c5-e418f79bc7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:30.970115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c15d3-d11a-4fa7-90c5-e418f79bc7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:30.971061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:30.971278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c15d3-d11a-4fa7-90c5-e418f79bc7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:30.972644 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c15d3-d11a-4fa7-90c5-e418f79bc7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:30.974405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c15d3-d11a-4fa7-90c5-e418f79bc7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:30.980756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c15d3-d11a-4fa7-90c5-e418f79bc7c3 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:31.003682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382bba2-27b4-434c-9bd2-93dd0da2098b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dad6e072a5490797b3da13d39ea831, user_id=d8e6005671a84f009e7a2896eca509fa, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:31.009581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382bba2-27b4-434c-9bd2-93dd0da2098b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:31.057980 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 813/1626] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:30 2022] PUT /identity/v3/projects/24dad6e072a5490797b3da13d39ea831/users/d8e6005671a84f009e7a2896eca509fa/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:31.059063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382bba2-27b4-434c-9bd2-93dd0da2098b admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:31.062939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 814/1627] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:30 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:31.063916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c15d3-d11a-4fa7-90c5-e418f79bc7c3 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:31.157879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:31.206335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382bba2-27b4-434c-9bd2-93dd0da2098b admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:31.262728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c15d3-d11a-4fa7-90c5-e418f79bc7c3 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:31.280055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30764-3123-4948-8098-8172cbcb01f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:31.281675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30764-3123-4948-8098-8172cbcb01f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:31.283048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30764-3123-4948-8098-8172cbcb01f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:31.283295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30764-3123-4948-8098-8172cbcb01f9 admin admin] PATH_INFO: `/v3/projects/55846b42e18c44ab9d3f5952f6a626c2/users/900879594bd34eacbbd8b1c8aac84308/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:31.333344 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa28584-1188-44f1-97ff-928dc7c729c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:31.333974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa28584-1188-44f1-97ff-928dc7c729c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:31.334258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa28584-1188-44f1-97ff-928dc7c729c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:31.334598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa28584-1188-44f1-97ff-928dc7c729c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:31.336071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30764-3123-4948-8098-8172cbcb01f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55846b42e18c44ab9d3f5952f6a626c2, user_id=900879594bd34eacbbd8b1c8aac84308, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:31.339643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa28584-1188-44f1-97ff-928dc7c729c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:31.341311 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa28584-1188-44f1-97ff-928dc7c729c5 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:31.341453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30764-3123-4948-8098-8172cbcb01f9 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:31.371142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 814/1628] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:31.372025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa28584-1188-44f1-97ff-928dc7c729c5 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:31.386309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 815/1629] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:31 2022] PUT /identity/v3/projects/55846b42e18c44ab9d3f5952f6a626c2/users/900879594bd34eacbbd8b1c8aac84308/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:31.386845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30764-3123-4948-8098-8172cbcb01f9 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:31.393802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa28584-1188-44f1-97ff-928dc7c729c5 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:31.527543 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaea97f-7c26-4fb3-92c5-948909b69242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:31.528694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaea97f-7c26-4fb3-92c5-948909b69242 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:31.531506 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaea97f-7c26-4fb3-92c5-948909b69242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:31.531900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaea97f-7c26-4fb3-92c5-948909b69242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:31.532754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaea97f-7c26-4fb3-92c5-948909b69242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:31.536740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaea97f-7c26-4fb3-92c5-948909b69242 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:31.546583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30764-3123-4948-8098-8172cbcb01f9 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:31.561245 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551856d1-ffbd-4d8f-a1b7-9a2bd868be4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:31.561245 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551856d1-ffbd-4d8f-a1b7-9a2bd868be4c admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:31.561245 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551856d1-ffbd-4d8f-a1b7-9a2bd868be4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:31.561245 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551856d1-ffbd-4d8f-a1b7-9a2bd868be4c admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:31.564634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551856d1-ffbd-4d8f-a1b7-9a2bd868be4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:31.564763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 815/1630] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:31.565543 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaea97f-7c26-4fb3-92c5-948909b69242 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:31.566155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551856d1-ffbd-4d8f-a1b7-9a2bd868be4c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:31.593094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaea97f-7c26-4fb3-92c5-948909b69242 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:31.610367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955a229-afb7-45b6-9e85-71e62449a61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:31.611486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955a229-afb7-45b6-9e85-71e62449a61a admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:31.611618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955a229-afb7-45b6-9e85-71e62449a61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:31.613393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955a229-afb7-45b6-9e85-71e62449a61a admin admin] PATH_INFO: `/v3/projects/39a03833058c4d7f851172b55cd8407d/users/db9f533d22cf4bb895f89e1bbd38f575/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:31.636382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 816/1631] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:31 2022] POST /identity/v3/users => generated 309 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:31.638718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551856d1-ffbd-4d8f-a1b7-9a2bd868be4c admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:31.646065 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955a229-afb7-45b6-9e85-71e62449a61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a03833058c4d7f851172b55cd8407d, user_id=db9f533d22cf4bb895f89e1bbd38f575, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:31.650158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955a229-afb7-45b6-9e85-71e62449a61a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:31.654272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551856d1-ffbd-4d8f-a1b7-9a2bd868be4c admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:31.663363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515085ff-8b88-4480-aea6-38fd8b2618d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:31.664851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515085ff-8b88-4480-aea6-38fd8b2618d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:31.665143 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515085ff-8b88-4480-aea6-38fd8b2618d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:31.665467 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515085ff-8b88-4480-aea6-38fd8b2618d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:31.666202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515085ff-8b88-4480-aea6-38fd8b2618d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:31.668168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515085ff-8b88-4480-aea6-38fd8b2618d1 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:31.674979 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:31.697009 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 816/1632] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:31 2022] PUT /identity/v3/projects/39a03833058c4d7f851172b55cd8407d/users/db9f533d22cf4bb895f89e1bbd38f575/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:31.702507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955a229-afb7-45b6-9e85-71e62449a61a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:31.706014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 817/1633] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:31.710266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515085ff-8b88-4480-aea6-38fd8b2618d1 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:31.737278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515085ff-8b88-4480-aea6-38fd8b2618d1 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:31.876462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955a229-afb7-45b6-9e85-71e62449a61a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:31.889169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e536ea3-fda7-4c55-ba50-90fa76c9e75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:31.889858 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e536ea3-fda7-4c55-ba50-90fa76c9e75b admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:31.890137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e536ea3-fda7-4c55-ba50-90fa76c9e75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:31.890410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e536ea3-fda7-4c55-ba50-90fa76c9e75b admin admin] PATH_INFO: `/v3/projects/24dad6e072a5490797b3da13d39ea831/users/d8e6005671a84f009e7a2896eca509fa/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:31.992417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e536ea3-fda7-4c55-ba50-90fa76c9e75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dad6e072a5490797b3da13d39ea831, user_id=d8e6005671a84f009e7a2896eca509fa, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:31.992417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e536ea3-fda7-4c55-ba50-90fa76c9e75b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:31.996026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff81e78-a1b0-4fac-9452-6213cad0bf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:31.996026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff81e78-a1b0-4fac-9452-6213cad0bf87 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:31.996026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff81e78-a1b0-4fac-9452-6213cad0bf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:31.996026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff81e78-a1b0-4fac-9452-6213cad0bf87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:31.996516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff81e78-a1b0-4fac-9452-6213cad0bf87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:31.996516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff81e78-a1b0-4fac-9452-6213cad0bf87 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:31.998551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 817/1634] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:31 2022] PUT /identity/v3/projects/24dad6e072a5490797b3da13d39ea831/users/d8e6005671a84f009e7a2896eca509fa/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:31.998551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e536ea3-fda7-4c55-ba50-90fa76c9e75b admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:31.998782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 818/1635] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:31.998782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff81e78-a1b0-4fac-9452-6213cad0bf87 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:31.998782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff81e78-a1b0-4fac-9452-6213cad0bf87 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:32.073915 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:32.100466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e536ea3-fda7-4c55-ba50-90fa76c9e75b admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:32.106875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10bb5d-c727-4eba-a81a-5569d7ddc5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:32.109281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10bb5d-c727-4eba-a81a-5569d7ddc5ed admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:32.109879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10bb5d-c727-4eba-a81a-5569d7ddc5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:32.110675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10bb5d-c727-4eba-a81a-5569d7ddc5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:32.112168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10bb5d-c727-4eba-a81a-5569d7ddc5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:32.114516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10bb5d-c727-4eba-a81a-5569d7ddc5ed admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:32.140209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 818/1636] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:32.142554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db959d6-b129-4d8a-bdb2-34df3b910ee6 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:32.143792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db959d6-b129-4d8a-bdb2-34df3b910ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:32.143924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db959d6-b129-4d8a-bdb2-34df3b910ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:32.168895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca44fdf-b3bd-4826-bf76-ab960797e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:32.169660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca44fdf-b3bd-4826-bf76-ab960797e3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:32.170012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca44fdf-b3bd-4826-bf76-ab960797e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:32.170755 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca44fdf-b3bd-4826-bf76-ab960797e3e6 admin admin] PATH_INFO: `/v3/projects/55846b42e18c44ab9d3f5952f6a626c2/users/900879594bd34eacbbd8b1c8aac84308/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:32.174111 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca44fdf-b3bd-4826-bf76-ab960797e3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55846b42e18c44ab9d3f5952f6a626c2, user_id=900879594bd34eacbbd8b1c8aac84308, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:32.176429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca44fdf-b3bd-4826-bf76-ab960797e3e6 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:32.186921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-5db959d6-b129-4d8a-bdb2-34df3b910ee6 None None] MFA Rules not processed for user `d8e6005671a84f009e7a2896eca509fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:32.188303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-5db959d6-b129-4d8a-bdb2-34df3b910ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:32.196875 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 819/1637] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:31 2022] PUT /identity/v3/projects/55846b42e18c44ab9d3f5952f6a626c2/users/900879594bd34eacbbd8b1c8aac84308/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:32.197826 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca44fdf-b3bd-4826-bf76-ab960797e3e6 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:32.297810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 819/1638] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:32.302609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db959d6-b129-4d8a-bdb2-34df3b910ee6 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:32.317636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:32.338107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca44fdf-b3bd-4826-bf76-ab960797e3e6 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:32.348805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd16e6-da95-4e7b-944b-35b820b5fa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:32.349863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd16e6-da95-4e7b-944b-35b820b5fa4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:32.350858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd16e6-da95-4e7b-944b-35b820b5fa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:32.351822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd16e6-da95-4e7b-944b-35b820b5fa4b admin admin] PATH_INFO: `/v3/projects/635e4aed1f814824aefeb5b8c250babf/users/0f45ca7013c34bc08a1543d1f2c876e9/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:32.379753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd16e6-da95-4e7b-944b-35b820b5fa4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=635e4aed1f814824aefeb5b8c250babf, user_id=0f45ca7013c34bc08a1543d1f2c876e9, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:32.385775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd16e6-da95-4e7b-944b-35b820b5fa4b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:32.408234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 820/1639] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:32 2022] PUT /identity/v3/projects/635e4aed1f814824aefeb5b8c250babf/users/0f45ca7013c34bc08a1543d1f2c876e9/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:32.409881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c493a-88df-46fc-ad69-82e6c0bf7156 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:32.410144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db959d6-b129-4d8a-bdb2-34df3b910ee6 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:32.410629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c493a-88df-46fc-ad69-82e6c0bf7156 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:32.411114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c493a-88df-46fc-ad69-82e6c0bf7156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:32.489867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-9c6c493a-88df-46fc-ad69-82e6c0bf7156 None None] MFA Rules not processed for user `900879594bd34eacbbd8b1c8aac84308`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:32.493777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9c6c493a-88df-46fc-ad69-82e6c0bf7156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:32.565501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785a6e6-8cde-42b8-9c75-43466dbd3b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:32.566361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785a6e6-8cde-42b8-9c75-43466dbd3b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:32.566793 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785a6e6-8cde-42b8-9c75-43466dbd3b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:32.567079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785a6e6-8cde-42b8-9c75-43466dbd3b35 admin admin] PATH_INFO: `/v3/projects/39a03833058c4d7f851172b55cd8407d/users/db9f533d22cf4bb895f89e1bbd38f575/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:32.570228 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785a6e6-8cde-42b8-9c75-43466dbd3b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a03833058c4d7f851172b55cd8407d, user_id=db9f533d22cf4bb895f89e1bbd38f575, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:32.575545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785a6e6-8cde-42b8-9c75-43466dbd3b35 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:32.610191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 820/1640] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:32 2022] PUT /identity/v3/projects/39a03833058c4d7f851172b55cd8407d/users/db9f533d22cf4bb895f89e1bbd38f575/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:32.611266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785a6e6-8cde-42b8-9c75-43466dbd3b35 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:32.672143 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 821/1641] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:32.679191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c493a-88df-46fc-ad69-82e6c0bf7156 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:32.701969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c493a-88df-46fc-ad69-82e6c0bf7156 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:32.727392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:32.749737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785a6e6-8cde-42b8-9c75-43466dbd3b35 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:32.759025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d7d19-4e8d-465a-909a-33332e2644c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:32.759590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d7d19-4e8d-465a-909a-33332e2644c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:32.759877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d7d19-4e8d-465a-909a-33332e2644c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:32.760154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d7d19-4e8d-465a-909a-33332e2644c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:32.808801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7054fe-57a4-4b9c-b47d-66425a3d592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:32.809447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7054fe-57a4-4b9c-b47d-66425a3d592c admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:32.809724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7054fe-57a4-4b9c-b47d-66425a3d592c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:32.810823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7054fe-57a4-4b9c-b47d-66425a3d592c admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:32.811522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7054fe-57a4-4b9c-b47d-66425a3d592c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:32.813962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7054fe-57a4-4b9c-b47d-66425a3d592c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:32.825431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 822/1642] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:32.827056 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade85ec-c04d-481c-b3a9-3e38f1239539 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:32.827350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade85ec-c04d-481c-b3a9-3e38f1239539 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:32.827621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade85ec-c04d-481c-b3a9-3e38f1239539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:32.867853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-dade85ec-c04d-481c-b3a9-3e38f1239539 None None] MFA Rules not processed for user `db9f533d22cf4bb895f89e1bbd38f575`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:32.869418 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-dade85ec-c04d-481c-b3a9-3e38f1239539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:32.913319 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d7d19-4e8d-465a-909a-33332e2644c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:32.914965 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d7d19-4e8d-465a-909a-33332e2644c4 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:32.934017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 821/1643] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:32 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:32.951258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d7d19-4e8d-465a-909a-33332e2644c4 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:32.965199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:32.972046 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d7d19-4e8d-465a-909a-33332e2644c4 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:32.999719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85113b-1b4c-47b2-9c1f-3e44a77aea45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:33.000380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85113b-1b4c-47b2-9c1f-3e44a77aea45 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:33.000670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85113b-1b4c-47b2-9c1f-3e44a77aea45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:33.000978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85113b-1b4c-47b2-9c1f-3e44a77aea45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:33.011982 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 823/1644] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:33.012914 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade85ec-c04d-481c-b3a9-3e38f1239539 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:33.031831 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade85ec-c04d-481c-b3a9-3e38f1239539 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:33.045257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598ef0b-d854-4572-b2d0-eb40fc8f0d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:33.046092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598ef0b-d854-4572-b2d0-eb40fc8f0d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:33.047989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598ef0b-d854-4572-b2d0-eb40fc8f0d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:33.051821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598ef0b-d854-4572-b2d0-eb40fc8f0d70 admin admin] PATH_INFO: `/v3/projects/635e4aed1f814824aefeb5b8c250babf/users/0f45ca7013c34bc08a1543d1f2c876e9/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:33.060233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598ef0b-d854-4572-b2d0-eb40fc8f0d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635e4aed1f814824aefeb5b8c250babf, user_id=0f45ca7013c34bc08a1543d1f2c876e9, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:33.072129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598ef0b-d854-4572-b2d0-eb40fc8f0d70 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:33.096797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85113b-1b4c-47b2-9c1f-3e44a77aea45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:33.098839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85113b-1b4c-47b2-9c1f-3e44a77aea45 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:33.112721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 824/1645] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:33 2022] PUT /identity/v3/projects/635e4aed1f814824aefeb5b8c250babf/users/0f45ca7013c34bc08a1543d1f2c876e9/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:33.145850 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 822/1646] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:33.215284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598ef0b-d854-4572-b2d0-eb40fc8f0d70 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:33.371924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598ef0b-d854-4572-b2d0-eb40fc8f0d70 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:33.381260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0ee49-483c-4794-b0d0-b125796f2534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:33.382551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0ee49-483c-4794-b0d0-b125796f2534 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:33.387161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0ee49-483c-4794-b0d0-b125796f2534 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:33.387456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0ee49-483c-4794-b0d0-b125796f2534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:33.531844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:33.579313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0ee49-483c-4794-b0d0-b125796f2534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:33.581603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0ee49-483c-4794-b0d0-b125796f2534 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:33.596376 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e23b4f-bef2-4064-8824-c353ae6e1471 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:33.596693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e23b4f-bef2-4064-8824-c353ae6e1471 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:33.596983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e23b4f-bef2-4064-8824-c353ae6e1471 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:33.598819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 823/1647] 10.222.0.43 () {54 vars in 962 bytes} [Wed Sep 7 16:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 16:10:33.599551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e23b4f-bef2-4064-8824-c353ae6e1471 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:33.632821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 825/1648] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:33.633792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0ee49-483c-4794-b0d0-b125796f2534 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:33.648083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0ee49-483c-4794-b0d0-b125796f2534 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:33.662170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ea202-2936-45c7-a923-0167591fac28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:33.663012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ea202-2936-45c7-a923-0167591fac28 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:33.663351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ea202-2936-45c7-a923-0167591fac28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:33.663805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ea202-2936-45c7-a923-0167591fac28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:33.718608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e23b4f-bef2-4064-8824-c353ae6e1471 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:33.718608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:33.718608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:33.718608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:33.723884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] PATH_INFO: `/v3/users/822be3c971414ebab25b25f7d1229fae` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:33.723884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=822be3c971414ebab25b25f7d1229fae)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:33.723884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:33.798795 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ea202-2936-45c7-a923-0167591fac28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:33.800253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ea202-2936-45c7-a923-0167591fac28 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:33.811065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 826/1649] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:33.812270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c178580-a19a-4362-991b-884bd1d08590 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:33.812560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c178580-a19a-4362-991b-884bd1d08590 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:33.812874 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c178580-a19a-4362-991b-884bd1d08590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:33.827483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '822be3c971414ebab25b25f7d1229fae'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:33.854474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '822be3c971414ebab25b25f7d1229fae'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:33.868448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-2c178580-a19a-4362-991b-884bd1d08590 None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:33.869953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2c178580-a19a-4362-991b-884bd1d08590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:33.900336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '822be3c971414ebab25b25f7d1229fae'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:33.901839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '822be3c971414ebab25b25f7d1229fae'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:33.903939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '822be3c971414ebab25b25f7d1229fae'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:33.941589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 824/1650] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:10:33 2022] DELETE /identity/v3/users/822be3c971414ebab25b25f7d1229fae => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:10:33.945730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:33.948287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:33.990884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 827/1651] 10.222.0.43 () {58 vars in 1059 bytes} [Wed Sep 7 16:10:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:33.997194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bead3-e38f-479b-9abd-20f350980212 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:34.001061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bead3-e38f-479b-9abd-20f350980212 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:34.001421 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bead3-e38f-479b-9abd-20f350980212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:34.007029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:34.032385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f73bead3-e38f-479b-9abd-20f350980212 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:34.033897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f73bead3-e38f-479b-9abd-20f350980212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:34.106919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87b34e-96a6-4d89-aa14-562971fe7254 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:34.117797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdc63e-6f92-4d89-acea-685ce7c88695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:34.118568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdc63e-6f92-4d89-acea-685ce7c88695 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:34.118858 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdc63e-6f92-4d89-acea-685ce7c88695 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:34.119133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdc63e-6f92-4d89-acea-685ce7c88695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:34.126660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:34.127706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-afbdc63e-6f92-4d89-acea-685ce7c88695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:34.149962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 828/1652] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:34.155255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aced6-1c02-4c98-a52f-3f29961bdf42 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:34.155709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aced6-1c02-4c98-a52f-3f29961bdf42 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:34.160239 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aced6-1c02-4c98-a52f-3f29961bdf42 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:34.162389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 829/1653] 10.222.0.43 () {54 vars in 912 bytes} [Wed Sep 7 16:10:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:10:34.171441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd6a80-b9fb-4f4d-8dd4-50f9284b1acf None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:34.171844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd6a80-b9fb-4f4d-8dd4-50f9284b1acf None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:34.172613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd6a80-b9fb-4f4d-8dd4-50f9284b1acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:34.214825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-37fd6a80-b9fb-4f4d-8dd4-50f9284b1acf None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:34.216167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-37fd6a80-b9fb-4f4d-8dd4-50f9284b1acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:34.325673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdc63e-6f92-4d89-acea-685ce7c88695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:34.327235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdc63e-6f92-4d89-acea-685ce7c88695 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:34.356720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 825/1654] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:34.358504 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdc63e-6f92-4d89-acea-685ce7c88695 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:34.362813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-afbdc63e-6f92-4d89-acea-685ce7c88695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:34.423244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 830/1655] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:10:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:10:34.437754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd6a80-b9fb-4f4d-8dd4-50f9284b1acf None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:34.442042 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-37fd6a80-b9fb-4f4d-8dd4-50f9284b1acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:34.488051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd6a80-b9fb-4f4d-8dd4-50f9284b1acf None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:34.492858 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdc63e-6f92-4d89-acea-685ce7c88695 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:34.502519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59552975-7270-45c1-9d5c-2f6b379cef20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:34.503263 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59552975-7270-45c1-9d5c-2f6b379cef20 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:34.504532 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59552975-7270-45c1-9d5c-2f6b379cef20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:34.504532 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59552975-7270-45c1-9d5c-2f6b379cef20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:34.507244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148217cb-bb4d-4ef9-9797-0466e188a5d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:34.508082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148217cb-bb4d-4ef9-9797-0466e188a5d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:34.508297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148217cb-bb4d-4ef9-9797-0466e188a5d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:34.512205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148217cb-bb4d-4ef9-9797-0466e188a5d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:34.531284 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59552975-7270-45c1-9d5c-2f6b379cef20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:34.533144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59552975-7270-45c1-9d5c-2f6b379cef20 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:34.561792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148217cb-bb4d-4ef9-9797-0466e188a5d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:34.564793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148217cb-bb4d-4ef9-9797-0466e188a5d4 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:34.567133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 826/1656] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:34.591974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 831/1657] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:10:36.040063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214ef6b-80b5-4b27-99c8-ea2f7b8f91b7 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:36.040670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214ef6b-80b5-4b27-99c8-ea2f7b8f91b7 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:36.040670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214ef6b-80b5-4b27-99c8-ea2f7b8f91b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:36.112042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-0214ef6b-80b5-4b27-99c8-ea2f7b8f91b7 None None] MFA Rules not processed for user `0f45ca7013c34bc08a1543d1f2c876e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:36.113333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0214ef6b-80b5-4b27-99c8-ea2f7b8f91b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:36.276250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:36.281530 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 827/1658] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:10:36.480014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148217cb-bb4d-4ef9-9797-0466e188a5d4 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:36.481664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-148217cb-bb4d-4ef9-9797-0466e188a5d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:36.511206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148217cb-bb4d-4ef9-9797-0466e188a5d4 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:36.534909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65e826-8b03-49ac-b441-2346993a9efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:36.535983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65e826-8b03-49ac-b441-2346993a9efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:36.535983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65e826-8b03-49ac-b441-2346993a9efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:36.536723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65e826-8b03-49ac-b441-2346993a9efd admin admin] PATH_INFO: `/v3/projects/b8283e3e5acc4a4e885e1ab4c11fffac` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:36.550201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65e826-8b03-49ac-b441-2346993a9efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8283e3e5acc4a4e885e1ab4c11fffac)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:36.552290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65e826-8b03-49ac-b441-2346993a9efd admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:36.760045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-bb65e826-8b03-49ac-b441-2346993a9efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8283e3e5acc4a4e885e1ab4c11fffac', 'request_id': 'req-bb65e826-8b03-49ac-b441-2346993a9efd'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:36.787761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-bb65e826-8b03-49ac-b441-2346993a9efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8283e3e5acc4a4e885e1ab4c11fffac', 'request_id': 'req-bb65e826-8b03-49ac-b441-2346993a9efd'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:36.801275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-bb65e826-8b03-49ac-b441-2346993a9efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8283e3e5acc4a4e885e1ab4c11fffac', 'request_id': 'req-bb65e826-8b03-49ac-b441-2346993a9efd'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:36.836465 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-bb65e826-8b03-49ac-b441-2346993a9efd admin admin] The token cache is being invalidate because project b8283e3e5acc4a4e885e1ab4c11fffac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:10:36.836810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-bb65e826-8b03-49ac-b441-2346993a9efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:36.848105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-bb65e826-8b03-49ac-b441-2346993a9efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:36.853979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 832/1659] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:10:36 2022] DELETE /identity/v3/projects/b8283e3e5acc4a4e885e1ab4c11fffac => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:36.857905 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214ef6b-80b5-4b27-99c8-ea2f7b8f91b7 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:36.873869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214ef6b-80b5-4b27-99c8-ea2f7b8f91b7 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:37.002271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f675d82-f18e-40a0-a85b-9cc1108d5238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:37.002989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f675d82-f18e-40a0-a85b-9cc1108d5238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:37.003279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f675d82-f18e-40a0-a85b-9cc1108d5238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:37.003559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f675d82-f18e-40a0-a85b-9cc1108d5238 admin admin] PATH_INFO: `/v3/users/d8e6005671a84f009e7a2896eca509fa` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:37.005229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f675d82-f18e-40a0-a85b-9cc1108d5238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e6005671a84f009e7a2896eca509fa)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:37.011147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f675d82-f18e-40a0-a85b-9cc1108d5238 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:37.138502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1f675d82-f18e-40a0-a85b-9cc1108d5238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e6005671a84f009e7a2896eca509fa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:37.169179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1f675d82-f18e-40a0-a85b-9cc1108d5238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e6005671a84f009e7a2896eca509fa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:37.201215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1f675d82-f18e-40a0-a85b-9cc1108d5238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e6005671a84f009e7a2896eca509fa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:37.201978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1f675d82-f18e-40a0-a85b-9cc1108d5238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e6005671a84f009e7a2896eca509fa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:37.202597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1f675d82-f18e-40a0-a85b-9cc1108d5238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e6005671a84f009e7a2896eca509fa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:37.242384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 828/1660] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:10:36 2022] DELETE /identity/v3/users/d8e6005671a84f009e7a2896eca509fa => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:37.430679 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2fe11-d42d-4991-a55a-6af1b8e644ae None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:37.430965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2fe11-d42d-4991-a55a-6af1b8e644ae None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:37.431283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2fe11-d42d-4991-a55a-6af1b8e644ae None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:37.432889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 833/1661] 10.222.0.43 () {54 vars in 962 bytes} [Wed Sep 7 16:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:10:37.451240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dda90-f89e-4f27-81be-ef87d1f814c0 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:37.451532 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dda90-f89e-4f27-81be-ef87d1f814c0 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:37.451844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dda90-f89e-4f27-81be-ef87d1f814c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:37.505870 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8c4dda90-f89e-4f27-81be-ef87d1f814c0 None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:37.514596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8c4dda90-f89e-4f27-81be-ef87d1f814c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:37.729507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 829/1662] 10.222.0.43 () {58 vars in 1059 bytes} [Wed Sep 7 16:10:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:37.735765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ade03-4bc4-4bf2-99c0-96ba85c184ae None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:37.736353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ade03-4bc4-4bf2-99c0-96ba85c184ae None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:37.736353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ade03-4bc4-4bf2-99c0-96ba85c184ae None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:37.738154 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 834/1663] 10.222.0.43 () {54 vars in 912 bytes} [Wed Sep 7 16:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:10:37.744895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75484b2-fc88-4f67-ba6d-d7e0b83b0e03 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:37.745264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75484b2-fc88-4f67-ba6d-d7e0b83b0e03 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:37.745652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75484b2-fc88-4f67-ba6d-d7e0b83b0e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:37.781842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f75484b2-fc88-4f67-ba6d-d7e0b83b0e03 None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:37.784044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f75484b2-fc88-4f67-ba6d-d7e0b83b0e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:37.797915 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 830/1664] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:10:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:37.857102 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ade03-4bc4-4bf2-99c0-96ba85c184ae None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:37.864427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-845ade03-4bc4-4bf2-99c0-96ba85c184ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:37.993423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ade03-4bc4-4bf2-99c0-96ba85c184ae None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:38.008479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59fb25-c653-4a60-894e-b3b5bd2440b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:38.009230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59fb25-c653-4a60-894e-b3b5bd2440b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:38.009857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59fb25-c653-4a60-894e-b3b5bd2440b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:38.013712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59fb25-c653-4a60-894e-b3b5bd2440b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:38.038085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59fb25-c653-4a60-894e-b3b5bd2440b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:38.047473 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59fb25-c653-4a60-894e-b3b5bd2440b3 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:38.072744 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 835/1665] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:39.565533 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75484b2-fc88-4f67-ba6d-d7e0b83b0e03 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:39.567058 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f75484b2-fc88-4f67-ba6d-d7e0b83b0e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:39.574702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:39.798316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75484b2-fc88-4f67-ba6d-d7e0b83b0e03 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:39.806269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373945a2-85d7-49fb-a85b-7db49331a81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:39.807125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373945a2-85d7-49fb-a85b-7db49331a81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:39.808095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373945a2-85d7-49fb-a85b-7db49331a81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:39.808571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373945a2-85d7-49fb-a85b-7db49331a81a admin admin] PATH_INFO: `/v3/users/813248aa4fa34ea28f049dde1ffebd50` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:39.816018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373945a2-85d7-49fb-a85b-7db49331a81a admin admin] RBAC: Authorizing `identity:delete_user(user_id=813248aa4fa34ea28f049dde1ffebd50)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:39.818931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373945a2-85d7-49fb-a85b-7db49331a81a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:39.916472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-373945a2-85d7-49fb-a85b-7db49331a81a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813248aa4fa34ea28f049dde1ffebd50'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:39.940307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-373945a2-85d7-49fb-a85b-7db49331a81a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813248aa4fa34ea28f049dde1ffebd50'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:39.963887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-373945a2-85d7-49fb-a85b-7db49331a81a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813248aa4fa34ea28f049dde1ffebd50'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:39.965567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-373945a2-85d7-49fb-a85b-7db49331a81a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813248aa4fa34ea28f049dde1ffebd50'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:39.967810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-373945a2-85d7-49fb-a85b-7db49331a81a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813248aa4fa34ea28f049dde1ffebd50'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:40.004170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 831/1666] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:10:39 2022] DELETE /identity/v3/users/813248aa4fa34ea28f049dde1ffebd50 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:40.010104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430ddb-ad81-4728-93e7-2841a5eb64f4 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:40.011069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430ddb-ad81-4728-93e7-2841a5eb64f4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:40.011318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430ddb-ad81-4728-93e7-2841a5eb64f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:40.033005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:40.049703 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-26430ddb-ad81-4728-93e7-2841a5eb64f4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:40.051123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-26430ddb-ad81-4728-93e7-2841a5eb64f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:40.189702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 836/1667] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:40.219917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cccfa-b940-4c0b-9b6c-81f3160770bc None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:40.220563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cccfa-b940-4c0b-9b6c-81f3160770bc None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:40.220964 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cccfa-b940-4c0b-9b6c-81f3160770bc None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:40.224480 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 832/1668] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:10:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:10:40.262096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26430ddb-ad81-4728-93e7-2841a5eb64f4 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:40.264239 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-26430ddb-ad81-4728-93e7-2841a5eb64f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:40.272904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121ae3d-91ab-4a5f-975a-4bc05998bf57 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:40.273298 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121ae3d-91ab-4a5f-975a-4bc05998bf57 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:40.273802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121ae3d-91ab-4a5f-975a-4bc05998bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:40.326057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e121ae3d-91ab-4a5f-975a-4bc05998bf57 None None] MFA Rules not processed for user `b918da0f83754f3887de1cfa2e4df028`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:40.327412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e121ae3d-91ab-4a5f-975a-4bc05998bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:40.438519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26430ddb-ad81-4728-93e7-2841a5eb64f4 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:40.456295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e6eb4-4649-41b0-8f19-ea19247cbd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:40.458282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e6eb4-4649-41b0-8f19-ea19247cbd72 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:40.460012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e6eb4-4649-41b0-8f19-ea19247cbd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:40.460012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e6eb4-4649-41b0-8f19-ea19247cbd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:40.529547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e6eb4-4649-41b0-8f19-ea19247cbd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:40.536302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e6eb4-4649-41b0-8f19-ea19247cbd72 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:40.538218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 833/1669] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:10:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:40.603640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 837/1670] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:40.619112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121ae3d-91ab-4a5f-975a-4bc05998bf57 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:40.620833 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e6eb4-4649-41b0-8f19-ea19247cbd72 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:40.621104 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e121ae3d-91ab-4a5f-975a-4bc05998bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:40.623515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2e5e6eb4-4649-41b0-8f19-ea19247cbd72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:40.649605 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121ae3d-91ab-4a5f-975a-4bc05998bf57 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:40.657378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e6eb4-4649-41b0-8f19-ea19247cbd72 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:40.667380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad83bf8-fdc8-4cc5-a4de-1280cdd9c905 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b918da0f83754f3887de1cfa2e4df028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:40.668378 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad83bf8-fdc8-4cc5-a4de-1280cdd9c905 service placement] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:40.669996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad83bf8-fdc8-4cc5-a4de-1280cdd9c905 service placement] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:40.670452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad83bf8-fdc8-4cc5-a4de-1280cdd9c905 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:40.685948 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4748a31-e87f-49c3-ae0d-9465e01aeef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:40.688706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4748a31-e87f-49c3-ae0d-9465e01aeef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:40.689150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4748a31-e87f-49c3-ae0d-9465e01aeef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:40.689601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4748a31-e87f-49c3-ae0d-9465e01aeef4 admin admin] PATH_INFO: `/v3/projects/24dad6e072a5490797b3da13d39ea831` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:40.692617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4748a31-e87f-49c3-ae0d-9465e01aeef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24dad6e072a5490797b3da13d39ea831)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:40.697630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad83bf8-fdc8-4cc5-a4de-1280cdd9c905 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:40.699747 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4748a31-e87f-49c3-ae0d-9465e01aeef4 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:40.702445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad83bf8-fdc8-4cc5-a4de-1280cdd9c905 service placement] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:40.738018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 834/1671] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:40.899318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b4748a31-e87f-49c3-ae0d-9465e01aeef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24dad6e072a5490797b3da13d39ea831', 'request_id': 'req-b4748a31-e87f-49c3-ae0d-9465e01aeef4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:40.927972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b4748a31-e87f-49c3-ae0d-9465e01aeef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24dad6e072a5490797b3da13d39ea831', 'request_id': 'req-b4748a31-e87f-49c3-ae0d-9465e01aeef4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:40.952278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b4748a31-e87f-49c3-ae0d-9465e01aeef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24dad6e072a5490797b3da13d39ea831', 'request_id': 'req-b4748a31-e87f-49c3-ae0d-9465e01aeef4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:40.981253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b4748a31-e87f-49c3-ae0d-9465e01aeef4 admin admin] The token cache is being invalidate because project 24dad6e072a5490797b3da13d39ea831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:10:40.981554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b4748a31-e87f-49c3-ae0d-9465e01aeef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:40.984505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b4748a31-e87f-49c3-ae0d-9465e01aeef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:40.990409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 838/1672] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:10:40 2022] DELETE /identity/v3/projects/24dad6e072a5490797b3da13d39ea831 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:10:40.995209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268a10c-8ab1-40ef-a0a6-e78d8fd9eeaf None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:40.995767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268a10c-8ab1-40ef-a0a6-e78d8fd9eeaf None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:40.996455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268a10c-8ab1-40ef-a0a6-e78d8fd9eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:41.036475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:41.058819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-4268a10c-8ab1-40ef-a0a6-e78d8fd9eeaf None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:41.060085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4268a10c-8ab1-40ef-a0a6-e78d8fd9eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:41.125011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5f3f-c033-496c-a9a2-b4715946814e None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:41.125819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5f3f-c033-496c-a9a2-b4715946814e None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:41.126242 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5f3f-c033-496c-a9a2-b4715946814e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:41.164639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 835/1673] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:41.173152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87290a72-10a9-4b93-8396-01539e76adc2 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:41.173460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87290a72-10a9-4b93-8396-01539e76adc2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:41.173714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87290a72-10a9-4b93-8396-01539e76adc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:41.183091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b25e5f3f-c033-496c-a9a2-b4715946814e None None] MFA Rules not processed for user `e181e79d294845dd88c91a9dff2831f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:41.184396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b25e5f3f-c033-496c-a9a2-b4715946814e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:41.205509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:41.231630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-87290a72-10a9-4b93-8396-01539e76adc2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:41.236034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-87290a72-10a9-4b93-8396-01539e76adc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:41.267092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 836/1674] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:10:41.275025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87290a72-10a9-4b93-8396-01539e76adc2 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:41.302800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87290a72-10a9-4b93-8396-01539e76adc2 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:41.317668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 839/1675] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:41.319722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d44e3f-199a-4545-9583-cb0a37da474f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:41.319941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d44e3f-199a-4545-9583-cb0a37da474f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:41.320217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d44e3f-199a-4545-9583-cb0a37da474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:41.323768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e1040-8e71-4cd3-bb54-2299821bce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:41.325042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e1040-8e71-4cd3-bb54-2299821bce86 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:41.325329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e1040-8e71-4cd3-bb54-2299821bce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:41.325609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e1040-8e71-4cd3-bb54-2299821bce86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:41.326287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e1040-8e71-4cd3-bb54-2299821bce86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:41.326595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e1040-8e71-4cd3-bb54-2299821bce86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:41.337219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e1040-8e71-4cd3-bb54-2299821bce86 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:41.356606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-21d44e3f-199a-4545-9583-cb0a37da474f None None] MFA Rules not processed for user `e181e79d294845dd88c91a9dff2831f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:41.359540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-21d44e3f-199a-4545-9583-cb0a37da474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:41.383460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 837/1676] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:41.387454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e1040-8e71-4cd3-bb54-2299821bce86 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:41.392956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 840/1677] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:41.402420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d44e3f-199a-4545-9583-cb0a37da474f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:41.404844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-21d44e3f-199a-4545-9583-cb0a37da474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:41.407270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e1040-8e71-4cd3-bb54-2299821bce86 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:41.422826 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cb3b5-1f78-43e3-9075-17feef6bc41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:41.423464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cb3b5-1f78-43e3-9075-17feef6bc41a admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:41.423760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cb3b5-1f78-43e3-9075-17feef6bc41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:41.424032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cb3b5-1f78-43e3-9075-17feef6bc41a admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:41.424704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cb3b5-1f78-43e3-9075-17feef6bc41a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:41.429931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cb3b5-1f78-43e3-9075-17feef6bc41a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:41.497192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 838/1678] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:41 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:10:41.501110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cb3b5-1f78-43e3-9075-17feef6bc41a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:41.659177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d44e3f-199a-4545-9583-cb0a37da474f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:41.725302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cb3b5-1f78-43e3-9075-17feef6bc41a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:41.737285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516f2f3-1c2e-4b3b-b1dd-8fd9cd62ad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:41.737924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516f2f3-1c2e-4b3b-b1dd-8fd9cd62ad56 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:41.738972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516f2f3-1c2e-4b3b-b1dd-8fd9cd62ad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:41.740645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516f2f3-1c2e-4b3b-b1dd-8fd9cd62ad56 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:41.743097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516f2f3-1c2e-4b3b-b1dd-8fd9cd62ad56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:41.747036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516f2f3-1c2e-4b3b-b1dd-8fd9cd62ad56 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:41.806521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 839/1679] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:41 2022] POST /identity/v3/users => generated 290 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:41.808065 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516f2f3-1c2e-4b3b-b1dd-8fd9cd62ad56 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:41.811172 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-5516f2f3-1c2e-4b3b-b1dd-8fd9cd62ad56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:41.833391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173a90f-927a-4958-9493-366448afad9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:41.834241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173a90f-927a-4958-9493-366448afad9c service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:41.836477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173a90f-927a-4958-9493-366448afad9c service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:41.840539 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516f2f3-1c2e-4b3b-b1dd-8fd9cd62ad56 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:41.841050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173a90f-927a-4958-9493-366448afad9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:41.852058 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:41.853580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:41.853580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:41.854589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] PATH_INFO: `/v3/projects/2ef0175bf6234bcaa8d5cd28faaed9ad` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:41.855529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef0175bf6234bcaa8d5cd28faaed9ad)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:41.856710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: WARNING py.warnings [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:10:41.856710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: warnings.warn(msg) Sep 07 16:10:41.856710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: Sep 07 16:10:41.858520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:41.980996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef0175bf6234bcaa8d5cd28faaed9ad', 'request_id': 'req-16b95ae8-2200-4a54-9533-1c9bc2259516'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:41.982657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:41.996995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef0175bf6234bcaa8d5cd28faaed9ad', 'request_id': 'req-16b95ae8-2200-4a54-9533-1c9bc2259516'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:42.020176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:42.020371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef0175bf6234bcaa8d5cd28faaed9ad', 'request_id': 'req-16b95ae8-2200-4a54-9533-1c9bc2259516'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:42.057644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] The token cache is being invalidate because project 2ef0175bf6234bcaa8d5cd28faaed9ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:10:42.059197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:42.062351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:42.065706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 840/1680] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:10:41 2022] DELETE /identity/v3/projects/2ef0175bf6234bcaa8d5cd28faaed9ad => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:42.066643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:42.071973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:42.075672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173a90f-927a-4958-9493-366448afad9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:42.079161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173a90f-927a-4958-9493-366448afad9c service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:42.116842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 841/1681] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:10:42.123789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173a90f-927a-4958-9493-366448afad9c service nova] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:42.178663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173a90f-927a-4958-9493-366448afad9c service nova] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:42.200741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:42.201573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:42.202023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:42.202501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] PATH_INFO: `/v3/users/db9f533d22cf4bb895f89e1bbd38f575` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:42.203821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db9f533d22cf4bb895f89e1bbd38f575)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:42.204351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b95ae8-2200-4a54-9533-1c9bc2259516 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:42.205412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: WARNING py.warnings [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 16:10:42.205412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: warnings.warn(msg) Sep 07 16:10:42.205412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: Sep 07 16:10:42.207751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:42.218680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782eea7b-7885-47ba-8161-0d5d26edfa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:42.219466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782eea7b-7885-47ba-8161-0d5d26edfa88 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:42.219748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782eea7b-7885-47ba-8161-0d5d26edfa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:42.220023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782eea7b-7885-47ba-8161-0d5d26edfa88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:42.220675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782eea7b-7885-47ba-8161-0d5d26edfa88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:42.228059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782eea7b-7885-47ba-8161-0d5d26edfa88 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:42.252448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 841/1682] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:42.253478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782eea7b-7885-47ba-8161-0d5d26edfa88 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:42.289206 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782eea7b-7885-47ba-8161-0d5d26edfa88 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:42.322412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f902d29-c836-4345-9640-0313c6f2156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:42.322412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f902d29-c836-4345-9640-0313c6f2156d admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:42.322412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f902d29-c836-4345-9640-0313c6f2156d admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:42.322412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f902d29-c836-4345-9640-0313c6f2156d admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:42.324913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f902d29-c836-4345-9640-0313c6f2156d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:42.326536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f902d29-c836-4345-9640-0313c6f2156d admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:42.350886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 842/1683] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:42.356039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f902d29-c836-4345-9640-0313c6f2156d admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:42.385091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f902d29-c836-4345-9640-0313c6f2156d admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:42.402562 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0126aa2-06fa-41ca-9692-de327f59e3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:42.403567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0126aa2-06fa-41ca-9692-de327f59e3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:42.405151 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0126aa2-06fa-41ca-9692-de327f59e3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:42.406378 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0126aa2-06fa-41ca-9692-de327f59e3d0 admin admin] PATH_INFO: `/v3/projects/ee0dbdc7f61f41d085de97ee99c4f122/users/fe486141add44b509c8c93990eda7ad0/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:42.451082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0126aa2-06fa-41ca-9692-de327f59e3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee0dbdc7f61f41d085de97ee99c4f122, user_id=fe486141add44b509c8c93990eda7ad0, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:42.457076 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0126aa2-06fa-41ca-9692-de327f59e3d0 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:42.475800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db9f533d22cf4bb895f89e1bbd38f575'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:42.505543 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 843/1684] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:42 2022] PUT /identity/v3/projects/ee0dbdc7f61f41d085de97ee99c4f122/users/fe486141add44b509c8c93990eda7ad0/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:42.511685 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db9f533d22cf4bb895f89e1bbd38f575'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:42.512799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db9f533d22cf4bb895f89e1bbd38f575'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:42.513568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db9f533d22cf4bb895f89e1bbd38f575'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:42.514247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3ec5-97bd-466a-bc70-393cc6bf6e06 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:42.514608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3ec5-97bd-466a-bc70-393cc6bf6e06 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:42.514895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3ec5-97bd-466a-bc70-393cc6bf6e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:42.554853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-788c3ec5-97bd-466a-bc70-393cc6bf6e06 None None] MFA Rules not processed for user `fe486141add44b509c8c93990eda7ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:42.556175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-788c3ec5-97bd-466a-bc70-393cc6bf6e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:42.577822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db9f533d22cf4bb895f89e1bbd38f575'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:42.626888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 842/1685] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:10:42 2022] DELETE /identity/v3/users/db9f533d22cf4bb895f89e1bbd38f575 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:42.658287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 844/1686] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:42.658943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:42.660574 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:42.828294 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e5979-6382-49f9-ba8f-9049216351e9 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:42.839202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb82c7-f3c7-4da1-aa85-e2f25e33cb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:42.840215 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb82c7-f3c7-4da1-aa85-e2f25e33cb52 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:42.840713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb82c7-f3c7-4da1-aa85-e2f25e33cb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:42.841199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb82c7-f3c7-4da1-aa85-e2f25e33cb52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:42.843461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb82c7-f3c7-4da1-aa85-e2f25e33cb52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:42.848273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb82c7-f3c7-4da1-aa85-e2f25e33cb52 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:42.922015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 843/1687] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:42 2022] POST /identity/v3/projects => generated 381 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:10:42.926634 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c3ec5-97bd-466a-bc70-393cc6bf6e06 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:42.986209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:43.040726 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c3ec5-97bd-466a-bc70-393cc6bf6e06 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:43.136440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e67ff2-a38f-45b2-951f-abb4dd3f7cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:43.137601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e67ff2-a38f-45b2-951f-abb4dd3f7cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:43.138083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e67ff2-a38f-45b2-951f-abb4dd3f7cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:43.138773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e67ff2-a38f-45b2-951f-abb4dd3f7cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:43.140104 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e67ff2-a38f-45b2-951f-abb4dd3f7cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:43.144090 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e67ff2-a38f-45b2-951f-abb4dd3f7cc3 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:43.207740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 845/1688] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:42 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:43.212280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb82c7-f3c7-4da1-aa85-e2f25e33cb52 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:43.226294 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb82c7-f3c7-4da1-aa85-e2f25e33cb52 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:43.233910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd00841-f4c0-4a0c-aa5b-d5abba3b810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:43.236409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd00841-f4c0-4a0c-aa5b-d5abba3b810d admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:43.237037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd00841-f4c0-4a0c-aa5b-d5abba3b810d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:43.242008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd00841-f4c0-4a0c-aa5b-d5abba3b810d admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:43.242008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd00841-f4c0-4a0c-aa5b-d5abba3b810d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:43.244284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd00841-f4c0-4a0c-aa5b-d5abba3b810d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:43.273462 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 844/1689] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:43.275528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e67ff2-a38f-45b2-951f-abb4dd3f7cc3 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:43.289894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e67ff2-a38f-45b2-951f-abb4dd3f7cc3 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:43.300284 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aecea6-4ded-4b58-817b-d9751cba6478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:43.301267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aecea6-4ded-4b58-817b-d9751cba6478 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:43.301801 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aecea6-4ded-4b58-817b-d9751cba6478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:43.302277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aecea6-4ded-4b58-817b-d9751cba6478 admin admin] PATH_INFO: `/v3/projects/1f986d5e3b65440fb007f6507135eee7/users/04d83fcf4162420490100d2e836537c4/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:43.339757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aecea6-4ded-4b58-817b-d9751cba6478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f986d5e3b65440fb007f6507135eee7, user_id=04d83fcf4162420490100d2e836537c4, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:43.343563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aecea6-4ded-4b58-817b-d9751cba6478 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:43.380373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 846/1690] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:43 2022] PUT /identity/v3/projects/1f986d5e3b65440fb007f6507135eee7/users/04d83fcf4162420490100d2e836537c4/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:43.385403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd00841-f4c0-4a0c-aa5b-d5abba3b810d admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:43.401179 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd00841-f4c0-4a0c-aa5b-d5abba3b810d admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:43.507263 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba62db2-1f31-43a9-994e-2d2defaa35f3 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:43.508279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba62db2-1f31-43a9-994e-2d2defaa35f3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:43.509067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba62db2-1f31-43a9-994e-2d2defaa35f3 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:43.511411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 847/1691] 10.222.0.43 () {54 vars in 912 bytes} [Wed Sep 7 16:10:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:10:43.517808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c0f13-d644-4786-a740-63c77b1b13d6 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:43.518913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c0f13-d644-4786-a740-63c77b1b13d6 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:43.519414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c0f13-d644-4786-a740-63c77b1b13d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:43.570928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:43.677803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf52e80-5299-432c-918c-aca107174f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:43.683545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf52e80-5299-432c-918c-aca107174f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:43.683847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf52e80-5299-432c-918c-aca107174f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:43.684129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf52e80-5299-432c-918c-aca107174f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:43.694638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf52e80-5299-432c-918c-aca107174f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:43.698903 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf52e80-5299-432c-918c-aca107174f04 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:43.720346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-006c0f13-d644-4786-a740-63c77b1b13d6 None None] MFA Rules not processed for user `e91f048f8885448383f4a361b07dac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:43.721409 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-006c0f13-d644-4786-a740-63c77b1b13d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:43.740223 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 845/1692] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:43.744324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf52e80-5299-432c-918c-aca107174f04 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:43.795525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf52e80-5299-432c-918c-aca107174f04 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:43.811664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbeeae-9a52-46b6-929f-3b40c6b88e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:43.812517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbeeae-9a52-46b6-929f-3b40c6b88e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:43.812829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbeeae-9a52-46b6-929f-3b40c6b88e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:43.813108 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbeeae-9a52-46b6-929f-3b40c6b88e13 admin admin] PATH_INFO: `/v3/projects/1f986d5e3b65440fb007f6507135eee7/users/04d83fcf4162420490100d2e836537c4/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:43.826937 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbeeae-9a52-46b6-929f-3b40c6b88e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f986d5e3b65440fb007f6507135eee7, user_id=04d83fcf4162420490100d2e836537c4, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:43.833349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbeeae-9a52-46b6-929f-3b40c6b88e13 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:43.885981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 846/1693] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:43 2022] PUT /identity/v3/projects/1f986d5e3b65440fb007f6507135eee7/users/04d83fcf4162420490100d2e836537c4/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:43.886999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbeeae-9a52-46b6-929f-3b40c6b88e13 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:43.896672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-bedbeeae-9a52-46b6-929f-3b40c6b88e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:43.944329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 848/1694] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:10:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:10:43.945341 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c0f13-d644-4786-a740-63c77b1b13d6 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:43.947212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-006c0f13-d644-4786-a740-63c77b1b13d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:43.986105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c0f13-d644-4786-a740-63c77b1b13d6 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:44.079951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbeeae-9a52-46b6-929f-3b40c6b88e13 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:44.101963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78d9fc-0cd7-46d8-a89e-89deb937738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:44.103987 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78d9fc-0cd7-46d8-a89e-89deb937738f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:44.104281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78d9fc-0cd7-46d8-a89e-89deb937738f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:44.104561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78d9fc-0cd7-46d8-a89e-89deb937738f admin admin] PATH_INFO: `/v3/users/ccab69ee603d48ba9126c9ef4532a40f` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:44.107183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78d9fc-0cd7-46d8-a89e-89deb937738f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccab69ee603d48ba9126c9ef4532a40f)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:44.112420 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:44.113104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78d9fc-0cd7-46d8-a89e-89deb937738f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:44.186395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:44.187686 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:44.188035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:44.189164 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] PATH_INFO: `/v3/users/47c1cec893a440d7acef2516b5d6a587` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:44.190531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47c1cec893a440d7acef2516b5d6a587)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:44.196233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:44.222605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0b78d9fc-0cd7-46d8-a89e-89deb937738f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccab69ee603d48ba9126c9ef4532a40f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.247191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0b78d9fc-0cd7-46d8-a89e-89deb937738f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccab69ee603d48ba9126c9ef4532a40f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.248240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0b78d9fc-0cd7-46d8-a89e-89deb937738f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccab69ee603d48ba9126c9ef4532a40f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.249009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0b78d9fc-0cd7-46d8-a89e-89deb937738f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccab69ee603d48ba9126c9ef4532a40f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.299380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0b78d9fc-0cd7-46d8-a89e-89deb937738f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccab69ee603d48ba9126c9ef4532a40f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.317200 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47c1cec893a440d7acef2516b5d6a587'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.339521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47c1cec893a440d7acef2516b5d6a587'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.358885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 847/1695] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:10:43 2022] DELETE /identity/v3/users/ccab69ee603d48ba9126c9ef4532a40f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:44.362817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3e822-e568-4ab5-8a01-2ccdbc0b22b7 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:44.363349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3e822-e568-4ab5-8a01-2ccdbc0b22b7 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:44.363837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3e822-e568-4ab5-8a01-2ccdbc0b22b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:44.378212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47c1cec893a440d7acef2516b5d6a587'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.379245 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47c1cec893a440d7acef2516b5d6a587'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.381312 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47c1cec893a440d7acef2516b5d6a587'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.418510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 849/1696] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:10:43 2022] DELETE /identity/v3/users/47c1cec893a440d7acef2516b5d6a587 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:44.419521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:44.423602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:44.477204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-abd3e822-e568-4ab5-8a01-2ccdbc0b22b7 None None] MFA Rules not processed for user `04d83fcf4162420490100d2e836537c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:44.481508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-abd3e822-e568-4ab5-8a01-2ccdbc0b22b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:44.530480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:44.575859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a372391-ca23-463f-b4b1-91400b3bb0e1 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:44.589503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53a5f2-319a-42de-ad55-454302885eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:44.590708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53a5f2-319a-42de-ad55-454302885eaa service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:44.591000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53a5f2-319a-42de-ad55-454302885eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:44.591277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53a5f2-319a-42de-ad55-454302885eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:44.594563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0f53a5f2-319a-42de-ad55-454302885eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:44.606874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53a5f2-319a-42de-ad55-454302885eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:44.608639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53a5f2-319a-42de-ad55-454302885eaa service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:44.614193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 848/1697] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:44.617589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a7bed-2cdf-4cf7-8620-90390543e0f5 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:44.617918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a7bed-2cdf-4cf7-8620-90390543e0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:44.618816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a7bed-2cdf-4cf7-8620-90390543e0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:44.628190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 850/1698] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:44.629445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53a5f2-319a-42de-ad55-454302885eaa service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:44.632666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0f53a5f2-319a-42de-ad55-454302885eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:44.674005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-623a7bed-2cdf-4cf7-8620-90390543e0f5 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:44.676578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-623a7bed-2cdf-4cf7-8620-90390543e0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:44.744907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53a5f2-319a-42de-ad55-454302885eaa service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:44.769688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e8a98-6933-4ff7-a634-57897a84de78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:44.770604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e8a98-6933-4ff7-a634-57897a84de78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:44.770897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e8a98-6933-4ff7-a634-57897a84de78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:44.771228 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e8a98-6933-4ff7-a634-57897a84de78 admin admin] PATH_INFO: `/v3/projects/39a03833058c4d7f851172b55cd8407d` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:44.773189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e8a98-6933-4ff7-a634-57897a84de78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a03833058c4d7f851172b55cd8407d)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:44.783349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e8a98-6933-4ff7-a634-57897a84de78 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:44.785751 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:44.872773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 849/1699] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:44.874249 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a7bed-2cdf-4cf7-8620-90390543e0f5 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:44.882619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-623a7bed-2cdf-4cf7-8620-90390543e0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:44.883458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8d5e8a98-6933-4ff7-a634-57897a84de78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a03833058c4d7f851172b55cd8407d', 'request_id': 'req-8d5e8a98-6933-4ff7-a634-57897a84de78'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.894113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8d5e8a98-6933-4ff7-a634-57897a84de78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a03833058c4d7f851172b55cd8407d', 'request_id': 'req-8d5e8a98-6933-4ff7-a634-57897a84de78'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.918269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8d5e8a98-6933-4ff7-a634-57897a84de78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a03833058c4d7f851172b55cd8407d', 'request_id': 'req-8d5e8a98-6933-4ff7-a634-57897a84de78'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.939197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8d5e8a98-6933-4ff7-a634-57897a84de78 admin admin] The token cache is being invalidate because project 39a03833058c4d7f851172b55cd8407d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:10:44.939546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8d5e8a98-6933-4ff7-a634-57897a84de78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.940187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8d5e8a98-6933-4ff7-a634-57897a84de78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:44.941754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 851/1700] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:10:44 2022] DELETE /identity/v3/projects/39a03833058c4d7f851172b55cd8407d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:44.947241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feb006-b8ad-4602-99f9-73580bf5f036 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:44.947849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feb006-b8ad-4602-99f9-73580bf5f036 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:44.947849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feb006-b8ad-4602-99f9-73580bf5f036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:44.990583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-36feb006-b8ad-4602-99f9-73580bf5f036 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:44.992055 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-36feb006-b8ad-4602-99f9-73580bf5f036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:44.995606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a7bed-2cdf-4cf7-8620-90390543e0f5 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:45.150316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 852/1701] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:45.150316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feb006-b8ad-4602-99f9-73580bf5f036 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:45.150316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-36feb006-b8ad-4602-99f9-73580bf5f036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:45.159002 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46740b2b-60bd-4b6a-83ae-0947ed3ab9ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:45.159625 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46740b2b-60bd-4b6a-83ae-0947ed3ab9ba service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:45.160053 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46740b2b-60bd-4b6a-83ae-0947ed3ab9ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:45.160297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46740b2b-60bd-4b6a-83ae-0947ed3ab9ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:45.165808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-46740b2b-60bd-4b6a-83ae-0947ed3ab9ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:45.224200 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feb006-b8ad-4602-99f9-73580bf5f036 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:45.232027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e38e5d-277e-4172-b867-ea67d7cc33e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:45.232969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e38e5d-277e-4172-b867-ea67d7cc33e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:45.233260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e38e5d-277e-4172-b867-ea67d7cc33e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:45.233538 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e38e5d-277e-4172-b867-ea67d7cc33e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:45.235596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-67e38e5d-277e-4172-b867-ea67d7cc33e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:45.240058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:45.268278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e38e5d-277e-4172-b867-ea67d7cc33e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:45.276654 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e38e5d-277e-4172-b867-ea67d7cc33e6 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:45.314341 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 853/1702] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:45.315274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e38e5d-277e-4172-b867-ea67d7cc33e6 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:45.337077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46740b2b-60bd-4b6a-83ae-0947ed3ab9ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:45.338155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-67e38e5d-277e-4172-b867-ea67d7cc33e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:45.338690 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46740b2b-60bd-4b6a-83ae-0947ed3ab9ba service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:45.359376 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 850/1703] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:45.360884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cfaac-578d-4a0f-a69d-616cece3b782 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:45.361305 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cfaac-578d-4a0f-a69d-616cece3b782 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:45.362138 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cfaac-578d-4a0f-a69d-616cece3b782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:45.383521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e38e5d-277e-4172-b867-ea67d7cc33e6 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:45.396277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:45.397069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:45.397596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:45.397983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] PATH_INFO: `/v3/projects/d791ee9517ba4d90a600825d27214d37` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:45.401533 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d791ee9517ba4d90a600825d27214d37)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:45.407541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:45.429659 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-900cfaac-578d-4a0f-a69d-616cece3b782 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:45.433946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-900cfaac-578d-4a0f-a69d-616cece3b782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:45.464958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 851/1704] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:45.466731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cfaac-578d-4a0f-a69d-616cece3b782 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:45.482756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cfaac-578d-4a0f-a69d-616cece3b782 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:45.511145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad79231-e7bb-4938-b09c-7569c0f8a3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:45.512374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad79231-e7bb-4938-b09c-7569c0f8a3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:45.512917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad79231-e7bb-4938-b09c-7569c0f8a3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:45.513443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad79231-e7bb-4938-b09c-7569c0f8a3e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:45.514352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad79231-e7bb-4938-b09c-7569c0f8a3e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:45.517218 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad79231-e7bb-4938-b09c-7569c0f8a3e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:45.521338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad79231-e7bb-4938-b09c-7569c0f8a3e7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:45.529060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:45.551317 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 852/1705] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:45.552527 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad79231-e7bb-4938-b09c-7569c0f8a3e7 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:45.557775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-dad79231-e7bb-4938-b09c-7569c0f8a3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:45.573006 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd791ee9517ba4d90a600825d27214d37', 'request_id': 'req-206ca9e5-88c0-46e2-a92f-e45636873af3'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:45.587172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad79231-e7bb-4938-b09c-7569c0f8a3e7 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:45.591131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd791ee9517ba4d90a600825d27214d37', 'request_id': 'req-206ca9e5-88c0-46e2-a92f-e45636873af3'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:45.608811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd791ee9517ba4d90a600825d27214d37', 'request_id': 'req-206ca9e5-88c0-46e2-a92f-e45636873af3'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:45.634954 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] The token cache is being invalidate because project d791ee9517ba4d90a600825d27214d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:10:45.635258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:45.635945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:45.639692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 854/1706] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:10:45 2022] DELETE /identity/v3/projects/d791ee9517ba4d90a600825d27214d37 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:45.640588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:45.650460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:45.734069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62106353-8398-4701-846f-e1bac9a773be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:45.734694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62106353-8398-4701-846f-e1bac9a773be service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:45.734987 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62106353-8398-4701-846f-e1bac9a773be service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:45.735768 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62106353-8398-4701-846f-e1bac9a773be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:45.739766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-62106353-8398-4701-846f-e1bac9a773be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:45.858078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ca9e5-88c0-46e2-a92f-e45636873af3 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:45.871697 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f7d7-cf56-49a4-97e6-a200820d25e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:45.872337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f7d7-cf56-49a4-97e6-a200820d25e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:45.872823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f7d7-cf56-49a4-97e6-a200820d25e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:45.873112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f7d7-cf56-49a4-97e6-a200820d25e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:45.873764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8f7d7-cf56-49a4-97e6-a200820d25e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:45.876866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8f7d7-cf56-49a4-97e6-a200820d25e7 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:45.924260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62106353-8398-4701-846f-e1bac9a773be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:45.933796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62106353-8398-4701-846f-e1bac9a773be service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:45.947086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 855/1707] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:45 2022] POST /identity/v3/projects => generated 375 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:45.948000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f7d7-cf56-49a4-97e6-a200820d25e7 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:45.951161 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-03c8f7d7-cf56-49a4-97e6-a200820d25e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:45.979038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 853/1708] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:45.987299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62106353-8398-4701-846f-e1bac9a773be service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:45.997068 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-62106353-8398-4701-846f-e1bac9a773be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:46.088308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f7d7-cf56-49a4-97e6-a200820d25e7 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:46.095445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:46.096714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:46.097789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:46.098572 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] PATH_INFO: `/v3/users/0f45ca7013c34bc08a1543d1f2c876e9` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:46.104793 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f45ca7013c34bc08a1543d1f2c876e9)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:46.108186 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:46.177206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62106353-8398-4701-846f-e1bac9a773be service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:46.185071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:46.266487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:46.271080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f45ca7013c34bc08a1543d1f2c876e9'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.285035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f45ca7013c34bc08a1543d1f2c876e9'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.325938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f45ca7013c34bc08a1543d1f2c876e9'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.326351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e93b3-0e18-4023-9a3e-d145150aacca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b918da0f83754f3887de1cfa2e4df028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:46.327021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e93b3-0e18-4023-9a3e-d145150aacca service placement] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:46.327286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e93b3-0e18-4023-9a3e-d145150aacca service placement] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:46.327569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e93b3-0e18-4023-9a3e-d145150aacca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:46.328977 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f45ca7013c34bc08a1543d1f2c876e9'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.329534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-372e93b3-0e18-4023-9a3e-d145150aacca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:46.330409 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f45ca7013c34bc08a1543d1f2c876e9'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.366800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e93b3-0e18-4023-9a3e-d145150aacca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:46.369210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e93b3-0e18-4023-9a3e-d145150aacca service placement] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:46.378004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 856/1709] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:10:45 2022] DELETE /identity/v3/users/0f45ca7013c34bc08a1543d1f2c876e9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:46.378004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:46.378004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:46.402562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 854/1710] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:46.403856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f40a2-6b54-4ad6-9d00-025d3aeb971c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:46.404153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f40a2-6b54-4ad6-9d00-025d3aeb971c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:46.404442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f40a2-6b54-4ad6-9d00-025d3aeb971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:46.449838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b97f40a2-6b54-4ad6-9d00-025d3aeb971c None None] MFA Rules not processed for user `e181e79d294845dd88c91a9dff2831f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:46.453084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b97f40a2-6b54-4ad6-9d00-025d3aeb971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:46.491606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81209aa6-8ff0-4428-8007-427147ea0091 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:46.497804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640309b-8a47-4b7a-8597-90649fa039e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:46.498475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640309b-8a47-4b7a-8597-90649fa039e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:46.498814 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640309b-8a47-4b7a-8597-90649fa039e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:46.499277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640309b-8a47-4b7a-8597-90649fa039e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:46.499940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640309b-8a47-4b7a-8597-90649fa039e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:46.504972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640309b-8a47-4b7a-8597-90649fa039e9 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:46.551341 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 857/1711] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:46 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:46.551341 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640309b-8a47-4b7a-8597-90649fa039e9 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:46.556210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b640309b-8a47-4b7a-8597-90649fa039e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:46.573264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 855/1712] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:46.574399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f40a2-6b54-4ad6-9d00-025d3aeb971c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:46.579177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b97f40a2-6b54-4ad6-9d00-025d3aeb971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:46.606009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f40a2-6b54-4ad6-9d00-025d3aeb971c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:46.609372 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640309b-8a47-4b7a-8597-90649fa039e9 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:46.618452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:46.619332 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:46.620539 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:46.621210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] PATH_INFO: `/v3/users/4183249aa90b4d42937d336e629dd5f9` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:46.625544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4183249aa90b4d42937d336e629dd5f9)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:46.642517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:46.660371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef71892-b6ac-4ec9-8e6b-748b24a60146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:46.664181 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71892-b6ac-4ec9-8e6b-748b24a60146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:46.664181 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71892-b6ac-4ec9-8e6b-748b24a60146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:46.664382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71892-b6ac-4ec9-8e6b-748b24a60146 admin admin] PATH_INFO: `/v3/projects/ed6f4338045b412da87fafecc1289f0a` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:46.669649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef71892-b6ac-4ec9-8e6b-748b24a60146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6f4338045b412da87fafecc1289f0a)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:46.688946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef71892-b6ac-4ec9-8e6b-748b24a60146 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:46.840294 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4183249aa90b4d42937d336e629dd5f9'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.867811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4183249aa90b4d42937d336e629dd5f9'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.868417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7ef71892-b6ac-4ec9-8e6b-748b24a60146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6f4338045b412da87fafecc1289f0a', 'request_id': 'req-7ef71892-b6ac-4ec9-8e6b-748b24a60146'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.868550 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4183249aa90b4d42937d336e629dd5f9'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.871201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4183249aa90b4d42937d336e629dd5f9'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.886638 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7ef71892-b6ac-4ec9-8e6b-748b24a60146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6f4338045b412da87fafecc1289f0a', 'request_id': 'req-7ef71892-b6ac-4ec9-8e6b-748b24a60146'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.901997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4183249aa90b4d42937d336e629dd5f9'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.910689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7ef71892-b6ac-4ec9-8e6b-748b24a60146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6f4338045b412da87fafecc1289f0a', 'request_id': 'req-7ef71892-b6ac-4ec9-8e6b-748b24a60146'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.938071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 856/1713] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:10:46 2022] DELETE /identity/v3/users/4183249aa90b4d42937d336e629dd5f9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:46.938272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:46.946372 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:46.952873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7ef71892-b6ac-4ec9-8e6b-748b24a60146 admin admin] The token cache is being invalidate because project ed6f4338045b412da87fafecc1289f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:10:46.953413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7ef71892-b6ac-4ec9-8e6b-748b24a60146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.953992 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7ef71892-b6ac-4ec9-8e6b-748b24a60146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:46.957153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 858/1714] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:10:46 2022] DELETE /identity/v3/projects/ed6f4338045b412da87fafecc1289f0a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:46.960483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb8af9-10fc-4e0d-8fce-3ec5595359af None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:46.960483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb8af9-10fc-4e0d-8fce-3ec5595359af None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:46.961724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb8af9-10fc-4e0d-8fce-3ec5595359af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:46.997237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:47.020708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-cdcb8af9-10fc-4e0d-8fce-3ec5595359af None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:47.027094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-cdcb8af9-10fc-4e0d-8fce-3ec5595359af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:47.105893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:DELETE=11,keystone:SELECT=84,keystone:INSERT=5 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:47.180960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd893bc-35dc-40a7-93b1-0ee5351a31c3 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:47.194411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 859/1715] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:47.200599 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb8af9-10fc-4e0d-8fce-3ec5595359af None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:47.200811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cae60-b59a-4e09-b556-9d655fe0bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:47.201340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cae60-b59a-4e09-b556-9d655fe0bdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:47.201622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cae60-b59a-4e09-b556-9d655fe0bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:47.201899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cae60-b59a-4e09-b556-9d655fe0bdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:47.202548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cae60-b59a-4e09-b556-9d655fe0bdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:47.204160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cae60-b59a-4e09-b556-9d655fe0bdd9 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:47.205112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-cdcb8af9-10fc-4e0d-8fce-3ec5595359af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:47.225657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb8af9-10fc-4e0d-8fce-3ec5595359af None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:47.237894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 857/1716] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:47.237894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e09e7-ae5e-4ab8-9c5f-fb9c42c67286 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:47.237894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e09e7-ae5e-4ab8-9c5f-fb9c42c67286 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:47.237894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e09e7-ae5e-4ab8-9c5f-fb9c42c67286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:47.247762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:47.252215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:47.254486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:47.255214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] PATH_INFO: `/v3/users/900879594bd34eacbbd8b1c8aac84308` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:47.258562 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900879594bd34eacbbd8b1c8aac84308)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:47.263265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:47.310541 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-a78e09e7-ae5e-4ab8-9c5f-fb9c42c67286 None None] MFA Rules not processed for user `6ddf97a836074da89dacb0d8029e2165`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:47.313403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a78e09e7-ae5e-4ab8-9c5f-fb9c42c67286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:47.373646 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900879594bd34eacbbd8b1c8aac84308'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:47.393593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900879594bd34eacbbd8b1c8aac84308'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:47.431157 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900879594bd34eacbbd8b1c8aac84308'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:47.432973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900879594bd34eacbbd8b1c8aac84308'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:47.434553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900879594bd34eacbbd8b1c8aac84308'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:47.466959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 860/1717] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:10:47 2022] DELETE /identity/v3/users/900879594bd34eacbbd8b1c8aac84308 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:47.468086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:47.473113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:47.527671 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 858/1718] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:47.529222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e09e7-ae5e-4ab8-9c5f-fb9c42c67286 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:47.541885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a78e09e7-ae5e-4ab8-9c5f-fb9c42c67286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:47.579191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e09e7-ae5e-4ab8-9c5f-fb9c42c67286 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:47.709064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3b9fe-e7dc-48b0-95e4-23f76bbd9c41 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:47.734982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739e607-8736-4117-9cc6-a729f89b285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:47.735795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739e607-8736-4117-9cc6-a729f89b285b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:47.736177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739e607-8736-4117-9cc6-a729f89b285b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:47.736552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739e607-8736-4117-9cc6-a729f89b285b admin admin] PATH_INFO: `/v3/projects/635e4aed1f814824aefeb5b8c250babf` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:47.738702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739e607-8736-4117-9cc6-a729f89b285b admin admin] RBAC: Authorizing `identity:delete_project(project_id=635e4aed1f814824aefeb5b8c250babf)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:47.748144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739e607-8736-4117-9cc6-a729f89b285b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:47.783676 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328e67-9f4c-460a-9f80-6ba8c63a5458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:47.797522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328e67-9f4c-460a-9f80-6ba8c63a5458 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:47.797945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328e67-9f4c-460a-9f80-6ba8c63a5458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:47.799651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328e67-9f4c-460a-9f80-6ba8c63a5458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:47.799651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e328e67-9f4c-460a-9f80-6ba8c63a5458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:47.804412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e328e67-9f4c-460a-9f80-6ba8c63a5458 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:47.851669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 859/1719] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:47.852836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328e67-9f4c-460a-9f80-6ba8c63a5458 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:47.860736 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5e328e67-9f4c-460a-9f80-6ba8c63a5458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:47.938805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:47.965529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e739e607-8736-4117-9cc6-a729f89b285b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635e4aed1f814824aefeb5b8c250babf', 'request_id': 'req-e739e607-8736-4117-9cc6-a729f89b285b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:47.992835 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e739e607-8736-4117-9cc6-a729f89b285b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635e4aed1f814824aefeb5b8c250babf', 'request_id': 'req-e739e607-8736-4117-9cc6-a729f89b285b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:48.015452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e739e607-8736-4117-9cc6-a729f89b285b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635e4aed1f814824aefeb5b8c250babf', 'request_id': 'req-e739e607-8736-4117-9cc6-a729f89b285b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:48.056156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:48.078544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e739e607-8736-4117-9cc6-a729f89b285b admin admin] The token cache is being invalidate because project 635e4aed1f814824aefeb5b8c250babf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:10:48.080958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e739e607-8736-4117-9cc6-a729f89b285b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:48.082637 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e739e607-8736-4117-9cc6-a729f89b285b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:48.089925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 861/1720] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:10:47 2022] DELETE /identity/v3/projects/635e4aed1f814824aefeb5b8c250babf => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:48.093972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690be1e0-a4a5-4053-8156-46a61cbbba49 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:48.096272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690be1e0-a4a5-4053-8156-46a61cbbba49 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:48.097570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690be1e0-a4a5-4053-8156-46a61cbbba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:48.114538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328e67-9f4c-460a-9f80-6ba8c63a5458 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:48.215455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-690be1e0-a4a5-4053-8156-46a61cbbba49 None None] MFA Rules not processed for user `a82ffedb9d854ad0a5044c5cbec62ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:48.220906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-690be1e0-a4a5-4053-8156-46a61cbbba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:48.279995 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba3986-4d66-432f-a192-ab994e6c84bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:48.280760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba3986-4d66-432f-a192-ab994e6c84bf service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:48.281540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba3986-4d66-432f-a192-ab994e6c84bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:48.281871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba3986-4d66-432f-a192-ab994e6c84bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:48.293326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-91ba3986-4d66-432f-a192-ab994e6c84bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:48.495271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 862/1721] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:48.496288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690be1e0-a4a5-4053-8156-46a61cbbba49 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:48.503496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-690be1e0-a4a5-4053-8156-46a61cbbba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:48.561690 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba3986-4d66-432f-a192-ab994e6c84bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:48.563234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba3986-4d66-432f-a192-ab994e6c84bf service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:48.613969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 860/1722] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 761 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:48.617247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba3986-4d66-432f-a192-ab994e6c84bf service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:48.623040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-91ba3986-4d66-432f-a192-ab994e6c84bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:48.666670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba3986-4d66-432f-a192-ab994e6c84bf service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:48.691347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7f7c7-62ba-4699-b474-fd83009f5331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:48.692909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7f7c7-62ba-4699-b474-fd83009f5331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:48.693145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7f7c7-62ba-4699-b474-fd83009f5331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:48.693590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7f7c7-62ba-4699-b474-fd83009f5331 admin admin] PATH_INFO: `/v3/projects/3c43bb4c1f174a88bbc3c4efb9a08d7f/users/771c738d923849cf810bfcddb61e43d4/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:48.747516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7f7c7-62ba-4699-b474-fd83009f5331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c43bb4c1f174a88bbc3c4efb9a08d7f, user_id=771c738d923849cf810bfcddb61e43d4, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:48.756846 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7f7c7-62ba-4699-b474-fd83009f5331 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:48.784384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690be1e0-a4a5-4053-8156-46a61cbbba49 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:48.811717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 861/1723] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:48 2022] PUT /identity/v3/projects/3c43bb4c1f174a88bbc3c4efb9a08d7f/users/771c738d923849cf810bfcddb61e43d4/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:48.814531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb03b87-0433-45df-aa79-adee3dcbf88d None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:48.817481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb03b87-0433-45df-aa79-adee3dcbf88d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:48.817632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb03b87-0433-45df-aa79-adee3dcbf88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:48.892276 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-afb03b87-0433-45df-aa79-adee3dcbf88d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:48.893537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-afb03b87-0433-45df-aa79-adee3dcbf88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:49.010633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:49.032152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2be1b-35ea-49ea-834f-1d8f0e65d4b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:49.033307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2be1b-35ea-49ea-834f-1d8f0e65d4b4 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:49.033307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2be1b-35ea-49ea-834f-1d8f0e65d4b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:49.033488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2be1b-35ea-49ea-834f-1d8f0e65d4b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:49.035949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8bc2be1b-35ea-49ea-834f-1d8f0e65d4b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:49.089114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 862/1724] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:49.090014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb03b87-0433-45df-aa79-adee3dcbf88d None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:49.093375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-afb03b87-0433-45df-aa79-adee3dcbf88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:49.119829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb03b87-0433-45df-aa79-adee3dcbf88d None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:49.136802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa383de-a999-4373-bc1c-15d15f2a9e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:49.137483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa383de-a999-4373-bc1c-15d15f2a9e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:49.137733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa383de-a999-4373-bc1c-15d15f2a9e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:49.138019 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa383de-a999-4373-bc1c-15d15f2a9e96 admin admin] PATH_INFO: `/v3/projects/55846b42e18c44ab9d3f5952f6a626c2` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:49.140070 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa383de-a999-4373-bc1c-15d15f2a9e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55846b42e18c44ab9d3f5952f6a626c2)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:49.141991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa383de-a999-4373-bc1c-15d15f2a9e96 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:49.164293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:49.176648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2be1b-35ea-49ea-834f-1d8f0e65d4b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:49.178627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2be1b-35ea-49ea-834f-1d8f0e65d4b4 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:49.214428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 863/1725] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:49.216335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a3c85-313a-4dcc-b746-2ccee62a23a3 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:49.216632 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a3c85-313a-4dcc-b746-2ccee62a23a3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:49.216938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a3c85-313a-4dcc-b746-2ccee62a23a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:49.291787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5fa383de-a999-4373-bc1c-15d15f2a9e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55846b42e18c44ab9d3f5952f6a626c2', 'request_id': 'req-5fa383de-a999-4373-bc1c-15d15f2a9e96'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:49.304551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f99a3c85-313a-4dcc-b746-2ccee62a23a3 None None] MFA Rules not processed for user `a82ffedb9d854ad0a5044c5cbec62ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:49.307918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f99a3c85-313a-4dcc-b746-2ccee62a23a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:49.321353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5fa383de-a999-4373-bc1c-15d15f2a9e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55846b42e18c44ab9d3f5952f6a626c2', 'request_id': 'req-5fa383de-a999-4373-bc1c-15d15f2a9e96'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:49.330087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5fa383de-a999-4373-bc1c-15d15f2a9e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55846b42e18c44ab9d3f5952f6a626c2', 'request_id': 'req-5fa383de-a999-4373-bc1c-15d15f2a9e96'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:49.366343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5fa383de-a999-4373-bc1c-15d15f2a9e96 admin admin] The token cache is being invalidate because project 55846b42e18c44ab9d3f5952f6a626c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:10:49.366672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5fa383de-a999-4373-bc1c-15d15f2a9e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:49.369174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5fa383de-a999-4373-bc1c-15d15f2a9e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:49.375579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 863/1726] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:10:49 2022] DELETE /identity/v3/projects/55846b42e18c44ab9d3f5952f6a626c2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:49.377335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c86c8f-f5ea-4002-937d-3780eb6af50e None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:49.377335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c86c8f-f5ea-4002-937d-3780eb6af50e None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:49.378456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c86c8f-f5ea-4002-937d-3780eb6af50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:49.469996 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-50c86c8f-f5ea-4002-937d-3780eb6af50e None None] MFA Rules not processed for user `771c738d923849cf810bfcddb61e43d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:49.476851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-50c86c8f-f5ea-4002-937d-3780eb6af50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:49.501072 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 864/1727] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:49.508841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90849f-574d-4712-8989-49a3f311f570 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:49.509534 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90849f-574d-4712-8989-49a3f311f570 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:49.510588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90849f-574d-4712-8989-49a3f311f570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:49.566958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-fb90849f-574d-4712-8989-49a3f311f570 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:49.568286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-fb90849f-574d-4712-8989-49a3f311f570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:49.663800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 864/1728] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:49.667723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768aec55-badd-44c9-8c91-8525d25ff541 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:49.668029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768aec55-badd-44c9-8c91-8525d25ff541 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:49.668311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768aec55-badd-44c9-8c91-8525d25ff541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:49.674199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 865/1729] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:49.675441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90849f-574d-4712-8989-49a3f311f570 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:49.680676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-fb90849f-574d-4712-8989-49a3f311f570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:49.734839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-768aec55-badd-44c9-8c91-8525d25ff541 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:49.736147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-768aec55-badd-44c9-8c91-8525d25ff541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:49.773764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 865/1730] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:49.774758 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768aec55-badd-44c9-8c91-8525d25ff541 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:49.784438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-768aec55-badd-44c9-8c91-8525d25ff541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:49.829903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:49.890679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90849f-574d-4712-8989-49a3f311f570 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:49.907604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1c513-dfad-4a8c-8eaa-84914e48af5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:49.908515 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c513-dfad-4a8c-8eaa-84914e48af5a service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:49.909121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c513-dfad-4a8c-8eaa-84914e48af5a service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:49.909561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c513-dfad-4a8c-8eaa-84914e48af5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:49.915816 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2ed1c513-dfad-4a8c-8eaa-84914e48af5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:49.950546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1c513-dfad-4a8c-8eaa-84914e48af5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:49.954689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1c513-dfad-4a8c-8eaa-84914e48af5a service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:49.994235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 866/1731] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:49.994235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1c513-dfad-4a8c-8eaa-84914e48af5a service nova] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:50.027917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1c513-dfad-4a8c-8eaa-84914e48af5a service nova] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:50.042098 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314620e-8242-471f-a0fa-d870f65d8ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:50.042742 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314620e-8242-471f-a0fa-d870f65d8ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:50.043021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314620e-8242-471f-a0fa-d870f65d8ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:50.043280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314620e-8242-471f-a0fa-d870f65d8ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:50.046392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314620e-8242-471f-a0fa-d870f65d8ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:50.046714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314620e-8242-471f-a0fa-d870f65d8ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:50.052332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314620e-8242-471f-a0fa-d870f65d8ef7 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:50.053863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768aec55-badd-44c9-8c91-8525d25ff541 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:50.061024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded75fd3-0884-4ec4-a506-de2d8a652d98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc71e3a41ac644ff8a908b766495b5f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:50.061657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded75fd3-0884-4ec4-a506-de2d8a652d98 service glance] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:50.061934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded75fd3-0884-4ec4-a506-de2d8a652d98 service glance] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:50.062338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded75fd3-0884-4ec4-a506-de2d8a652d98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:50.103089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 867/1732] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:50.108103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314620e-8242-471f-a0fa-d870f65d8ef7 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:50.112196 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded75fd3-0884-4ec4-a506-de2d8a652d98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:50.115015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded75fd3-0884-4ec4-a506-de2d8a652d98 service glance] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:50.117897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c314620e-8242-471f-a0fa-d870f65d8ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:50.164414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314620e-8242-471f-a0fa-d870f65d8ef7 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:50.181121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 866/1733] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:50.183140 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cd7c4-5786-4603-a1bf-0bf1009a90b2 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:50.183788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cd7c4-5786-4603-a1bf-0bf1009a90b2 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:50.183788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cd7c4-5786-4603-a1bf-0bf1009a90b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:50.184887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:50.187539 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:50.188229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:50.190608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] PATH_INFO: `/v3/projects/f7d7979b33b74bf4ad50d65f6e0d72a1` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:50.195564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d7979b33b74bf4ad50d65f6e0d72a1)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:50.203605 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:50.221444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:50.236714 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-803cd7c4-5786-4603-a1bf-0bf1009a90b2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:50.240039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-803cd7c4-5786-4603-a1bf-0bf1009a90b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:50.262967 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 867/1734] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:50.264066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cd7c4-5786-4603-a1bf-0bf1009a90b2 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:50.290226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cd7c4-5786-4603-a1bf-0bf1009a90b2 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:50.295738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45ec40-a76f-453b-95c0-4fdc2f4ebba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:50.296368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45ec40-a76f-453b-95c0-4fdc2f4ebba5 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:50.296646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45ec40-a76f-453b-95c0-4fdc2f4ebba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:50.296951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45ec40-a76f-453b-95c0-4fdc2f4ebba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:50.297594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45ec40-a76f-453b-95c0-4fdc2f4ebba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:50.300231 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45ec40-a76f-453b-95c0-4fdc2f4ebba5 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:50.357025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 868/1735] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:50 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:50.359442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45ec40-a76f-453b-95c0-4fdc2f4ebba5 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:50.369452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d7979b33b74bf4ad50d65f6e0d72a1', 'request_id': 'req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:50.406927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d7979b33b74bf4ad50d65f6e0d72a1', 'request_id': 'req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:50.445026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d7979b33b74bf4ad50d65f6e0d72a1', 'request_id': 'req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:50.460896 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] The token cache is being invalidate because project f7d7979b33b74bf4ad50d65f6e0d72a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:10:50.461713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:50.462529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:50.470066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 868/1736] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:10:50 2022] DELETE /identity/v3/projects/f7d7979b33b74bf4ad50d65f6e0d72a1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:50.470066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:50.472363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:50.622039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45ec40-a76f-453b-95c0-4fdc2f4ebba5 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:50.639837 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee41cda-fbd2-48ba-97d7-82d226c39ebe admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:50.643909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b507f-0e32-40b8-abb9-040371acca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:50.644621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b507f-0e32-40b8-abb9-040371acca84 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:50.644937 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b507f-0e32-40b8-abb9-040371acca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:50.645209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b507f-0e32-40b8-abb9-040371acca84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:50.646051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b507f-0e32-40b8-abb9-040371acca84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:50.646413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b507f-0e32-40b8-abb9-040371acca84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:50.648040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b507f-0e32-40b8-abb9-040371acca84 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:50.665335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e70575-3d9d-40bd-b076-dc309ddc6d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:50.666078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e70575-3d9d-40bd-b076-dc309ddc6d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:50.666466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e70575-3d9d-40bd-b076-dc309ddc6d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:50.667063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e70575-3d9d-40bd-b076-dc309ddc6d27 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:50.667879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e70575-3d9d-40bd-b076-dc309ddc6d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:50.669990 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e70575-3d9d-40bd-b076-dc309ddc6d27 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:50.675401 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 869/1737] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:50.688774 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b25256-09f2-41d4-bc9a-3b7fc320d6b7 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:50.692672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b25256-09f2-41d4-bc9a-3b7fc320d6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:50.694351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b25256-09f2-41d4-bc9a-3b7fc320d6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:50.714991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 869/1738] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:50 2022] POST /identity/v3/users => generated 282 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:50.721266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e18d60-b289-430a-89fc-880cbd6effad None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:50.723538 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e18d60-b289-430a-89fc-880cbd6effad None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:50.723948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e18d60-b289-430a-89fc-880cbd6effad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:50.766662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-d0b25256-09f2-41d4-bc9a-3b7fc320d6b7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:50.772785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d0b25256-09f2-41d4-bc9a-3b7fc320d6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:50.821136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 870/1739] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:50.822101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b25256-09f2-41d4-bc9a-3b7fc320d6b7 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:50.831575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d0b25256-09f2-41d4-bc9a-3b7fc320d6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:50.874548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:50.885183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b25256-09f2-41d4-bc9a-3b7fc320d6b7 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:50.891601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-27e18d60-b289-430a-89fc-880cbd6effad None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:50.893120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-27e18d60-b289-430a-89fc-880cbd6effad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:50.907958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80438068-16df-44b4-81d2-34bf02e41266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:50.908377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80438068-16df-44b4-81d2-34bf02e41266 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:50.908662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80438068-16df-44b4-81d2-34bf02e41266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:50.908962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80438068-16df-44b4-81d2-34bf02e41266 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:50.909610 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80438068-16df-44b4-81d2-34bf02e41266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:50.917465 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80438068-16df-44b4-81d2-34bf02e41266 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:51.018152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 871/1740] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:50 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:51.020201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80438068-16df-44b4-81d2-34bf02e41266 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:51.073899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 870/1741] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:10:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:51.075236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8225-04b8-4cbe-876b-9f14e6955417 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:51.075636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8225-04b8-4cbe-876b-9f14e6955417 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:51.076022 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8225-04b8-4cbe-876b-9f14e6955417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:51.119487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-341c8225-04b8-4cbe-876b-9f14e6955417 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:51.122263 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-341c8225-04b8-4cbe-876b-9f14e6955417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:51.283112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80438068-16df-44b4-81d2-34bf02e41266 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:51.299973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411d33e-d228-490c-9319-22c5d2c338e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:51.300617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411d33e-d228-490c-9319-22c5d2c338e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:51.300933 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411d33e-d228-490c-9319-22c5d2c338e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:51.301212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411d33e-d228-490c-9319-22c5d2c338e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:51.301877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411d33e-d228-490c-9319-22c5d2c338e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:51.303883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411d33e-d228-490c-9319-22c5d2c338e8 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:51.331491 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 872/1742] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:51.332443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411d33e-d228-490c-9319-22c5d2c338e8 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:51.366272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411d33e-d228-490c-9319-22c5d2c338e8 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:51.421766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443e1bc-5741-483a-971a-4d6a133d76f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:51.423279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 871/1743] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:51.426869 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443e1bc-5741-483a-971a-4d6a133d76f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:51.427163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443e1bc-5741-483a-971a-4d6a133d76f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:51.427447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443e1bc-5741-483a-971a-4d6a133d76f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:51.433520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c8225-04b8-4cbe-876b-9f14e6955417 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:51.448990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443e1bc-5741-483a-971a-4d6a133d76f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:51.452085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c8225-04b8-4cbe-876b-9f14e6955417 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:51.455290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443e1bc-5741-483a-971a-4d6a133d76f4 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:51.465425 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5187e6e-60b4-4467-8227-f261e44f58da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:51.466269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5187e6e-60b4-4467-8227-f261e44f58da admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:51.466691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5187e6e-60b4-4467-8227-f261e44f58da admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:51.467112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5187e6e-60b4-4467-8227-f261e44f58da admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:51.467906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5187e6e-60b4-4467-8227-f261e44f58da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:51.469769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5187e6e-60b4-4467-8227-f261e44f58da admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:51.503467 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 872/1744] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:51.504960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5187e6e-60b4-4467-8227-f261e44f58da admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:51.539389 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5187e6e-60b4-4467-8227-f261e44f58da admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:51.585803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb4893-4306-48d8-8552-b2e683155224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:51.586018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb4893-4306-48d8-8552-b2e683155224 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:51.587316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb4893-4306-48d8-8552-b2e683155224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:51.588402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb4893-4306-48d8-8552-b2e683155224 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:51.589188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 873/1745] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:51 2022] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:51.590278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443e1bc-5741-483a-971a-4d6a133d76f4 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:51.591088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb4893-4306-48d8-8552-b2e683155224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:10:51.594337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a443e1bc-5741-483a-971a-4d6a133d76f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:51.598134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb4893-4306-48d8-8552-b2e683155224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:51.609123 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb4893-4306-48d8-8552-b2e683155224 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:51.652019 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:51.695374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 873/1746] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:10:51.696347 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb4893-4306-48d8-8552-b2e683155224 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:51.751262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb4893-4306-48d8-8552-b2e683155224 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:51.774871 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da271ac6-4fb5-420b-b79d-255403416e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:51.776048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da271ac6-4fb5-420b-b79d-255403416e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:51.776565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da271ac6-4fb5-420b-b79d-255403416e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:51.777126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da271ac6-4fb5-420b-b79d-255403416e34 admin admin] PATH_INFO: `/v3/projects/32bcb016cefd47489b137b86a54cc8ea/users/a4f96529c2bb4bed9149336a2517c78f/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:51.823421 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da271ac6-4fb5-420b-b79d-255403416e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bcb016cefd47489b137b86a54cc8ea, user_id=a4f96529c2bb4bed9149336a2517c78f, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:51.834818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443e1bc-5741-483a-971a-4d6a133d76f4 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:51.836105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da271ac6-4fb5-420b-b79d-255403416e34 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:51.864888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae836a9-155d-4fd7-b8d1-4b919ee4cd0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:51.868232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae836a9-155d-4fd7-b8d1-4b919ee4cd0e service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:51.868541 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae836a9-155d-4fd7-b8d1-4b919ee4cd0e service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:51.868957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae836a9-155d-4fd7-b8d1-4b919ee4cd0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:51.890087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 874/1747] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:51 2022] PUT /identity/v3/projects/32bcb016cefd47489b137b86a54cc8ea/users/a4f96529c2bb4bed9149336a2517c78f/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:51.901384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da271ac6-4fb5-420b-b79d-255403416e34 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:52.046766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:52.058238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da271ac6-4fb5-420b-b79d-255403416e34 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:52.070790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a1288-0d67-4f31-a860-f226449194ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:52.073781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a1288-0d67-4f31-a860-f226449194ed admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:52.074083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a1288-0d67-4f31-a860-f226449194ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:52.074647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a1288-0d67-4f31-a860-f226449194ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:52.075277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a1288-0d67-4f31-a860-f226449194ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:52.079022 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a1288-0d67-4f31-a860-f226449194ed admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:52.105861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 875/1748] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:52.106794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a1288-0d67-4f31-a860-f226449194ed admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:52.122543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae836a9-155d-4fd7-b8d1-4b919ee4cd0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:52.129722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae836a9-155d-4fd7-b8d1-4b919ee4cd0e service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:52.139726 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a1288-0d67-4f31-a860-f226449194ed admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:52.151640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51ac01-83b1-4704-af36-27aede704cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:52.152361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51ac01-83b1-4704-af36-27aede704cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:52.152760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51ac01-83b1-4704-af36-27aede704cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:52.153039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51ac01-83b1-4704-af36-27aede704cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:52.153685 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51ac01-83b1-4704-af36-27aede704cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:52.153896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 874/1749] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:10:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:10:52.155731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511fcbe-0051-49ca-aedd-d3bb91b8d294 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:52.155731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511fcbe-0051-49ca-aedd-d3bb91b8d294 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:52.155950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511fcbe-0051-49ca-aedd-d3bb91b8d294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:52.158068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51ac01-83b1-4704-af36-27aede704cbe admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:52.206646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-1511fcbe-0051-49ca-aedd-d3bb91b8d294 None None] MFA Rules not processed for user `a4f96529c2bb4bed9149336a2517c78f`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:52.208181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1511fcbe-0051-49ca-aedd-d3bb91b8d294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:52.236396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 876/1750] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:52 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:52.236396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51ac01-83b1-4704-af36-27aede704cbe admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:52.429037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 875/1751] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:52.429972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511fcbe-0051-49ca-aedd-d3bb91b8d294 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:52.461734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511fcbe-0051-49ca-aedd-d3bb91b8d294 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:52.479775 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51ac01-83b1-4704-af36-27aede704cbe admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:52.486404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f299e4f-8bef-4aa5-9ea7-c6319688cdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:52.487342 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f299e4f-8bef-4aa5-9ea7-c6319688cdaa admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:52.488184 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f299e4f-8bef-4aa5-9ea7-c6319688cdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:52.488957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f299e4f-8bef-4aa5-9ea7-c6319688cdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:52.489793 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f299e4f-8bef-4aa5-9ea7-c6319688cdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:52.493285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f299e4f-8bef-4aa5-9ea7-c6319688cdaa admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:52.519711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 877/1752] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:52.522314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5b1b-e6ac-4d9e-9ec9-7c23fd316097 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:52.526025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5b1b-e6ac-4d9e-9ec9-7c23fd316097 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:52.528253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5b1b-e6ac-4d9e-9ec9-7c23fd316097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:52.577423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:52.593302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-816f5b1b-e6ac-4d9e-9ec9-7c23fd316097 None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:52.595772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-816f5b1b-e6ac-4d9e-9ec9-7c23fd316097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:52.655497 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc20b43-e89c-46da-a864-bd6f1519e0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:52.656383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc20b43-e89c-46da-a864-bd6f1519e0fa admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:52.656790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc20b43-e89c-46da-a864-bd6f1519e0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:52.656947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc20b43-e89c-46da-a864-bd6f1519e0fa admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:52.657632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc20b43-e89c-46da-a864-bd6f1519e0fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:52.662792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc20b43-e89c-46da-a864-bd6f1519e0fa admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:52.720825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 876/1753] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:52 2022] POST /identity/v3/users => generated 287 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:52.720825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc20b43-e89c-46da-a864-bd6f1519e0fa admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:52.745248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc20b43-e89c-46da-a864-bd6f1519e0fa admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:52.764542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad143e7b-b80d-4a40-b7b3-7f2b67a50a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:52.769443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad143e7b-b80d-4a40-b7b3-7f2b67a50a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:52.769747 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad143e7b-b80d-4a40-b7b3-7f2b67a50a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:52.772750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad143e7b-b80d-4a40-b7b3-7f2b67a50a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:52.774541 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad143e7b-b80d-4a40-b7b3-7f2b67a50a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:52.776491 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad143e7b-b80d-4a40-b7b3-7f2b67a50a6e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:52.822880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 878/1754] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:10:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:52.824596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f5b1b-e6ac-4d9e-9ec9-7c23fd316097 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:52.884201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 877/1755] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:52 2022] POST /identity/v3/projects => generated 363 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:52.884201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad143e7b-b80d-4a40-b7b3-7f2b67a50a6e admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:52.901003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f5b1b-e6ac-4d9e-9ec9-7c23fd316097 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:53.002964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad143e7b-b80d-4a40-b7b3-7f2b67a50a6e admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:53.020171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b010a01-d992-4c15-aba2-585789d7009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:53.022183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b010a01-d992-4c15-aba2-585789d7009c admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:53.022485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b010a01-d992-4c15-aba2-585789d7009c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:53.022845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b010a01-d992-4c15-aba2-585789d7009c admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:53.028170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b010a01-d992-4c15-aba2-585789d7009c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:53.060727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b010a01-d992-4c15-aba2-585789d7009c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:53.098974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 878/1756] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:53.100546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b010a01-d992-4c15-aba2-585789d7009c admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:53.209469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891a510-8f8a-471e-a2e0-1682715f59ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:53.209469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891a510-8f8a-471e-a2e0-1682715f59ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:53.211396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891a510-8f8a-471e-a2e0-1682715f59ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:53.211396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891a510-8f8a-471e-a2e0-1682715f59ac admin admin] PATH_INFO: `/v3/projects/0e1bea12881d4a8abd4c18758aca4e1f/users/16ba2dfce71c48a59972b9ac0b6b57c0/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:53.253032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891a510-8f8a-471e-a2e0-1682715f59ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1bea12881d4a8abd4c18758aca4e1f, user_id=16ba2dfce71c48a59972b9ac0b6b57c0, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:53.268164 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891a510-8f8a-471e-a2e0-1682715f59ac admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:53.283819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:53.314438 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 879/1757] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:52 2022] PUT /identity/v3/projects/0e1bea12881d4a8abd4c18758aca4e1f/users/16ba2dfce71c48a59972b9ac0b6b57c0/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:53.326814 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891a510-8f8a-471e-a2e0-1682715f59ac admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:53.405127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b010a01-d992-4c15-aba2-585789d7009c admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:53.521406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:53.565415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891a510-8f8a-471e-a2e0-1682715f59ac admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:53.584173 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ac4b-9291-41e5-b6a3-3d711c992a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:53.585187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ac4b-9291-41e5-b6a3-3d711c992a17 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:53.585467 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ac4b-9291-41e5-b6a3-3d711c992a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:53.586162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ac4b-9291-41e5-b6a3-3d711c992a17 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:53.586367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ac4b-9291-41e5-b6a3-3d711c992a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:53.588325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ac4b-9291-41e5-b6a3-3d711c992a17 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:53.606981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df4224-f456-403c-a63f-fa70ac3ec04f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:53.607901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df4224-f456-403c-a63f-fa70ac3ec04f service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:53.610270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df4224-f456-403c-a63f-fa70ac3ec04f service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:53.610862 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df4224-f456-403c-a63f-fa70ac3ec04f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:53.688780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 880/1758] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:53 2022] POST /identity/v3/users => generated 288 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:53.695011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ac4b-9291-41e5-b6a3-3d711c992a17 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:53.717883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ac4b-9291-41e5-b6a3-3d711c992a17 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:53.723199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3f81a-864f-4d30-bc2e-dff4f56075cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:53.723822 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3f81a-864f-4d30-bc2e-dff4f56075cc admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:53.724104 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3f81a-864f-4d30-bc2e-dff4f56075cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:53.724376 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3f81a-864f-4d30-bc2e-dff4f56075cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:53.725979 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3f81a-864f-4d30-bc2e-dff4f56075cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:53.727585 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3f81a-864f-4d30-bc2e-dff4f56075cc admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:53.744551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 881/1759] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:53.746533 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6536c-4bff-4571-9612-33f137698b24 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:53.746828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6536c-4bff-4571-9612-33f137698b24 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:53.747749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6536c-4bff-4571-9612-33f137698b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:53.805489 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-60a6536c-4bff-4571-9612-33f137698b24 None None] MFA Rules not processed for user `16ba2dfce71c48a59972b9ac0b6b57c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:53.807379 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-60a6536c-4bff-4571-9612-33f137698b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:53.827192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df4224-f456-403c-a63f-fa70ac3ec04f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:53.828846 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df4224-f456-403c-a63f-fa70ac3ec04f service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:53.855899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 879/1760] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:10:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:10:53.856641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df4224-f456-403c-a63f-fa70ac3ec04f service swift] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:53.902581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df4224-f456-403c-a63f-fa70ac3ec04f service swift] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:53.938727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb711e7-e69f-4dc6-91bf-d76bb108a1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:53.939285 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb711e7-e69f-4dc6-91bf-d76bb108a1ff admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:53.939777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb711e7-e69f-4dc6-91bf-d76bb108a1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:53.939954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb711e7-e69f-4dc6-91bf-d76bb108a1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:53.940632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb711e7-e69f-4dc6-91bf-d76bb108a1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:53.942242 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb711e7-e69f-4dc6-91bf-d76bb108a1ff admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:54.003142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 880/1761] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:54.004848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb711e7-e69f-4dc6-91bf-d76bb108a1ff admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:54.034557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb711e7-e69f-4dc6-91bf-d76bb108a1ff admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:54.053434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06764e2-f77b-40eb-8bc1-f07ada0913d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:54.054458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06764e2-f77b-40eb-8bc1-f07ada0913d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:54.054941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06764e2-f77b-40eb-8bc1-f07ada0913d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:54.055373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06764e2-f77b-40eb-8bc1-f07ada0913d1 admin admin] PATH_INFO: `/v3/projects/b87a2bad9fb745ab8e58d5522599345f/users/c23098a4ca6c4451870861e9d902902c/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:54.125118 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06764e2-f77b-40eb-8bc1-f07ada0913d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87a2bad9fb745ab8e58d5522599345f, user_id=c23098a4ca6c4451870861e9d902902c, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:54.128400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 882/1762] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:54.131393 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06764e2-f77b-40eb-8bc1-f07ada0913d1 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:54.134918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6536c-4bff-4571-9612-33f137698b24 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:54.171861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 881/1763] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:54 2022] PUT /identity/v3/projects/b87a2bad9fb745ab8e58d5522599345f/users/c23098a4ca6c4451870861e9d902902c/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:54.180790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06764e2-f77b-40eb-8bc1-f07ada0913d1 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:54.204780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6536c-4bff-4571-9612-33f137698b24 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:54.482976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cd281-decb-4580-bb60-f5d286b685b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:54.483757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd281-decb-4580-bb60-f5d286b685b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:54.483923 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd281-decb-4580-bb60-f5d286b685b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:54.484198 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd281-decb-4580-bb60-f5d286b685b0 admin admin] PATH_INFO: `/v3/projects/404972ac0d7449b1a4fc5c64f6cefa8e/users/ab033b7f4341406ca272aab18281588c/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:54.494164 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:54.497364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06764e2-f77b-40eb-8bc1-f07ada0913d1 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:54.515978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3ca5c-cb82-49a3-83e2-9e5523d053c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:54.519218 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3ca5c-cb82-49a3-83e2-9e5523d053c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:54.519559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3ca5c-cb82-49a3-83e2-9e5523d053c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:54.519843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3ca5c-cb82-49a3-83e2-9e5523d053c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:54.520537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3ca5c-cb82-49a3-83e2-9e5523d053c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:54.528323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3ca5c-cb82-49a3-83e2-9e5523d053c6 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:54.534500 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cd281-decb-4580-bb60-f5d286b685b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404972ac0d7449b1a4fc5c64f6cefa8e, user_id=ab033b7f4341406ca272aab18281588c, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:54.537425 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cd281-decb-4580-bb60-f5d286b685b0 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:54.580133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 883/1764] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:54 2022] PUT /identity/v3/projects/404972ac0d7449b1a4fc5c64f6cefa8e/users/ab033b7f4341406ca272aab18281588c/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:54.583250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98323100-b234-4c9f-ac64-b9e5d29046de None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:54.583250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98323100-b234-4c9f-ac64-b9e5d29046de None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:54.583250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98323100-b234-4c9f-ac64-b9e5d29046de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:54.622847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 882/1765] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:54 2022] POST /identity/v3/projects => generated 379 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:54.624764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3ca5c-cb82-49a3-83e2-9e5523d053c6 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:54.655008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-98323100-b234-4c9f-ac64-b9e5d29046de None None] MFA Rules not processed for user `c23098a4ca6c4451870861e9d902902c`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:54.657780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-98323100-b234-4c9f-ac64-b9e5d29046de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:54.755892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:54.839877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3ca5c-cb82-49a3-83e2-9e5523d053c6 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:54.845617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65901-81ba-4c1c-acd9-1aef9fb59229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:54.846260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65901-81ba-4c1c-acd9-1aef9fb59229 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:54.846545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65901-81ba-4c1c-acd9-1aef9fb59229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:54.846824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65901-81ba-4c1c-acd9-1aef9fb59229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:54.847482 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc65901-81ba-4c1c-acd9-1aef9fb59229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:54.855369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc65901-81ba-4c1c-acd9-1aef9fb59229 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:54.860250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 884/1766] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:54.861495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98323100-b234-4c9f-ac64-b9e5d29046de None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:54.887470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98323100-b234-4c9f-ac64-b9e5d29046de None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:54.900444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c46acf-dfdc-49b8-b866-7a8024c3f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:54.901367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c46acf-dfdc-49b8-b866-7a8024c3f763 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:54.901806 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c46acf-dfdc-49b8-b866-7a8024c3f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:54.902254 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c46acf-dfdc-49b8-b866-7a8024c3f763 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:54.902745 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 883/1767] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:54.903647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c46acf-dfdc-49b8-b866-7a8024c3f763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:54.906400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65901-81ba-4c1c-acd9-1aef9fb59229 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:54.908657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c46acf-dfdc-49b8-b866-7a8024c3f763 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:54.950244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65901-81ba-4c1c-acd9-1aef9fb59229 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:54.965542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519494a-1608-40e5-b199-f517cc085d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:54.971828 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519494a-1608-40e5-b199-f517cc085d38 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:54.972195 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519494a-1608-40e5-b199-f517cc085d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:54.972595 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519494a-1608-40e5-b199-f517cc085d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:54.973545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519494a-1608-40e5-b199-f517cc085d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:54.977974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519494a-1608-40e5-b199-f517cc085d38 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:54.984046 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 885/1768] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:54 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:54.985277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c46acf-dfdc-49b8-b866-7a8024c3f763 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:55.014262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c46acf-dfdc-49b8-b866-7a8024c3f763 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:55.025936 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0c808-b643-49e5-b7d8-5030718f4938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:55.027171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0c808-b643-49e5-b7d8-5030718f4938 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:55.027599 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0c808-b643-49e5-b7d8-5030718f4938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:55.032975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0c808-b643-49e5-b7d8-5030718f4938 admin admin] PATH_INFO: `/v3/projects/404972ac0d7449b1a4fc5c64f6cefa8e/users/ab033b7f4341406ca272aab18281588c/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:55.044098 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0c808-b643-49e5-b7d8-5030718f4938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404972ac0d7449b1a4fc5c64f6cefa8e, user_id=ab033b7f4341406ca272aab18281588c, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:55.047177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0c808-b643-49e5-b7d8-5030718f4938 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:55.057725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 884/1769] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:10:54 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:55.077845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519494a-1608-40e5-b199-f517cc085d38 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:55.080339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 886/1770] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:54 2022] PUT /identity/v3/projects/404972ac0d7449b1a4fc5c64f6cefa8e/users/ab033b7f4341406ca272aab18281588c/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:55.081429 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0c808-b643-49e5-b7d8-5030718f4938 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:55.296812 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519494a-1608-40e5-b199-f517cc085d38 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:55.424572 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0c808-b643-49e5-b7d8-5030718f4938 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:55.438393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d93b7-34f1-4565-8984-27367d65a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:55.440309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d93b7-34f1-4565-8984-27367d65a6fd admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:55.441256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d93b7-34f1-4565-8984-27367d65a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:55.442268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d93b7-34f1-4565-8984-27367d65a6fd admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:55.445853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d93b7-34f1-4565-8984-27367d65a6fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:55.450293 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d93b7-34f1-4565-8984-27367d65a6fd admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:55.518225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 887/1771] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:10:55 2022] POST /identity/v3/users => generated 291 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:10:55.520381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d0354-c8be-4256-aeae-e27b5205b38b None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:55.522537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d0354-c8be-4256-aeae-e27b5205b38b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:55.523168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d0354-c8be-4256-aeae-e27b5205b38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:55.557130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bd152-d190-48c0-86bc-2692d7cccd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:55.558276 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bd152-d190-48c0-86bc-2692d7cccd35 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:55.558573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bd152-d190-48c0-86bc-2692d7cccd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:55.558979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bd152-d190-48c0-86bc-2692d7cccd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:55.559825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bd152-d190-48c0-86bc-2692d7cccd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:55.561628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bd152-d190-48c0-86bc-2692d7cccd35 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:55.608404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 885/1772] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 553 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:55.619324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bd152-d190-48c0-86bc-2692d7cccd35 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:55.647536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-fd2d0354-c8be-4256-aeae-e27b5205b38b None None] MFA Rules not processed for user `ab033b7f4341406ca272aab18281588c`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:55.659189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-fd2d0354-c8be-4256-aeae-e27b5205b38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:55.699669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bd152-d190-48c0-86bc-2692d7cccd35 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:55.729758 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68a964-26e6-4e84-8348-18ffd02e0530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:55.730730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68a964-26e6-4e84-8348-18ffd02e0530 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:55.731225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68a964-26e6-4e84-8348-18ffd02e0530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:55.731907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68a964-26e6-4e84-8348-18ffd02e0530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:55.734704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68a964-26e6-4e84-8348-18ffd02e0530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:55.736613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68a964-26e6-4e84-8348-18ffd02e0530 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:55.764490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 886/1773] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:55.765746 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68a964-26e6-4e84-8348-18ffd02e0530 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:55.799613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68a964-26e6-4e84-8348-18ffd02e0530 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:55.810287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:55.812609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4129c6-e6d7-4511-a688-09692296632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:55.813669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4129c6-e6d7-4511-a688-09692296632a admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:55.814169 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4129c6-e6d7-4511-a688-09692296632a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:55.814665 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4129c6-e6d7-4511-a688-09692296632a admin admin] PATH_INFO: `/v3/projects/4b76d748fe69406d8afe9af695f13ac4/users/0564c1f025bc4c40ad1bda759dda8d05/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:55.867389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4129c6-e6d7-4511-a688-09692296632a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b76d748fe69406d8afe9af695f13ac4, user_id=0564c1f025bc4c40ad1bda759dda8d05, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:55.870257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4129c6-e6d7-4511-a688-09692296632a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:55.911718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 887/1774] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:55 2022] PUT /identity/v3/projects/4b76d748fe69406d8afe9af695f13ac4/users/0564c1f025bc4c40ad1bda759dda8d05/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:55.921823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255aab8-3af4-482d-89b2-e8b5c76d34ed None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:55.933037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255aab8-3af4-482d-89b2-e8b5c76d34ed None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:55.933562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255aab8-3af4-482d-89b2-e8b5c76d34ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:56.000794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-3255aab8-3af4-482d-89b2-e8b5c76d34ed None None] MFA Rules not processed for user `e91f048f8885448383f4a361b07dac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:56.004296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3255aab8-3af4-482d-89b2-e8b5c76d34ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:56.031826 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:56.047573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 888/1775] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:56.048818 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d0354-c8be-4256-aeae-e27b5205b38b None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:56.106606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d0354-c8be-4256-aeae-e27b5205b38b None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:56.217370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 888/1776] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Sep 7 16:10:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:56.218453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255aab8-3af4-482d-89b2-e8b5c76d34ed None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:56.291272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688eac2-1e86-4233-97e7-a2ae618e1f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:56.292958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688eac2-1e86-4233-97e7-a2ae618e1f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:56.293294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688eac2-1e86-4233-97e7-a2ae618e1f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:56.293581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688eac2-1e86-4233-97e7-a2ae618e1f7a admin admin] PATH_INFO: `/v3/projects/7a195059058a48e681e6960d8f5d8c25/users/a533afc3277845389b923b8b40fd14db/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:56.322449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688eac2-1e86-4233-97e7-a2ae618e1f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a195059058a48e681e6960d8f5d8c25, user_id=a533afc3277845389b923b8b40fd14db, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:56.329211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688eac2-1e86-4233-97e7-a2ae618e1f7a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:56.363534 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 889/1777] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:56 2022] PUT /identity/v3/projects/7a195059058a48e681e6960d8f5d8c25/users/a533afc3277845389b923b8b40fd14db/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:56.364702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688eac2-1e86-4233-97e7-a2ae618e1f7a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:56.368644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2688eac2-1e86-4233-97e7-a2ae618e1f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:56.485487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255aab8-3af4-482d-89b2-e8b5c76d34ed None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:56.495943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688eac2-1e86-4233-97e7-a2ae618e1f7a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:56.503805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:56.505738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:56.508404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:56.508943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] PATH_INFO: `/v3/users/fe486141add44b509c8c93990eda7ad0` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:56.511029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe486141add44b509c8c93990eda7ad0)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:56.514749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:56.516285 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b131-ebf1-4f3d-b445-031c63f2ad14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:56.517108 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b131-ebf1-4f3d-b445-031c63f2ad14 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:56.526011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b131-ebf1-4f3d-b445-031c63f2ad14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:56.526379 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b131-ebf1-4f3d-b445-031c63f2ad14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:56.527103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49b131-ebf1-4f3d-b445-031c63f2ad14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:56.528912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49b131-ebf1-4f3d-b445-031c63f2ad14 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:56.549574 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 889/1778] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:56.552243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b131-ebf1-4f3d-b445-031c63f2ad14 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:56.556646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3d49b131-ebf1-4f3d-b445-031c63f2ad14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:56.620608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:56.627603 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe486141add44b509c8c93990eda7ad0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:56.665695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe486141add44b509c8c93990eda7ad0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:56.744842 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe486141add44b509c8c93990eda7ad0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:56.750068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe486141add44b509c8c93990eda7ad0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:56.753359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe486141add44b509c8c93990eda7ad0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:10:56.814601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 890/1779] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:10:56 2022] DELETE /identity/v3/users/fe486141add44b509c8c93990eda7ad0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:56.819973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:56.823818 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:56.837964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b131-ebf1-4f3d-b445-031c63f2ad14 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:56.971259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5d190-1eb2-45d2-b91d-effe877eb900 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:56.978818 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4c252-c9f1-4d44-ae7f-4380fb23ff38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:56.979834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c252-c9f1-4d44-ae7f-4380fb23ff38 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:56.980322 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c252-c9f1-4d44-ae7f-4380fb23ff38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:56.980852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4c252-c9f1-4d44-ae7f-4380fb23ff38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:56.984028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7dc4c252-c9f1-4d44-ae7f-4380fb23ff38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:57.008340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4c252-c9f1-4d44-ae7f-4380fb23ff38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:57.011019 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4c252-c9f1-4d44-ae7f-4380fb23ff38 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:57.041700 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 891/1780] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:57.042548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f0e48-6358-4d04-a903-b25e6014ef16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:57.043110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4c252-c9f1-4d44-ae7f-4380fb23ff38 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:57.043916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0e48-6358-4d04-a903-b25e6014ef16 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:57.044170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7dc4c252-c9f1-4d44-ae7f-4380fb23ff38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:57.044506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0e48-6358-4d04-a903-b25e6014ef16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:57.044955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0e48-6358-4d04-a903-b25e6014ef16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:57.056917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-677f0e48-6358-4d04-a903-b25e6014ef16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:57.142023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:57.217777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4c252-c9f1-4d44-ae7f-4380fb23ff38 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:57.227580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9524c15-d605-4065-a043-37af329ae625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:57.228163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9524c15-d605-4065-a043-37af329ae625 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:57.228440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9524c15-d605-4065-a043-37af329ae625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:57.228780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9524c15-d605-4065-a043-37af329ae625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:57.229432 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9524c15-d605-4065-a043-37af329ae625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:57.234018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9524c15-d605-4065-a043-37af329ae625 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:57.234770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f0e48-6358-4d04-a903-b25e6014ef16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:57.237331 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f0e48-6358-4d04-a903-b25e6014ef16 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:57.254540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 892/1781] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:10:57.258768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9524c15-d605-4065-a043-37af329ae625 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:57.261888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e9524c15-d605-4065-a043-37af329ae625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:57.271269 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 890/1782] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:57.273783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c462a-b00c-4d24-b6d3-4ff1838144b6 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:57.274369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c462a-b00c-4d24-b6d3-4ff1838144b6 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:57.274875 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c462a-b00c-4d24-b6d3-4ff1838144b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:57.284631 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9524c15-d605-4065-a043-37af329ae625 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:57.322163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ddaf6-0e32-422d-a5c1-97fd1db8d006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:57.331584 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ddaf6-0e32-422d-a5c1-97fd1db8d006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:57.331975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ddaf6-0e32-422d-a5c1-97fd1db8d006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:57.332652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ddaf6-0e32-422d-a5c1-97fd1db8d006 admin admin] PATH_INFO: `/v3/projects/4b76d748fe69406d8afe9af695f13ac4/users/0564c1f025bc4c40ad1bda759dda8d05/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:57.335584 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ddaf6-0e32-422d-a5c1-97fd1db8d006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b76d748fe69406d8afe9af695f13ac4, user_id=0564c1f025bc4c40ad1bda759dda8d05, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:57.337026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b18c462a-b00c-4d24-b6d3-4ff1838144b6 None None] MFA Rules not processed for user `6ddf97a836074da89dacb0d8029e2165`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:57.338573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b18c462a-b00c-4d24-b6d3-4ff1838144b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:57.338698 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ddaf6-0e32-422d-a5c1-97fd1db8d006 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:57.368088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 893/1783] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:57 2022] PUT /identity/v3/projects/4b76d748fe69406d8afe9af695f13ac4/users/0564c1f025bc4c40ad1bda759dda8d05/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:57.369857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2639c8a-3120-4704-a3c8-ebfcc58c8728 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:57.370218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2639c8a-3120-4704-a3c8-ebfcc58c8728 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:57.370593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2639c8a-3120-4704-a3c8-ebfcc58c8728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:57.421171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-a2639c8a-3120-4704-a3c8-ebfcc58c8728 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:57.422594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-a2639c8a-3120-4704-a3c8-ebfcc58c8728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:57.525214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:57.533467 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 891/1784] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:57.541403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c462a-b00c-4d24-b6d3-4ff1838144b6 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:57.598018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 894/1785] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:57.599425 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dd0da-8c55-49ca-8157-c23fd06ec8ce None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:57.600292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dd0da-8c55-49ca-8157-c23fd06ec8ce None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:57.601000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dd0da-8c55-49ca-8157-c23fd06ec8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:57.706570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-616dd0da-8c55-49ca-8157-c23fd06ec8ce None None] MFA Rules not processed for user `0564c1f025bc4c40ad1bda759dda8d05`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:57.708584 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-616dd0da-8c55-49ca-8157-c23fd06ec8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:57.729839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c462a-b00c-4d24-b6d3-4ff1838144b6 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:57.752165 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2746ab-6397-4157-aca7-4454b5354508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:57.753280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2746ab-6397-4157-aca7-4454b5354508 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:57.753796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2746ab-6397-4157-aca7-4454b5354508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:57.754141 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2746ab-6397-4157-aca7-4454b5354508 admin admin] PATH_INFO: `/v3/projects/7a195059058a48e681e6960d8f5d8c25/users/a533afc3277845389b923b8b40fd14db/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:57.771117 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2746ab-6397-4157-aca7-4454b5354508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a195059058a48e681e6960d8f5d8c25, user_id=a533afc3277845389b923b8b40fd14db, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:57.775739 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2746ab-6397-4157-aca7-4454b5354508 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:57.808630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 892/1786] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:10:57 2022] PUT /identity/v3/projects/7a195059058a48e681e6960d8f5d8c25/users/a533afc3277845389b923b8b40fd14db/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:10:57.819236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2746ab-6397-4157-aca7-4454b5354508 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:57.825978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8f2746ab-6397-4157-aca7-4454b5354508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:57.940350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 895/1787] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:57.942085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dd0da-8c55-49ca-8157-c23fd06ec8ce None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:57.945338 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-616dd0da-8c55-49ca-8157-c23fd06ec8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:58.010158 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2746ab-6397-4157-aca7-4454b5354508 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:58.027479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047794f-668b-4d32-8bef-2087979a6da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:58.033309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047794f-668b-4d32-8bef-2087979a6da2 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:58.035138 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047794f-668b-4d32-8bef-2087979a6da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:58.035824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047794f-668b-4d32-8bef-2087979a6da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:58.042960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f047794f-668b-4d32-8bef-2087979a6da2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:58.085003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:58.145476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dd0da-8c55-49ca-8157-c23fd06ec8ce None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:58.169272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047794f-668b-4d32-8bef-2087979a6da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:58.172123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047794f-668b-4d32-8bef-2087979a6da2 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:58.192229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 893/1788] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:58.193944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992111d8-7c98-464c-a8e8-61cad8fd223d None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:58.194295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992111d8-7c98-464c-a8e8-61cad8fd223d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:58.194595 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992111d8-7c98-464c-a8e8-61cad8fd223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:58.259109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-992111d8-7c98-464c-a8e8-61cad8fd223d None None] MFA Rules not processed for user `a533afc3277845389b923b8b40fd14db`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:10:58.263557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-992111d8-7c98-464c-a8e8-61cad8fd223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:58.311702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40f6de-f609-4a21-ade9-1be67d89291b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:58.314403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40f6de-f609-4a21-ade9-1be67d89291b service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:58.316383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40f6de-f609-4a21-ade9-1be67d89291b service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:58.318499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40f6de-f609-4a21-ade9-1be67d89291b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:58.433467 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 894/1789] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:10:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:10:58.435839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992111d8-7c98-464c-a8e8-61cad8fd223d None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:58.439055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-992111d8-7c98-464c-a8e8-61cad8fd223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:58.472343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992111d8-7c98-464c-a8e8-61cad8fd223d None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:58.481810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2d014-af95-49de-9361-a17945f61f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:58.482450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2d014-af95-49de-9361-a17945f61f2c service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:58.482730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2d014-af95-49de-9361-a17945f61f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:58.483042 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2d014-af95-49de-9361-a17945f61f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:58.495974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-84d2d014-af95-49de-9361-a17945f61f2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:58.538544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:58.570092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40f6de-f609-4a21-ade9-1be67d89291b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:58.573221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40f6de-f609-4a21-ade9-1be67d89291b service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:58.608648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 896/1790] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:58.650496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40f6de-f609-4a21-ade9-1be67d89291b service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:58.670494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40f6de-f609-4a21-ade9-1be67d89291b service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:58.681993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83109e80-14c4-4b3b-8b9a-a8e60604bc21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:58.683008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83109e80-14c4-4b3b-8b9a-a8e60604bc21 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:58.685545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83109e80-14c4-4b3b-8b9a-a8e60604bc21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:58.686199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83109e80-14c4-4b3b-8b9a-a8e60604bc21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:58.696986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2d014-af95-49de-9361-a17945f61f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:58.698632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2d014-af95-49de-9361-a17945f61f2c service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:58.714331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83109e80-14c4-4b3b-8b9a-a8e60604bc21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:58.720021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83109e80-14c4-4b3b-8b9a-a8e60604bc21 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:10:58.726597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 895/1791] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:58.766828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 897/1792] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:10:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:10:59.749701 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2d014-af95-49de-9361-a17945f61f2c service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:10:59.751214 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-84d2d014-af95-49de-9361-a17945f61f2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:10:59.784116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2d014-af95-49de-9361-a17945f61f2c service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:10:59.838954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:10:59.838954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:10:59.838954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:10:59.838954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] PATH_INFO: `/v3/projects/ee0dbdc7f61f41d085de97ee99c4f122` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:10:59.849184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee0dbdc7f61f41d085de97ee99c4f122)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:10:59.857093 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:00.013460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:00.035767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee0dbdc7f61f41d085de97ee99c4f122', 'request_id': 'req-c81dbbc7-2121-491d-aceb-89106da4bf63'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:00.057104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee0dbdc7f61f41d085de97ee99c4f122', 'request_id': 'req-c81dbbc7-2121-491d-aceb-89106da4bf63'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:00.064387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee0dbdc7f61f41d085de97ee99c4f122', 'request_id': 'req-c81dbbc7-2121-491d-aceb-89106da4bf63'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:00.095754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] The token cache is being invalidate because project ee0dbdc7f61f41d085de97ee99c4f122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:00.096246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:00.096990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:00.117317 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 896/1793] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:10:59 2022] DELETE /identity/v3/projects/ee0dbdc7f61f41d085de97ee99c4f122 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:00.121315 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83109e80-14c4-4b3b-8b9a-a8e60604bc21 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:00.144565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83109e80-14c4-4b3b-8b9a-a8e60604bc21 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:00.348146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:00.349343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:00.350324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:00.351609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] PATH_INFO: `/v3/users/04d83fcf4162420490100d2e836537c4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:00.354295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d83fcf4162420490100d2e836537c4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:00.363639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:00.503761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d83fcf4162420490100d2e836537c4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:00.521034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d83fcf4162420490100d2e836537c4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:00.550471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d83fcf4162420490100d2e836537c4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:00.551828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d83fcf4162420490100d2e836537c4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:00.555401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d83fcf4162420490100d2e836537c4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:00.589928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 898/1794] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:00 2022] DELETE /identity/v3/users/04d83fcf4162420490100d2e836537c4 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:00.671571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:00.673174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:00.691130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dbbc7-2121-491d-aceb-89106da4bf63 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:00.842936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53265c1e-0ae3-4c45-8ca7-ccc93c6acace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:00.843917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53265c1e-0ae3-4c45-8ca7-ccc93c6acace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:00.844446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53265c1e-0ae3-4c45-8ca7-ccc93c6acace admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:00.846544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53265c1e-0ae3-4c45-8ca7-ccc93c6acace admin admin] PATH_INFO: `/v3/users/c23098a4ca6c4451870861e9d902902c` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:00.849343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53265c1e-0ae3-4c45-8ca7-ccc93c6acace admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23098a4ca6c4451870861e9d902902c)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:00.853067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53265c1e-0ae3-4c45-8ca7-ccc93c6acace admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:00.919973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:00.923157 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:01.085084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-53265c1e-0ae3-4c45-8ca7-ccc93c6acace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23098a4ca6c4451870861e9d902902c'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:01.111400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-53265c1e-0ae3-4c45-8ca7-ccc93c6acace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23098a4ca6c4451870861e9d902902c'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:01.118315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-53265c1e-0ae3-4c45-8ca7-ccc93c6acace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23098a4ca6c4451870861e9d902902c'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:01.118315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-53265c1e-0ae3-4c45-8ca7-ccc93c6acace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23098a4ca6c4451870861e9d902902c'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:01.157907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:01.163722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-53265c1e-0ae3-4c45-8ca7-ccc93c6acace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23098a4ca6c4451870861e9d902902c'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:01.195124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143eb3a-1637-40ad-8438-2f951a37af01 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:01.202516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 897/1795] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:00 2022] DELETE /identity/v3/users/c23098a4ca6c4451870861e9d902902c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:01.203321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80af50b-b590-44be-be6d-8250e73c06bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:01.204156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80af50b-b590-44be-be6d-8250e73c06bc service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:01.207695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca872fa3-fdf9-4e25-8451-4527123fcda1 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:01.208194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80af50b-b590-44be-be6d-8250e73c06bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:01.208558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca872fa3-fdf9-4e25-8451-4527123fcda1 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:01.209241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca872fa3-fdf9-4e25-8451-4527123fcda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:01.209563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80af50b-b590-44be-be6d-8250e73c06bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:01.213617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f80af50b-b590-44be-be6d-8250e73c06bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:01.283350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-ca872fa3-fdf9-4e25-8451-4527123fcda1 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:01.292814 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ca872fa3-fdf9-4e25-8451-4527123fcda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:01.426125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:01.429687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80af50b-b590-44be-be6d-8250e73c06bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:01.431308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80af50b-b590-44be-be6d-8250e73c06bc service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:01.462749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 899/1796] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:01.504781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 898/1797] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:01.524666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80af50b-b590-44be-be6d-8250e73c06bc service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:01.526447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f80af50b-b590-44be-be6d-8250e73c06bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:01.718010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80af50b-b590-44be-be6d-8250e73c06bc service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:01.740330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca872fa3-fdf9-4e25-8451-4527123fcda1 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:01.741837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ca872fa3-fdf9-4e25-8451-4527123fcda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:01.767865 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca872fa3-fdf9-4e25-8451-4527123fcda1 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:01.785502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee331a7e-8187-4128-8a33-16c85df1e2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:01.786149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee331a7e-8187-4128-8a33-16c85df1e2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:01.786431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee331a7e-8187-4128-8a33-16c85df1e2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:01.789065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee331a7e-8187-4128-8a33-16c85df1e2ed admin admin] PATH_INFO: `/v3/projects/1f986d5e3b65440fb007f6507135eee7` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:01.791774 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee331a7e-8187-4128-8a33-16c85df1e2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f986d5e3b65440fb007f6507135eee7)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:01.796496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee331a7e-8187-4128-8a33-16c85df1e2ed admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:01.962066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ee331a7e-8187-4128-8a33-16c85df1e2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f986d5e3b65440fb007f6507135eee7', 'request_id': 'req-ee331a7e-8187-4128-8a33-16c85df1e2ed'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:01.975423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ee331a7e-8187-4128-8a33-16c85df1e2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f986d5e3b65440fb007f6507135eee7', 'request_id': 'req-ee331a7e-8187-4128-8a33-16c85df1e2ed'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:01.987674 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ee331a7e-8187-4128-8a33-16c85df1e2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f986d5e3b65440fb007f6507135eee7', 'request_id': 'req-ee331a7e-8187-4128-8a33-16c85df1e2ed'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:01.992034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fd59d-e727-41f9-b270-8acd19d6040a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:01.994185 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fd59d-e727-41f9-b270-8acd19d6040a service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:01.994522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fd59d-e727-41f9-b270-8acd19d6040a service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:01.995995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fd59d-e727-41f9-b270-8acd19d6040a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:02.021950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fd59d-e727-41f9-b270-8acd19d6040a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:02.026212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fd59d-e727-41f9-b270-8acd19d6040a service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:02.043514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ee331a7e-8187-4128-8a33-16c85df1e2ed admin admin] The token cache is being invalidate because project 1f986d5e3b65440fb007f6507135eee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:02.043816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ee331a7e-8187-4128-8a33-16c85df1e2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:02.046846 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ee331a7e-8187-4128-8a33-16c85df1e2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:02.051517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 899/1798] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:01 2022] DELETE /identity/v3/projects/1f986d5e3b65440fb007f6507135eee7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:02.057718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 900/1799] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:02.067780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be707467-15ab-440c-9fb2-1237e6603dd4 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:02.068082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be707467-15ab-440c-9fb2-1237e6603dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:02.069640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be707467-15ab-440c-9fb2-1237e6603dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:02.105673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fd59d-e727-41f9-b270-8acd19d6040a service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:02.111588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d66fd59d-e727-41f9-b270-8acd19d6040a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:02.133212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-be707467-15ab-440c-9fb2-1237e6603dd4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:02.136750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-be707467-15ab-440c-9fb2-1237e6603dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:02.160710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fd59d-e727-41f9-b270-8acd19d6040a service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:02.244607 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:02.256169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:02.257957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:02.258467 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:02.259806 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] PATH_INFO: `/v3/users/a4f96529c2bb4bed9149336a2517c78f` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:02.261687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f96529c2bb4bed9149336a2517c78f)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:02.265126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:02.314623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 900/1800] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:02.316459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e79f5-c35f-4c1e-a9cb-40ef4679095e None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:02.316783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e79f5-c35f-4c1e-a9cb-40ef4679095e None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:02.317058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e79f5-c35f-4c1e-a9cb-40ef4679095e None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:02.318877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 901/1801] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:11:02.325549 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71476cfa-584a-41a1-a03e-d714620de485 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:02.325839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71476cfa-584a-41a1-a03e-d714620de485 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:02.326347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71476cfa-584a-41a1-a03e-d714620de485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:02.353079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f96529c2bb4bed9149336a2517c78f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:02.370804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f96529c2bb4bed9149336a2517c78f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:02.377337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-71476cfa-584a-41a1-a03e-d714620de485 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:02.381317 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-71476cfa-584a-41a1-a03e-d714620de485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:02.402368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f96529c2bb4bed9149336a2517c78f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:02.404945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f96529c2bb4bed9149336a2517c78f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:02.411400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 902/1802] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:02.414082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f96529c2bb4bed9149336a2517c78f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:02.415244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90de8c-c784-4f66-9bf6-dfe0f2f5d3db None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:02.417139 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90de8c-c784-4f66-9bf6-dfe0f2f5d3db None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:02.417517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90de8c-c784-4f66-9bf6-dfe0f2f5d3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:02.464470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 901/1803] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:02 2022] DELETE /identity/v3/users/a4f96529c2bb4bed9149336a2517c78f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:02.464470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:02.464470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:02.482028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7e90de8c-c784-4f66-9bf6-dfe0f2f5d3db None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:02.483709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7e90de8c-c784-4f66-9bf6-dfe0f2f5d3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:02.632412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:02.640155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00835220-3ea0-4b5a-8e3f-48e3e6b1a154 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:02.656823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb687d1c-b438-4a63-90e3-1c92cbaf47b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:02.656823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb687d1c-b438-4a63-90e3-1c92cbaf47b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:02.656823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb687d1c-b438-4a63-90e3-1c92cbaf47b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:02.656823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb687d1c-b438-4a63-90e3-1c92cbaf47b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:02.657308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb687d1c-b438-4a63-90e3-1c92cbaf47b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:02.657308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb687d1c-b438-4a63-90e3-1c92cbaf47b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:02.657308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb687d1c-b438-4a63-90e3-1c92cbaf47b8 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:02.671490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 903/1804] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:11:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:02.672812 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb868a-de34-4d4d-8214-fbebe595ba24 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:02.673107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb868a-de34-4d4d-8214-fbebe595ba24 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:02.673394 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb868a-de34-4d4d-8214-fbebe595ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:02.701949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 902/1805] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:11:02.703594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb687d1c-b438-4a63-90e3-1c92cbaf47b8 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:02.719831 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-cfdb868a-de34-4d4d-8214-fbebe595ba24 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:02.720951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-cfdb868a-de34-4d4d-8214-fbebe595ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:02.726054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb687d1c-b438-4a63-90e3-1c92cbaf47b8 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:02.735741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae2a66-78e6-4336-9c24-f227e2a88bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:02.736392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae2a66-78e6-4336-9c24-f227e2a88bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:02.736666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae2a66-78e6-4336-9c24-f227e2a88bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:02.736993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae2a66-78e6-4336-9c24-f227e2a88bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:02.739398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae2a66-78e6-4336-9c24-f227e2a88bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:02.744763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 904/1806] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:02.744952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae2a66-78e6-4336-9c24-f227e2a88bb8 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:02.760346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb868a-de34-4d4d-8214-fbebe595ba24 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:02.767121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-cfdb868a-de34-4d4d-8214-fbebe595ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:02.820047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 903/1807] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:02 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:02.826736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae2a66-78e6-4336-9c24-f227e2a88bb8 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:02.935916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb868a-de34-4d4d-8214-fbebe595ba24 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:02.960716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:03.003852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae2a66-78e6-4336-9c24-f227e2a88bb8 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:03.013135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b6b5a-a7aa-4d12-b6d6-b5f214b673da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:03.013899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b6b5a-a7aa-4d12-b6d6-b5f214b673da admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:03.014188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b6b5a-a7aa-4d12-b6d6-b5f214b673da admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:03.014466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b6b5a-a7aa-4d12-b6d6-b5f214b673da admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:03.015118 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b6b5a-a7aa-4d12-b6d6-b5f214b673da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:03.017196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b6b5a-a7aa-4d12-b6d6-b5f214b673da admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:03.056672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e09bd-4a9d-4a8e-ab6b-4e1cea43eb16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:03.057569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e09bd-4a9d-4a8e-ab6b-4e1cea43eb16 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:03.058102 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e09bd-4a9d-4a8e-ab6b-4e1cea43eb16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:03.058477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e09bd-4a9d-4a8e-ab6b-4e1cea43eb16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:03.062550 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 904/1808] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:02 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:03.064591 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b6b5a-a7aa-4d12-b6d6-b5f214b673da admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:03.075893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e09bd-4a9d-4a8e-ab6b-4e1cea43eb16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:03.077937 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e09bd-4a9d-4a8e-ab6b-4e1cea43eb16 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:03.088974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b6b5a-a7aa-4d12-b6d6-b5f214b673da admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:03.094490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 905/1809] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:03.100487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2f65a-44e4-4dd3-a976-c78055015d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:03.101180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2f65a-44e4-4dd3-a976-c78055015d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:03.101463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2f65a-44e4-4dd3-a976-c78055015d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:03.101742 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2f65a-44e4-4dd3-a976-c78055015d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:03.102415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2f65a-44e4-4dd3-a976-c78055015d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:03.104310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2f65a-44e4-4dd3-a976-c78055015d87 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:03.136356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 905/1810] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:03.137429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e09bd-4a9d-4a8e-ab6b-4e1cea43eb16 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:03.165063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e09bd-4a9d-4a8e-ab6b-4e1cea43eb16 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:03.171946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f4664-4abd-489b-b78a-143c2055dfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:03.172856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f4664-4abd-489b-b78a-143c2055dfee admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:03.173318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f4664-4abd-489b-b78a-143c2055dfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:03.174358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f4664-4abd-489b-b78a-143c2055dfee admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:03.175163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f4664-4abd-489b-b78a-143c2055dfee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:03.177248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f4664-4abd-489b-b78a-143c2055dfee admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:03.192724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 906/1811] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:03.197354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2f65a-44e4-4dd3-a976-c78055015d87 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:03.211267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2f65a-44e4-4dd3-a976-c78055015d87 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:03.217350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b59f4e-02bd-43cb-8a7e-d5b4c9990a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:03.218099 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b59f4e-02bd-43cb-8a7e-d5b4c9990a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:03.218386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b59f4e-02bd-43cb-8a7e-d5b4c9990a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:03.218666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b59f4e-02bd-43cb-8a7e-d5b4c9990a14 admin admin] PATH_INFO: `/v3/projects/e964153032fc4c1e85d1497d9aff0ade/users/c32c499c160045769366ab200836c53a/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:03.239054 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b59f4e-02bd-43cb-8a7e-d5b4c9990a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e964153032fc4c1e85d1497d9aff0ade, user_id=c32c499c160045769366ab200836c53a, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:03.243207 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b59f4e-02bd-43cb-8a7e-d5b4c9990a14 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:03.261205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 906/1812] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:03 2022] PUT /identity/v3/projects/e964153032fc4c1e85d1497d9aff0ade/users/c32c499c160045769366ab200836c53a/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:03.273574 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cc7cb-f610-40b7-9f53-b305d90c667d None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:03.273983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cc7cb-f610-40b7-9f53-b305d90c667d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:03.274303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cc7cb-f610-40b7-9f53-b305d90c667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:03.360092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-4b6cc7cb-f610-40b7-9f53-b305d90c667d None None] MFA Rules not processed for user `c32c499c160045769366ab200836c53a`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:03.361916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4b6cc7cb-f610-40b7-9f53-b305d90c667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:03.486693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b59f4e-02bd-43cb-8a7e-d5b4c9990a14 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:03.488795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e9b59f4e-02bd-43cb-8a7e-d5b4c9990a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:03.712279 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 907/1813] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:03.713224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cc7cb-f610-40b7-9f53-b305d90c667d None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:03.720014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4b6cc7cb-f610-40b7-9f53-b305d90c667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:03.745839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b59f4e-02bd-43cb-8a7e-d5b4c9990a14 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:03.764997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b127ba-a379-4433-8063-952bde373973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:03.764997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b127ba-a379-4433-8063-952bde373973 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:03.764997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b127ba-a379-4433-8063-952bde373973 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:03.764997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b127ba-a379-4433-8063-952bde373973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:03.794190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b127ba-a379-4433-8063-952bde373973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:03.796579 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b127ba-a379-4433-8063-952bde373973 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:03.811590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:03.826081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 907/1814] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:03.830208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b127ba-a379-4433-8063-952bde373973 service nova] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:03.899544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cc7cb-f610-40b7-9f53-b305d90c667d None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:03.908084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:03.909387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:03.909868 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:03.910359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] PATH_INFO: `/v3/projects/b87a2bad9fb745ab8e58d5522599345f` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:03.913560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87a2bad9fb745ab8e58d5522599345f)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:03.919518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:04.013499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b127ba-a379-4433-8063-952bde373973 service nova] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:04.018924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1538b2b-badf-4456-aa6d-b37a5a1ac94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:04.019794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538b2b-badf-4456-aa6d-b37a5a1ac94c admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:04.020043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538b2b-badf-4456-aa6d-b37a5a1ac94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:04.020497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538b2b-badf-4456-aa6d-b37a5a1ac94c admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:04.021884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1538b2b-badf-4456-aa6d-b37a5a1ac94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:04.024048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1538b2b-badf-4456-aa6d-b37a5a1ac94c admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:04.050077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87a2bad9fb745ab8e58d5522599345f', 'request_id': 'req-9b4bb655-679b-422a-8f32-969d821e7e44'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.081940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87a2bad9fb745ab8e58d5522599345f', 'request_id': 'req-9b4bb655-679b-422a-8f32-969d821e7e44'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.102324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 908/1815] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:03 2022] POST /identity/v3/projects => generated 383 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:04.106686 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1538b2b-badf-4456-aa6d-b37a5a1ac94c admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:04.109832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87a2bad9fb745ab8e58d5522599345f', 'request_id': 'req-9b4bb655-679b-422a-8f32-969d821e7e44'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.132821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:04.134177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] The token cache is being invalidate because project b87a2bad9fb745ab8e58d5522599345f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:04.134177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.142338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.144977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 908/1816] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:03 2022] DELETE /identity/v3/projects/b87a2bad9fb745ab8e58d5522599345f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:04.152538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:04.154195 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:04.252237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1538b2b-badf-4456-aa6d-b37a5a1ac94c admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:04.266872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b37f0-b29d-454e-b918-63310bec8520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:04.267502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b37f0-b29d-454e-b918-63310bec8520 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:04.267786 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b37f0-b29d-454e-b918-63310bec8520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:04.268062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b37f0-b29d-454e-b918-63310bec8520 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:04.273507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b37f0-b29d-454e-b918-63310bec8520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:04.278028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b37f0-b29d-454e-b918-63310bec8520 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:04.335070 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 909/1817] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:04 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:04.337221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b37f0-b29d-454e-b918-63310bec8520 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:04.339322 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-891b37f0-b29d-454e-b918-63310bec8520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:04.342313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bb655-679b-422a-8f32-969d821e7e44 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:04.356985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:04.356985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:04.356985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:04.356985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] PATH_INFO: `/v3/users/a533afc3277845389b923b8b40fd14db` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:04.357994 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] RBAC: Authorizing `identity:delete_user(user_id=a533afc3277845389b923b8b40fd14db)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:04.389809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:04.404156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b37f0-b29d-454e-b918-63310bec8520 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:04.430891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7cb76-4230-4e2b-8469-68e662ed5b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:04.433258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7cb76-4230-4e2b-8469-68e662ed5b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:04.434246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7cb76-4230-4e2b-8469-68e662ed5b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:04.437006 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7cb76-4230-4e2b-8469-68e662ed5b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:04.441178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7cb76-4230-4e2b-8469-68e662ed5b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:04.444874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7cb76-4230-4e2b-8469-68e662ed5b23 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:04.490168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 910/1818] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:04.490168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7cb76-4230-4e2b-8469-68e662ed5b23 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:04.495558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-42b7cb76-4230-4e2b-8469-68e662ed5b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:04.528442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a533afc3277845389b923b8b40fd14db'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.534745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7cb76-4230-4e2b-8469-68e662ed5b23 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:04.542062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:04.542822 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:04.543112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:04.543493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] PATH_INFO: `/v3/projects/32bcb016cefd47489b137b86a54cc8ea` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:04.545823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a533afc3277845389b923b8b40fd14db'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.546226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32bcb016cefd47489b137b86a54cc8ea)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:04.546598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a533afc3277845389b923b8b40fd14db'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.547282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a533afc3277845389b923b8b40fd14db'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.551042 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:04.564502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:04.574899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a533afc3277845389b923b8b40fd14db'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.606431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 909/1819] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:04 2022] DELETE /identity/v3/users/a533afc3277845389b923b8b40fd14db => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:04.611629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:04.619899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:04.722863 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32bcb016cefd47489b137b86a54cc8ea', 'request_id': 'req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.744502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32bcb016cefd47489b137b86a54cc8ea', 'request_id': 'req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.761760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32bcb016cefd47489b137b86a54cc8ea', 'request_id': 'req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.781481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead06822-a492-4722-870f-2a433a5182af admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:04.794752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] The token cache is being invalidate because project 32bcb016cefd47489b137b86a54cc8ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:04.796040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.798934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:04.802673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 911/1820] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:04 2022] DELETE /identity/v3/projects/32bcb016cefd47489b137b86a54cc8ea => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:04.813028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:04.822912 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:04.951972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661902f-bcdc-4322-9083-51914d890054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:04.952858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661902f-bcdc-4322-9083-51914d890054 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:04.953238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661902f-bcdc-4322-9083-51914d890054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:04.954759 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661902f-bcdc-4322-9083-51914d890054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:04.957605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661902f-bcdc-4322-9083-51914d890054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:04.960714 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661902f-bcdc-4322-9083-51914d890054 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:04.989307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 910/1821] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:04.994671 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661902f-bcdc-4322-9083-51914d890054 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:04.997239 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9661902f-bcdc-4322-9083-51914d890054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:05.037748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661902f-bcdc-4322-9083-51914d890054 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:05.037951 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1db8d1-b6b8-41fc-85d9-8643c4baf948 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:05.048265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c983b6-9196-4f42-a8d3-a927682d3f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:05.049057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c983b6-9196-4f42-a8d3-a927682d3f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:05.050776 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c983b6-9196-4f42-a8d3-a927682d3f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:05.051096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c983b6-9196-4f42-a8d3-a927682d3f1d admin admin] PATH_INFO: `/v3/projects/a71a39ebea094e10b1c05cd3e33c9ce7/users/03cff49f354749bb8fac9eb104af2a60/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:05.061236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:05.062207 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:05.062577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:05.062859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] PATH_INFO: `/v3/users/ab033b7f4341406ca272aab18281588c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:05.064248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab033b7f4341406ca272aab18281588c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:05.069981 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:05.094291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:05.110869 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c983b6-9196-4f42-a8d3-a927682d3f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71a39ebea094e10b1c05cd3e33c9ce7, user_id=03cff49f354749bb8fac9eb104af2a60, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:05.113667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c983b6-9196-4f42-a8d3-a927682d3f1d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:05.151760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 911/1822] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:04 2022] PUT /identity/v3/projects/a71a39ebea094e10b1c05cd3e33c9ce7/users/03cff49f354749bb8fac9eb104af2a60/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:05.164502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157a72a-f482-4e58-92c1-ecf04f90ced2 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:05.165205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157a72a-f482-4e58-92c1-ecf04f90ced2 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:05.165715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157a72a-f482-4e58-92c1-ecf04f90ced2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:05.185147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab033b7f4341406ca272aab18281588c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:05.207251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab033b7f4341406ca272aab18281588c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:05.243313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab033b7f4341406ca272aab18281588c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:05.245505 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab033b7f4341406ca272aab18281588c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:05.249313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab033b7f4341406ca272aab18281588c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:05.254481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-1157a72a-f482-4e58-92c1-ecf04f90ced2 None None] MFA Rules not processed for user `03cff49f354749bb8fac9eb104af2a60`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:05.270444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 912/1823] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:04 2022] DELETE /identity/v3/users/ab033b7f4341406ca272aab18281588c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:05.272991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1157a72a-f482-4e58-92c1-ecf04f90ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:05.390946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:05.436949 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 912/1824] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:05.441651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:05.442932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:05.598356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b80016-ecc4-4f24-b5d8-8905519d1876 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:05.608609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512900-d2cc-4875-ac44-9cc5641152b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:05.609872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512900-d2cc-4875-ac44-9cc5641152b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:05.610185 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512900-d2cc-4875-ac44-9cc5641152b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:05.610432 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512900-d2cc-4875-ac44-9cc5641152b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:05.611092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e512900-d2cc-4875-ac44-9cc5641152b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:05.617522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e512900-d2cc-4875-ac44-9cc5641152b5 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:05.682440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 913/1825] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:05 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:05.683655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157a72a-f482-4e58-92c1-ecf04f90ced2 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:05.714311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157a72a-f482-4e58-92c1-ecf04f90ced2 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:05.854575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a2fdf-a452-4410-b361-dbab484f389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:05.855210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a2fdf-a452-4410-b361-dbab484f389f admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:05.855494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a2fdf-a452-4410-b361-dbab484f389f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:05.855773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a2fdf-a452-4410-b361-dbab484f389f admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:05.856423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a2fdf-a452-4410-b361-dbab484f389f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:05.858491 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a2fdf-a452-4410-b361-dbab484f389f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:05.901347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 913/1826] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:05 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:05.905174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512900-d2cc-4875-ac44-9cc5641152b5 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:05.919682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512900-d2cc-4875-ac44-9cc5641152b5 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:05.924841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd0b24-8fdd-4e7e-9a20-10f2d52feb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:05.926056 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd0b24-8fdd-4e7e-9a20-10f2d52feb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:05.926381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd0b24-8fdd-4e7e-9a20-10f2d52feb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:05.926649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd0b24-8fdd-4e7e-9a20-10f2d52feb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:05.927394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd0b24-8fdd-4e7e-9a20-10f2d52feb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:05.941021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd0b24-8fdd-4e7e-9a20-10f2d52feb75 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:05.962658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 914/1827] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:05.967071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a2fdf-a452-4410-b361-dbab484f389f admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:05.991221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a2fdf-a452-4410-b361-dbab484f389f admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:05.996808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd0b24-8fdd-4e7e-9a20-10f2d52feb75 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:05.998701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-fdfd0b24-8fdd-4e7e-9a20-10f2d52feb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:06.016018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def28db-5518-4522-8d59-97b056dbc97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:06.016905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def28db-5518-4522-8d59-97b056dbc97a admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:06.017670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def28db-5518-4522-8d59-97b056dbc97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:06.017670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def28db-5518-4522-8d59-97b056dbc97a admin admin] PATH_INFO: `/v3/projects/3de6d4591a4d431e9f51652395f041c3/users/c068b1d3edb8408d83f8d53ca03b20e0/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:06.044288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd0b24-8fdd-4e7e-9a20-10f2d52feb75 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:06.055707 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021ead3-df0a-41ee-b22f-d2298b5310f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:06.056365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021ead3-df0a-41ee-b22f-d2298b5310f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:06.056649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021ead3-df0a-41ee-b22f-d2298b5310f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:06.056948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021ead3-df0a-41ee-b22f-d2298b5310f4 admin admin] PATH_INFO: `/v3/projects/7a195059058a48e681e6960d8f5d8c25` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:06.058486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021ead3-df0a-41ee-b22f-d2298b5310f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a195059058a48e681e6960d8f5d8c25)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:06.061051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021ead3-df0a-41ee-b22f-d2298b5310f4 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:06.071898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def28db-5518-4522-8d59-97b056dbc97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de6d4591a4d431e9f51652395f041c3, user_id=c068b1d3edb8408d83f8d53ca03b20e0, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:06.074727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def28db-5518-4522-8d59-97b056dbc97a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:06.117578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 914/1828] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:05 2022] PUT /identity/v3/projects/3de6d4591a4d431e9f51652395f041c3/users/c068b1d3edb8408d83f8d53ca03b20e0/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:06.118861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def28db-5518-4522-8d59-97b056dbc97a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:06.192726 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9021ead3-df0a-41ee-b22f-d2298b5310f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a195059058a48e681e6960d8f5d8c25', 'request_id': 'req-9021ead3-df0a-41ee-b22f-d2298b5310f4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.211360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9021ead3-df0a-41ee-b22f-d2298b5310f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a195059058a48e681e6960d8f5d8c25', 'request_id': 'req-9021ead3-df0a-41ee-b22f-d2298b5310f4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.215382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:06.229715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9021ead3-df0a-41ee-b22f-d2298b5310f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a195059058a48e681e6960d8f5d8c25', 'request_id': 'req-9021ead3-df0a-41ee-b22f-d2298b5310f4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.267919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9021ead3-df0a-41ee-b22f-d2298b5310f4 admin admin] The token cache is being invalidate because project 7a195059058a48e681e6960d8f5d8c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:06.267919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9021ead3-df0a-41ee-b22f-d2298b5310f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.274251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9021ead3-df0a-41ee-b22f-d2298b5310f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.276705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 915/1829] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:05 2022] DELETE /identity/v3/projects/7a195059058a48e681e6960d8f5d8c25 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:06.283241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d2bf7-14ab-4e72-9447-debf743f8ddb None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:06.283508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d2bf7-14ab-4e72-9447-debf743f8ddb None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:06.283726 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d2bf7-14ab-4e72-9447-debf743f8ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:06.303416 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def28db-5518-4522-8d59-97b056dbc97a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:06.329034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-6c6d2bf7-14ab-4e72-9447-debf743f8ddb None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:06.331192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6c6d2bf7-14ab-4e72-9447-debf743f8ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:06.407478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:06.422863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6161d5-df30-4c44-8c42-49570f9ca3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:06.423832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6161d5-df30-4c44-8c42-49570f9ca3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:06.424695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6161d5-df30-4c44-8c42-49570f9ca3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:06.424695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6161d5-df30-4c44-8c42-49570f9ca3c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:06.425562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6161d5-df30-4c44-8c42-49570f9ca3c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:06.429718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6161d5-df30-4c44-8c42-49570f9ca3c6 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:06.460148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 915/1830] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:06.461542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6161d5-df30-4c44-8c42-49570f9ca3c6 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:06.465460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 916/1831] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:06.466290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9b6161d5-df30-4c44-8c42-49570f9ca3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:06.471373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d2bf7-14ab-4e72-9447-debf743f8ddb None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:06.472872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6c6d2bf7-14ab-4e72-9447-debf743f8ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:06.482599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6161d5-df30-4c44-8c42-49570f9ca3c6 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:06.488963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:06.489839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:06.490297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:06.491069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] PATH_INFO: `/v3/projects/404972ac0d7449b1a4fc5c64f6cefa8e` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:06.492602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=404972ac0d7449b1a4fc5c64f6cefa8e)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:06.494548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d2bf7-14ab-4e72-9447-debf743f8ddb None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:06.495138 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:06.501132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35a46c-2627-4418-8dac-edaf71dbc530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:06.501938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35a46c-2627-4418-8dac-edaf71dbc530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:06.502408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35a46c-2627-4418-8dac-edaf71dbc530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:06.502608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35a46c-2627-4418-8dac-edaf71dbc530 admin admin] PATH_INFO: `/v3/users/16ba2dfce71c48a59972b9ac0b6b57c0` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:06.504095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35a46c-2627-4418-8dac-edaf71dbc530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ba2dfce71c48a59972b9ac0b6b57c0)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:06.507811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35a46c-2627-4418-8dac-edaf71dbc530 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:06.577819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404972ac0d7449b1a4fc5c64f6cefa8e', 'request_id': 'req-b9394e79-f7a8-4fcb-8119-a46089ceea84'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.589365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404972ac0d7449b1a4fc5c64f6cefa8e', 'request_id': 'req-b9394e79-f7a8-4fcb-8119-a46089ceea84'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.592750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2d35a46c-2627-4418-8dac-edaf71dbc530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ba2dfce71c48a59972b9ac0b6b57c0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.600845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404972ac0d7449b1a4fc5c64f6cefa8e', 'request_id': 'req-b9394e79-f7a8-4fcb-8119-a46089ceea84'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.603213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2d35a46c-2627-4418-8dac-edaf71dbc530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ba2dfce71c48a59972b9ac0b6b57c0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.618649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2d35a46c-2627-4418-8dac-edaf71dbc530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ba2dfce71c48a59972b9ac0b6b57c0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.620372 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2d35a46c-2627-4418-8dac-edaf71dbc530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ba2dfce71c48a59972b9ac0b6b57c0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.622672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2d35a46c-2627-4418-8dac-edaf71dbc530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ba2dfce71c48a59972b9ac0b6b57c0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.626671 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] The token cache is being invalidate because project 404972ac0d7449b1a4fc5c64f6cefa8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:06.627213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.628285 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:06.631477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 916/1832] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:06 2022] DELETE /identity/v3/projects/404972ac0d7449b1a4fc5c64f6cefa8e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:06.632809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:06.636388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:06.645404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 917/1833] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:06 2022] DELETE /identity/v3/users/16ba2dfce71c48a59972b9ac0b6b57c0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:06.647535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ca370-5776-461f-880c-22d6d1861611 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:06.648034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ca370-5776-461f-880c-22d6d1861611 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:06.648510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ca370-5776-461f-880c-22d6d1861611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:06.678180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c72ca370-5776-461f-880c-22d6d1861611 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:06.680179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c72ca370-5776-461f-880c-22d6d1861611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:06.732114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9394e79-f7a8-4fcb-8119-a46089ceea84 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:06.749667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:06.765522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 918/1834] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:06.766858 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774000d-2b51-47d0-a48d-dc2be22972a7 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:06.767431 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774000d-2b51-47d0-a48d-dc2be22972a7 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:06.767947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774000d-2b51-47d0-a48d-dc2be22972a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:06.791319 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-7774000d-2b51-47d0-a48d-dc2be22972a7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:06.792655 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7774000d-2b51-47d0-a48d-dc2be22972a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:06.797789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec5f0f-80d4-471f-8f89-31de781a3656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:06.798029 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec5f0f-80d4-471f-8f89-31de781a3656 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:06.798313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec5f0f-80d4-471f-8f89-31de781a3656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:06.798589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec5f0f-80d4-471f-8f89-31de781a3656 admin admin] PATH_INFO: `/v3/projects/3de6d4591a4d431e9f51652395f041c3/users/c068b1d3edb8408d83f8d53ca03b20e0/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:06.800497 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec5f0f-80d4-471f-8f89-31de781a3656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de6d4591a4d431e9f51652395f041c3, user_id=c068b1d3edb8408d83f8d53ca03b20e0, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:06.801494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 919/1835] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:06.803242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf3735-405c-49c9-852a-83f55ba9f18a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:06.803242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf3735-405c-49c9-852a-83f55ba9f18a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:06.803446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec5f0f-80d4-471f-8f89-31de781a3656 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:06.803532 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf3735-405c-49c9-852a-83f55ba9f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:06.815426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 917/1836] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:06 2022] PUT /identity/v3/projects/3de6d4591a4d431e9f51652395f041c3/users/c068b1d3edb8408d83f8d53ca03b20e0/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:06.816186 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec5f0f-80d4-471f-8f89-31de781a3656 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:06.826375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-efcf3735-405c-49c9-852a-83f55ba9f18a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:06.828027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-efcf3735-405c-49c9-852a-83f55ba9f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:06.864327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:06.928852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 920/1837] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:06.930484 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f5a16-372e-4c24-81cc-6be065f5d36f None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:06.930763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f5a16-372e-4c24-81cc-6be065f5d36f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:06.931231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f5a16-372e-4c24-81cc-6be065f5d36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:06.951719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec5f0f-80d4-471f-8f89-31de781a3656 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:06.972026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3952fd5-1adc-4a45-9400-75d653229ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:06.972771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3952fd5-1adc-4a45-9400-75d653229ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:06.972969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3952fd5-1adc-4a45-9400-75d653229ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:06.973251 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3952fd5-1adc-4a45-9400-75d653229ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:06.979756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3952fd5-1adc-4a45-9400-75d653229ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:06.980107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3952fd5-1adc-4a45-9400-75d653229ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:06.981767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3952fd5-1adc-4a45-9400-75d653229ef3 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:06.992409 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-966f5a16-372e-4c24-81cc-6be065f5d36f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:06.992409 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-966f5a16-372e-4c24-81cc-6be065f5d36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:07.004387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 921/1838] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:07.004387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611416b-7ee8-46b6-80cc-3f5230642726 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.004387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611416b-7ee8-46b6-80cc-3f5230642726 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.004387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611416b-7ee8-46b6-80cc-3f5230642726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.025014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 918/1839] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:11:07.027713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3952fd5-1adc-4a45-9400-75d653229ef3 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.030981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b3952fd5-1adc-4a45-9400-75d653229ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:07.058650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9611416b-7ee8-46b6-80cc-3f5230642726 None None] MFA Rules not processed for user `c068b1d3edb8408d83f8d53ca03b20e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:07.060065 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9611416b-7ee8-46b6-80cc-3f5230642726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:07.104287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3952fd5-1adc-4a45-9400-75d653229ef3 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.109375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afdc0e-a7a9-4d1c-ab0d-a3cd6362489d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.110067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afdc0e-a7a9-4d1c-ab0d-a3cd6362489d service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.110320 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afdc0e-a7a9-4d1c-ab0d-a3cd6362489d service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.111328 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afdc0e-a7a9-4d1c-ab0d-a3cd6362489d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.122841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afdc0e-a7a9-4d1c-ab0d-a3cd6362489d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.124296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afdc0e-a7a9-4d1c-ab0d-a3cd6362489d service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.137235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 919/1840] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:07.137926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afdc0e-a7a9-4d1c-ab0d-a3cd6362489d service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.149131 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afdc0e-a7a9-4d1c-ab0d-a3cd6362489d service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.154280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca950949-001a-4d11-8a86-452c866babc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.154891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca950949-001a-4d11-8a86-452c866babc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.155177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca950949-001a-4d11-8a86-452c866babc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.155457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca950949-001a-4d11-8a86-452c866babc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.160039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca950949-001a-4d11-8a86-452c866babc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:07.160039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca950949-001a-4d11-8a86-452c866babc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.160039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca950949-001a-4d11-8a86-452c866babc7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.160891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 922/1841] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:07.165528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611416b-7ee8-46b6-80cc-3f5230642726 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.184081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 920/1842] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:11:07.184081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8f149-ade7-471a-96a2-c7bbde0420bf None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.184081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8f149-ade7-471a-96a2-c7bbde0420bf None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.184081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8f149-ade7-471a-96a2-c7bbde0420bf None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.188771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 921/1843] 10.222.0.43 () {54 vars in 912 bytes} [Wed Sep 7 16:11:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:11:07.189648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8f149-ade7-471a-96a2-c7bbde0420bf None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.192462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611416b-7ee8-46b6-80cc-3f5230642726 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.197212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f8a8f149-ade7-471a-96a2-c7bbde0420bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:07.198169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39661a11-3c33-4448-90ca-8b826bc8d1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.199038 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661a11-3c33-4448-90ca-8b826bc8d1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.199520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661a11-3c33-4448-90ca-8b826bc8d1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.200674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661a11-3c33-4448-90ca-8b826bc8d1e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.201594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39661a11-3c33-4448-90ca-8b826bc8d1e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.204269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39661a11-3c33-4448-90ca-8b826bc8d1e4 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.250078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 923/1844] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:07 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:07.251192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39661a11-3c33-4448-90ca-8b826bc8d1e4 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.272912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8f149-ade7-471a-96a2-c7bbde0420bf None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.319421 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:07.335065 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39661a11-3c33-4448-90ca-8b826bc8d1e4 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.341321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11540a7d-6d33-4a12-9167-47b6878fe4d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.341946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11540a7d-6d33-4a12-9167-47b6878fe4d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.342232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11540a7d-6d33-4a12-9167-47b6878fe4d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.342510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11540a7d-6d33-4a12-9167-47b6878fe4d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.343662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddbb82-f2e9-4338-8a4c-dd8ad72dd4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.344283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddbb82-f2e9-4338-8a4c-dd8ad72dd4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.344568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddbb82-f2e9-4338-8a4c-dd8ad72dd4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.345117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddbb82-f2e9-4338-8a4c-dd8ad72dd4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.345808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddbb82-f2e9-4338-8a4c-dd8ad72dd4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.348571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddbb82-f2e9-4338-8a4c-dd8ad72dd4b3 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.354977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:07.386790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 924/1845] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:07 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:07.388360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52646d4f-8bf5-4a1e-8ce8-a037c4a5db46 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.388854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52646d4f-8bf5-4a1e-8ce8-a037c4a5db46 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.389135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52646d4f-8bf5-4a1e-8ce8-a037c4a5db46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.425067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-52646d4f-8bf5-4a1e-8ce8-a037c4a5db46 None None] MFA Rules not processed for user `e91f048f8885448383f4a361b07dac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:07.426443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-52646d4f-8bf5-4a1e-8ce8-a037c4a5db46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:07.456461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11540a7d-6d33-4a12-9167-47b6878fe4d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.460078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11540a7d-6d33-4a12-9167-47b6878fe4d1 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.472965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 922/1846] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:07.474196 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11540a7d-6d33-4a12-9167-47b6878fe4d1 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.486767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11540a7d-6d33-4a12-9167-47b6878fe4d1 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.500291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 925/1847] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:11:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:07.501833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52646d4f-8bf5-4a1e-8ce8-a037c4a5db46 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.591017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3d3fd-e9ba-42fe-9de8-5414373a19af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.591712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3d3fd-e9ba-42fe-9de8-5414373a19af admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.592084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3d3fd-e9ba-42fe-9de8-5414373a19af admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.592438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3d3fd-e9ba-42fe-9de8-5414373a19af admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.593182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3d3fd-e9ba-42fe-9de8-5414373a19af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.595502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3d3fd-e9ba-42fe-9de8-5414373a19af admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.639262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 923/1848] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:07 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:07.641493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52646d4f-8bf5-4a1e-8ce8-a037c4a5db46 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.642677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3d3fd-e9ba-42fe-9de8-5414373a19af admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.649446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c5b2-e43c-4a08-8f75-bed4f2421e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.651480 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c5b2-e43c-4a08-8f75-bed4f2421e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.654479 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c5b2-e43c-4a08-8f75-bed4f2421e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.657077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3d3fd-e9ba-42fe-9de8-5414373a19af admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.657201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c5b2-e43c-4a08-8f75-bed4f2421e50 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.660050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36c5b2-e43c-4a08-8f75-bed4f2421e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.661247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27aa20-67f2-4410-9de8-db1f59bcc1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.662434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27aa20-67f2-4410-9de8-db1f59bcc1ed service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.662753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27aa20-67f2-4410-9de8-db1f59bcc1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.663027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27aa20-67f2-4410-9de8-db1f59bcc1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.663236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36c5b2-e43c-4a08-8f75-bed4f2421e50 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.671255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27aa20-67f2-4410-9de8-db1f59bcc1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.672703 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27aa20-67f2-4410-9de8-db1f59bcc1ed service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.693319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 924/1849] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:07.694585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27aa20-67f2-4410-9de8-db1f59bcc1ed service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.706547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 926/1850] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:07 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:07.707498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c5b2-e43c-4a08-8f75-bed4f2421e50 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.709562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27aa20-67f2-4410-9de8-db1f59bcc1ed service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.710191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-5e36c5b2-e43c-4a08-8f75-bed4f2421e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:07.716245 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704110e4-55f2-4b84-83db-f21e95ebba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.717045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704110e4-55f2-4b84-83db-f21e95ebba51 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.717407 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704110e4-55f2-4b84-83db-f21e95ebba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.717755 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704110e4-55f2-4b84-83db-f21e95ebba51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.718553 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704110e4-55f2-4b84-83db-f21e95ebba51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.720292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704110e4-55f2-4b84-83db-f21e95ebba51 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.724207 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c5b2-e43c-4a08-8f75-bed4f2421e50 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.734939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.735461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.735738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.736152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] PATH_INFO: `/v3/projects/0e1bea12881d4a8abd4c18758aca4e1f` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.738108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1bea12881d4a8abd4c18758aca4e1f)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.740063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.749654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 925/1851] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:07.750637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704110e4-55f2-4b84-83db-f21e95ebba51 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.767123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704110e4-55f2-4b84-83db-f21e95ebba51 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.772804 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726facb-c4ea-49c0-aa73-b7cbd17ba013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.773546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726facb-c4ea-49c0-aa73-b7cbd17ba013 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.773766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726facb-c4ea-49c0-aa73-b7cbd17ba013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.774235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726facb-c4ea-49c0-aa73-b7cbd17ba013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.775160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726facb-c4ea-49c0-aa73-b7cbd17ba013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.777211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726facb-c4ea-49c0-aa73-b7cbd17ba013 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.790885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 926/1852] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:07.791776 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726facb-c4ea-49c0-aa73-b7cbd17ba013 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.800272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1bea12881d4a8abd4c18758aca4e1f', 'request_id': 'req-d2366024-8144-47a7-8929-f77ffc475050'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:07.806878 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1bea12881d4a8abd4c18758aca4e1f', 'request_id': 'req-d2366024-8144-47a7-8929-f77ffc475050'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:07.808977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726facb-c4ea-49c0-aa73-b7cbd17ba013 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.820974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1bea12881d4a8abd4c18758aca4e1f', 'request_id': 'req-d2366024-8144-47a7-8929-f77ffc475050'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:07.840381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:07.846613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] The token cache is being invalidate because project 0e1bea12881d4a8abd4c18758aca4e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:07.847362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:07.849068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:07.852459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 927/1853] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:07 2022] DELETE /identity/v3/projects/0e1bea12881d4a8abd4c18758aca4e1f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:07.857926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.859719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:07.906971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24e554-f6f4-4522-9b04-5a337698a0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.907726 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24e554-f6f4-4522-9b04-5a337698a0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.924373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24e554-f6f4-4522-9b04-5a337698a0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.925230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24e554-f6f4-4522-9b04-5a337698a0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.927246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24e554-f6f4-4522-9b04-5a337698a0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.929813 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24e554-f6f4-4522-9b04-5a337698a0c2 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.931702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:07.955104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 927/1854] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:07.955104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24e554-f6f4-4522-9b04-5a337698a0c2 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:07.956046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1f24e554-f6f4-4522-9b04-5a337698a0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:07.975744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2366024-8144-47a7-8929-f77ffc475050 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.975979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24e554-f6f4-4522-9b04-5a337698a0c2 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:07.982597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd2112-556a-40a4-9646-ca8ee42e2145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.983209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417038d4-3c03-4934-acf0-e5b3a6162399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:07.983914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd2112-556a-40a4-9646-ca8ee42e2145 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.984236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417038d4-3c03-4934-acf0-e5b3a6162399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:07.984377 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd2112-556a-40a4-9646-ca8ee42e2145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.984606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd2112-556a-40a4-9646-ca8ee42e2145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.985416 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd2112-556a-40a4-9646-ca8ee42e2145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.986130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417038d4-3c03-4934-acf0-e5b3a6162399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:07.986498 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417038d4-3c03-4934-acf0-e5b3a6162399 admin admin] PATH_INFO: `/v3/users/0564c1f025bc4c40ad1bda759dda8d05` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:07.987029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd2112-556a-40a4-9646-ca8ee42e2145 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:07.988019 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417038d4-3c03-4934-acf0-e5b3a6162399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0564c1f025bc4c40ad1bda759dda8d05)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:07.991817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417038d4-3c03-4934-acf0-e5b3a6162399 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:08.004008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 928/1855] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:08.005317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd2112-556a-40a4-9646-ca8ee42e2145 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:08.008088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0ebd2112-556a-40a4-9646-ca8ee42e2145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:08.033838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd2112-556a-40a4-9646-ca8ee42e2145 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:08.041499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abd805-aa05-4648-abf3-891bfb27f508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:08.042177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd805-aa05-4648-abf3-891bfb27f508 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:08.042468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd805-aa05-4648-abf3-891bfb27f508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:08.042740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd805-aa05-4648-abf3-891bfb27f508 admin admin] PATH_INFO: `/v3/projects/d76007821708489ebfb7221e66e093e0/users/cd04de1249f04dbb872852cbbc6a2679/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:08.060150 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abd805-aa05-4648-abf3-891bfb27f508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76007821708489ebfb7221e66e093e0, user_id=cd04de1249f04dbb872852cbbc6a2679, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:08.062893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abd805-aa05-4648-abf3-891bfb27f508 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:08.080724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-417038d4-3c03-4934-acf0-e5b3a6162399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0564c1f025bc4c40ad1bda759dda8d05'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:08.094921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 929/1856] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:08 2022] PUT /identity/v3/projects/d76007821708489ebfb7221e66e093e0/users/cd04de1249f04dbb872852cbbc6a2679/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:08.105284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-417038d4-3c03-4934-acf0-e5b3a6162399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0564c1f025bc4c40ad1bda759dda8d05'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:08.105284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-417038d4-3c03-4934-acf0-e5b3a6162399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0564c1f025bc4c40ad1bda759dda8d05'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:08.105284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-417038d4-3c03-4934-acf0-e5b3a6162399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0564c1f025bc4c40ad1bda759dda8d05'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:08.105789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abd805-aa05-4648-abf3-891bfb27f508 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:08.110295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-97abd805-aa05-4648-abf3-891bfb27f508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:08.127115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-417038d4-3c03-4934-acf0-e5b3a6162399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0564c1f025bc4c40ad1bda759dda8d05'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:08.144325 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 928/1857] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:07 2022] DELETE /identity/v3/users/0564c1f025bc4c40ad1bda759dda8d05 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:08.167623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6024f-79b0-4ff2-ac2d-c5b5add23477 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:08.168239 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6024f-79b0-4ff2-ac2d-c5b5add23477 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:08.168719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6024f-79b0-4ff2-ac2d-c5b5add23477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:08.230925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-75a6024f-79b0-4ff2-ac2d-c5b5add23477 None None] MFA Rules not processed for user `cd04de1249f04dbb872852cbbc6a2679`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:08.255380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-75a6024f-79b0-4ff2-ac2d-c5b5add23477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:08.310296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abd805-aa05-4648-abf3-891bfb27f508 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:08.470991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 929/1858] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:08.471590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3e6ec-ca43-484e-8fdf-2459ddf4e358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:08.472291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3e6ec-ca43-484e-8fdf-2459ddf4e358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:08.472576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3e6ec-ca43-484e-8fdf-2459ddf4e358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:08.472905 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3e6ec-ca43-484e-8fdf-2459ddf4e358 admin admin] PATH_INFO: `/v3/projects/4cd9c72d228341c589cb361eb1cb0068/users/91b99005247f4d1c975676c93e18bbad/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:08.476332 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6024f-79b0-4ff2-ac2d-c5b5add23477 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:08.484397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-75a6024f-79b0-4ff2-ac2d-c5b5add23477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:08.540347 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3e6ec-ca43-484e-8fdf-2459ddf4e358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd9c72d228341c589cb361eb1cb0068, user_id=91b99005247f4d1c975676c93e18bbad, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:08.550010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3e6ec-ca43-484e-8fdf-2459ddf4e358 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:08.578549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:08.589027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 930/1859] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:08 2022] PUT /identity/v3/projects/4cd9c72d228341c589cb361eb1cb0068/users/91b99005247f4d1c975676c93e18bbad/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:08.590131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3e6ec-ca43-484e-8fdf-2459ddf4e358 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:08.596060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d9c3e6ec-ca43-484e-8fdf-2459ddf4e358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:08.642662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6024f-79b0-4ff2-ac2d-c5b5add23477 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:08.694353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:08.754730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26c1d-7823-4fe8-8593-ed182ba31edf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:08.756947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26c1d-7823-4fe8-8593-ed182ba31edf service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:08.757339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26c1d-7823-4fe8-8593-ed182ba31edf service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:08.757649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26c1d-7823-4fe8-8593-ed182ba31edf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:08.759739 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-22c26c1d-7823-4fe8-8593-ed182ba31edf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:08.782120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3e6ec-ca43-484e-8fdf-2459ddf4e358 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:08.788433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddf951-e9c7-4c4a-a738-ea8aaa3b31cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:08.789494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddf951-e9c7-4c4a-a738-ea8aaa3b31cc admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:08.789791 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddf951-e9c7-4c4a-a738-ea8aaa3b31cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:08.790045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddf951-e9c7-4c4a-a738-ea8aaa3b31cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:08.790698 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddf951-e9c7-4c4a-a738-ea8aaa3b31cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:08.792826 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddf951-e9c7-4c4a-a738-ea8aaa3b31cc admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:08.831616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 931/1860] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:08 2022] POST /identity/v3/projects => generated 381 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:08.834527 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d9980-9e74-46ae-bd38-34f90cba6a0d None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:08.835517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d9980-9e74-46ae-bd38-34f90cba6a0d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:08.836011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d9980-9e74-46ae-bd38-34f90cba6a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:08.868433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f30d9980-9e74-46ae-bd38-34f90cba6a0d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:08.869950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f30d9980-9e74-46ae-bd38-34f90cba6a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:08.876392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c26c1d-7823-4fe8-8593-ed182ba31edf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:08.879340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c26c1d-7823-4fe8-8593-ed182ba31edf service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:08.894893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 930/1861] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:08.897602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26c1d-7823-4fe8-8593-ed182ba31edf service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:08.917065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26c1d-7823-4fe8-8593-ed182ba31edf service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:08.989053 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 932/1862] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:08.991357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d9980-9e74-46ae-bd38-34f90cba6a0d None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:08.993585 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f30d9980-9e74-46ae-bd38-34f90cba6a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:09.010488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d9980-9e74-46ae-bd38-34f90cba6a0d None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:09.015999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:09.017441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.017750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.018030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] PATH_INFO: `/v3/projects/4b76d748fe69406d8afe9af695f13ac4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.019400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b76d748fe69406d8afe9af695f13ac4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:09.022043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:09.037323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09490887-bbba-4f37-bc60-391ddd16cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:09.038338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09490887-bbba-4f37-bc60-391ddd16cdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.038804 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09490887-bbba-4f37-bc60-391ddd16cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.039273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09490887-bbba-4f37-bc60-391ddd16cdb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.040091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09490887-bbba-4f37-bc60-391ddd16cdb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:09.042927 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09490887-bbba-4f37-bc60-391ddd16cdb1 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:09.081863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 931/1863] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:08 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:09.081863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09490887-bbba-4f37-bc60-391ddd16cdb1 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:09.081863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-09490887-bbba-4f37-bc60-391ddd16cdb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:09.096891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b76d748fe69406d8afe9af695f13ac4', 'request_id': 'req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:09.112245 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b76d748fe69406d8afe9af695f13ac4', 'request_id': 'req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:09.123640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b76d748fe69406d8afe9af695f13ac4', 'request_id': 'req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:09.149533 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] The token cache is being invalidate because project 4b76d748fe69406d8afe9af695f13ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:09.149860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:09.151760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:09.154091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 933/1864] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:08 2022] DELETE /identity/v3/projects/4b76d748fe69406d8afe9af695f13ac4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:09.155056 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:09.156723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:09.169500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09490887-bbba-4f37-bc60-391ddd16cdb1 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:09.172036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:09.188160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:09.247667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3161ab0-650d-4f76-a8e6-47e91bafb3ca admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:09.252108 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af980274-985f-443c-ac69-6a15ae74b693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:09.252779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af980274-985f-443c-ac69-6a15ae74b693 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.253066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af980274-985f-443c-ac69-6a15ae74b693 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.253343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af980274-985f-443c-ac69-6a15ae74b693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.255339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-af980274-985f-443c-ac69-6a15ae74b693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:09.256494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cf12c-62b2-418d-8489-bb79ef7fcfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:09.257694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cf12c-62b2-418d-8489-bb79ef7fcfb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.258358 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cf12c-62b2-418d-8489-bb79ef7fcfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.258872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cf12c-62b2-418d-8489-bb79ef7fcfb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.259798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cf12c-62b2-418d-8489-bb79ef7fcfb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:09.261965 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cf12c-62b2-418d-8489-bb79ef7fcfb4 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:09.270967 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af980274-985f-443c-ac69-6a15ae74b693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:09.273404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af980274-985f-443c-ac69-6a15ae74b693 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:09.280813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 934/1865] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:09.282815 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0b749-bf6f-4dbe-abb2-5e02029cb01a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.283295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0b749-bf6f-4dbe-abb2-5e02029cb01a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.283754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0b749-bf6f-4dbe-abb2-5e02029cb01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.288273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 932/1866] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:09.289136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af980274-985f-443c-ac69-6a15ae74b693 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:09.308442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af980274-985f-443c-ac69-6a15ae74b693 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:09.330750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c56f8a-1b42-4ed6-84fd-e04a1a5fa819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:09.331518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c56f8a-1b42-4ed6-84fd-e04a1a5fa819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.332172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c56f8a-1b42-4ed6-84fd-e04a1a5fa819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.332470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c56f8a-1b42-4ed6-84fd-e04a1a5fa819 admin admin] PATH_INFO: `/v3/projects/09590777959f49d098b9c15eaff40307/users/7454d5eb50c24907b7857a0894082c2c/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.346709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-3ac0b749-bf6f-4dbe-abb2-5e02029cb01a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:09.353272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3ac0b749-bf6f-4dbe-abb2-5e02029cb01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:09.364136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c56f8a-1b42-4ed6-84fd-e04a1a5fa819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09590777959f49d098b9c15eaff40307, user_id=7454d5eb50c24907b7857a0894082c2c, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:09.367684 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c56f8a-1b42-4ed6-84fd-e04a1a5fa819 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:09.369125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 935/1867] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:09.377657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205a503-fab8-492e-bcfe-1d0ae30a327c None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.377840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205a503-fab8-492e-bcfe-1d0ae30a327c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.378262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205a503-fab8-492e-bcfe-1d0ae30a327c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.400579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 933/1868] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:09 2022] PUT /identity/v3/projects/09590777959f49d098b9c15eaff40307/users/7454d5eb50c24907b7857a0894082c2c/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:09.404531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c56f8a-1b42-4ed6-84fd-e04a1a5fa819 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:09.413594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-6205a503-fab8-492e-bcfe-1d0ae30a327c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:09.415160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6205a503-fab8-492e-bcfe-1d0ae30a327c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:09.497714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 936/1869] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:09.499750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205a503-fab8-492e-bcfe-1d0ae30a327c None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:09.513540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205a503-fab8-492e-bcfe-1d0ae30a327c None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:09.519972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e4472-07be-4f5e-8362-0b72d258b835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:09.520933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e4472-07be-4f5e-8362-0b72d258b835 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.521707 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e4472-07be-4f5e-8362-0b72d258b835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.522261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e4472-07be-4f5e-8362-0b72d258b835 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.523935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e4472-07be-4f5e-8362-0b72d258b835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:09.524441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e4472-07be-4f5e-8362-0b72d258b835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:09.526157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c56f8a-1b42-4ed6-84fd-e04a1a5fa819 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:09.527702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e4472-07be-4f5e-8362-0b72d258b835 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:09.533214 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c2849-8674-4dca-80d8-35ae900e7f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:09.533851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c2849-8674-4dca-80d8-35ae900e7f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.534135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c2849-8674-4dca-80d8-35ae900e7f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.534428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c2849-8674-4dca-80d8-35ae900e7f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.535486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c2849-8674-4dca-80d8-35ae900e7f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:09.539087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c2849-8674-4dca-80d8-35ae900e7f3b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:09.553027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 937/1870] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:11:09.553991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 934/1871] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:09.558524 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c2849-8674-4dca-80d8-35ae900e7f3b admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:09.561164 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e4472-07be-4f5e-8362-0b72d258b835 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:09.572991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e4472-07be-4f5e-8362-0b72d258b835 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:09.579869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f355bb5-25de-43cf-8ada-713e52213613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:09.580766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355bb5-25de-43cf-8ada-713e52213613 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.581151 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355bb5-25de-43cf-8ada-713e52213613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.581529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355bb5-25de-43cf-8ada-713e52213613 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.582669 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f355bb5-25de-43cf-8ada-713e52213613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:09.585482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f355bb5-25de-43cf-8ada-713e52213613 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:09.593012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c2849-8674-4dca-80d8-35ae900e7f3b admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:09.604405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527bbd6-d0ad-4e85-83a6-51a9acc30191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:09.605262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527bbd6-d0ad-4e85-83a6-51a9acc30191 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.605925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527bbd6-d0ad-4e85-83a6-51a9acc30191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.606312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527bbd6-d0ad-4e85-83a6-51a9acc30191 admin admin] PATH_INFO: `/v3/projects/09590777959f49d098b9c15eaff40307/users/7454d5eb50c24907b7857a0894082c2c/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.608605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527bbd6-d0ad-4e85-83a6-51a9acc30191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09590777959f49d098b9c15eaff40307, user_id=7454d5eb50c24907b7857a0894082c2c, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:09.611832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527bbd6-d0ad-4e85-83a6-51a9acc30191 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:09.628729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 935/1872] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:09 2022] PUT /identity/v3/projects/09590777959f49d098b9c15eaff40307/users/7454d5eb50c24907b7857a0894082c2c/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:09.636878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19c6d4-9e4f-4b7d-ab20-d6ed5a909441 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.637555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19c6d4-9e4f-4b7d-ab20-d6ed5a909441 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.637992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19c6d4-9e4f-4b7d-ab20-d6ed5a909441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.648388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 938/1873] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:09 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:09.649574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f355bb5-25de-43cf-8ada-713e52213613 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:09.693039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-2e19c6d4-9e4f-4b7d-ab20-d6ed5a909441 None None] MFA Rules not processed for user `7454d5eb50c24907b7857a0894082c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:09.695376 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2e19c6d4-9e4f-4b7d-ab20-d6ed5a909441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:09.809825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f355bb5-25de-43cf-8ada-713e52213613 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:09.819108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87692e-8c4d-4954-b122-47e5ff3e461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:09.819964 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87692e-8c4d-4954-b122-47e5ff3e461d admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.820219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87692e-8c4d-4954-b122-47e5ff3e461d admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.820947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87692e-8c4d-4954-b122-47e5ff3e461d admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.821264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87692e-8c4d-4954-b122-47e5ff3e461d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:09.823446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87692e-8c4d-4954-b122-47e5ff3e461d admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:09.840108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:09.859775 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 939/1874] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:09 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:09.860364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:09.864436 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87692e-8c4d-4954-b122-47e5ff3e461d admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:09.875223 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 936/1875] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:09.887651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87692e-8c4d-4954-b122-47e5ff3e461d admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:09.893076 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83eda85-b765-4ca7-b72a-dad42796b08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:09.894891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83eda85-b765-4ca7-b72a-dad42796b08b admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.895588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83eda85-b765-4ca7-b72a-dad42796b08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.895880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83eda85-b765-4ca7-b72a-dad42796b08b admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.897375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83eda85-b765-4ca7-b72a-dad42796b08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:09.899013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83eda85-b765-4ca7-b72a-dad42796b08b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:09.941029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 940/1876] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:09.946899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19c6d4-9e4f-4b7d-ab20-d6ed5a909441 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:09.962471 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19c6d4-9e4f-4b7d-ab20-d6ed5a909441 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:09.975307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14c4a-f6f8-4318-ad8f-2f7e41cbe817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:09.975943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14c4a-f6f8-4318-ad8f-2f7e41cbe817 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:09.976384 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14c4a-f6f8-4318-ad8f-2f7e41cbe817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:09.976672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14c4a-f6f8-4318-ad8f-2f7e41cbe817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:09.977653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d14c4a-f6f8-4318-ad8f-2f7e41cbe817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:09.979272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d14c4a-f6f8-4318-ad8f-2f7e41cbe817 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:09.991496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 937/1877] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:09.996354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83eda85-b765-4ca7-b72a-dad42796b08b admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:10.008790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83eda85-b765-4ca7-b72a-dad42796b08b admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:10.028466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4bb50-3585-4d68-b3cf-879d84c9bea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:10.029236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4bb50-3585-4d68-b3cf-879d84c9bea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:10.029519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4bb50-3585-4d68-b3cf-879d84c9bea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:10.030777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4bb50-3585-4d68-b3cf-879d84c9bea1 admin admin] PATH_INFO: `/v3/projects/27a527b690ce4453b5e1e8250602bbe8/users/040972cfbc98402a921d7057620d4079/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:10.070844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4bb50-3585-4d68-b3cf-879d84c9bea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a527b690ce4453b5e1e8250602bbe8, user_id=040972cfbc98402a921d7057620d4079, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:10.075536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4bb50-3585-4d68-b3cf-879d84c9bea1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:10.097898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 941/1878] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:09 2022] PUT /identity/v3/projects/27a527b690ce4453b5e1e8250602bbe8/users/040972cfbc98402a921d7057620d4079/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:10.109009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418454de-443f-4a98-865f-150c32ba28e7 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:10.109296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418454de-443f-4a98-865f-150c32ba28e7 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:10.109627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418454de-443f-4a98-865f-150c32ba28e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:10.141998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-418454de-443f-4a98-865f-150c32ba28e7 None None] MFA Rules not processed for user `040972cfbc98402a921d7057620d4079`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:10.143273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-418454de-443f-4a98-865f-150c32ba28e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:10.236478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 938/1879] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:10.241589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4bb50-3585-4d68-b3cf-879d84c9bea1 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:10.392464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4bb50-3585-4d68-b3cf-879d84c9bea1 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:10.399838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1a4c3-2fee-486e-9ee9-a02f819e3ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:10.400540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1a4c3-2fee-486e-9ee9-a02f819e3ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:10.400926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1a4c3-2fee-486e-9ee9-a02f819e3ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:10.401276 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1a4c3-2fee-486e-9ee9-a02f819e3ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:10.401949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1a4c3-2fee-486e-9ee9-a02f819e3ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:10.404276 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1a4c3-2fee-486e-9ee9-a02f819e3ee3 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:10.450100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 942/1880] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:10 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:10.454114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418454de-443f-4a98-865f-150c32ba28e7 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:10.467581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418454de-443f-4a98-865f-150c32ba28e7 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:10.590854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444ff1d-8742-4dbb-9a78-a5cc8fb23989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:10.591939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444ff1d-8742-4dbb-9a78-a5cc8fb23989 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:10.592234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444ff1d-8742-4dbb-9a78-a5cc8fb23989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:10.592675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444ff1d-8742-4dbb-9a78-a5cc8fb23989 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:10.593464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444ff1d-8742-4dbb-9a78-a5cc8fb23989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:10.596213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444ff1d-8742-4dbb-9a78-a5cc8fb23989 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:10.631611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 939/1881] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:10 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:10.635747 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1a4c3-2fee-486e-9ee9-a02f819e3ee3 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:10.648904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1a4c3-2fee-486e-9ee9-a02f819e3ee3 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:10.655430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696643c-d17b-495f-9028-77308eef8b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:10.656448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696643c-d17b-495f-9028-77308eef8b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:10.656977 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696643c-d17b-495f-9028-77308eef8b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:10.657283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696643c-d17b-495f-9028-77308eef8b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:10.658258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696643c-d17b-495f-9028-77308eef8b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:10.659867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696643c-d17b-495f-9028-77308eef8b0c admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:10.679390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444ff1d-8742-4dbb-9a78-a5cc8fb23989 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:10.685926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 943/1882] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:10.692027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444ff1d-8742-4dbb-9a78-a5cc8fb23989 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:10.699488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97258578-63b7-422d-880b-26bd0e7dd6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:10.700271 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97258578-63b7-422d-880b-26bd0e7dd6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:10.700603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97258578-63b7-422d-880b-26bd0e7dd6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:10.700989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97258578-63b7-422d-880b-26bd0e7dd6f2 admin admin] PATH_INFO: `/v3/projects/8868a4f3ee0545a0914c2e9d3fdb8eec/users/e5ba6c9efaa8467ab0592f209f3c385b/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:10.721896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97258578-63b7-422d-880b-26bd0e7dd6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8868a4f3ee0545a0914c2e9d3fdb8eec, user_id=e5ba6c9efaa8467ab0592f209f3c385b, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:10.726689 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97258578-63b7-422d-880b-26bd0e7dd6f2 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:10.749151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 940/1883] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:10 2022] PUT /identity/v3/projects/8868a4f3ee0545a0914c2e9d3fdb8eec/users/e5ba6c9efaa8467ab0592f209f3c385b/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:10.750262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696643c-d17b-495f-9028-77308eef8b0c admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:10.761580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696643c-d17b-495f-9028-77308eef8b0c admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:10.806514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f5a2c-8678-42b1-a0b2-49d12573af99 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:10.806805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f5a2c-8678-42b1-a0b2-49d12573af99 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:10.807082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f5a2c-8678-42b1-a0b2-49d12573af99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:10.855197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f445e-7750-4352-9646-d87ab5872d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:10.855458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f445e-7750-4352-9646-d87ab5872d65 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:10.855711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f445e-7750-4352-9646-d87ab5872d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:10.855910 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f445e-7750-4352-9646-d87ab5872d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:10.856574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f445e-7750-4352-9646-d87ab5872d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:10.858215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f445e-7750-4352-9646-d87ab5872d65 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:10.866116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-ac2f5a2c-8678-42b1-a0b2-49d12573af99 None None] MFA Rules not processed for user `91b99005247f4d1c975676c93e18bbad`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:10.870692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ac2f5a2c-8678-42b1-a0b2-49d12573af99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:10.875757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 944/1884] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:10.876655 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f445e-7750-4352-9646-d87ab5872d65 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:10.893336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f445e-7750-4352-9646-d87ab5872d65 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:10.909473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd70da9-eeba-4039-a10d-fe1a6ab9acb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:10.910080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd70da9-eeba-4039-a10d-fe1a6ab9acb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:10.910361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd70da9-eeba-4039-a10d-fe1a6ab9acb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:10.910663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd70da9-eeba-4039-a10d-fe1a6ab9acb1 admin admin] PATH_INFO: `/v3/projects/8868a4f3ee0545a0914c2e9d3fdb8eec/users/e5ba6c9efaa8467ab0592f209f3c385b/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:10.913766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd70da9-eeba-4039-a10d-fe1a6ab9acb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8868a4f3ee0545a0914c2e9d3fdb8eec, user_id=e5ba6c9efaa8467ab0592f209f3c385b, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:10.916901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd70da9-eeba-4039-a10d-fe1a6ab9acb1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:10.933248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:10.935882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 945/1885] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:10 2022] PUT /identity/v3/projects/8868a4f3ee0545a0914c2e9d3fdb8eec/users/e5ba6c9efaa8467ab0592f209f3c385b/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:10.947800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40952774-847b-48c1-80d2-b761e2968790 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:10.948091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40952774-847b-48c1-80d2-b761e2968790 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:10.948367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40952774-847b-48c1-80d2-b761e2968790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:10.978271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-40952774-847b-48c1-80d2-b761e2968790 None None] MFA Rules not processed for user `e5ba6c9efaa8467ab0592f209f3c385b`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:10.979632 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-40952774-847b-48c1-80d2-b761e2968790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:10.979908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 941/1886] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:10.986251 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f5a2c-8678-42b1-a0b2-49d12573af99 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:10.988186 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:10.988713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ac2f5a2c-8678-42b1-a0b2-49d12573af99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:11.004615 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f5a2c-8678-42b1-a0b2-49d12573af99 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:11.106745 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851d86a-20f0-4383-b16f-8594d05491d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:11.107092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851d86a-20f0-4383-b16f-8594d05491d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:11.107383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851d86a-20f0-4383-b16f-8594d05491d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:11.107490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 946/1887] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:11.107750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851d86a-20f0-4383-b16f-8594d05491d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:11.113131 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851d86a-20f0-4383-b16f-8594d05491d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:11.118604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40952774-847b-48c1-80d2-b761e2968790 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:11.119473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-40952774-847b-48c1-80d2-b761e2968790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:11.129072 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851d86a-20f0-4383-b16f-8594d05491d7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:11.189900 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 942/1888] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:10 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:11.194542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851d86a-20f0-4383-b16f-8594d05491d7 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:11.260788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40952774-847b-48c1-80d2-b761e2968790 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:11.369482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d03189-eb9d-4e77-b468-9ce969940335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:11.370114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d03189-eb9d-4e77-b468-9ce969940335 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:11.370540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d03189-eb9d-4e77-b468-9ce969940335 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:11.370825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d03189-eb9d-4e77-b468-9ce969940335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:11.373065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851d86a-20f0-4383-b16f-8594d05491d7 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:11.407676 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8c335-84ee-40a2-b060-337ebf0f44a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:11.410851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8c335-84ee-40a2-b060-337ebf0f44a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:11.413101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8c335-84ee-40a2-b060-337ebf0f44a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:11.413959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8c335-84ee-40a2-b060-337ebf0f44a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:11.418391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8c335-84ee-40a2-b060-337ebf0f44a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:11.420590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8c335-84ee-40a2-b060-337ebf0f44a7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:11.477163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d03189-eb9d-4e77-b468-9ce969940335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:11.478761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d03189-eb9d-4e77-b468-9ce969940335 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:11.485999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 943/1889] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:11 2022] POST /identity/v3/users => generated 292 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:11.487255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8c335-84ee-40a2-b060-337ebf0f44a7 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:11.507960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 947/1890] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:11.510576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8c335-84ee-40a2-b060-337ebf0f44a7 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:11.517919 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca1db-09c9-4531-8b25-57e1e4e8b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:11.518851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca1db-09c9-4531-8b25-57e1e4e8b45a admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:11.519234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca1db-09c9-4531-8b25-57e1e4e8b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:11.519605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca1db-09c9-4531-8b25-57e1e4e8b45a admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:11.520367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aca1db-09c9-4531-8b25-57e1e4e8b45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:11.522687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aca1db-09c9-4531-8b25-57e1e4e8b45a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:11.536171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 944/1891] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:11.545997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d03189-eb9d-4e77-b468-9ce969940335 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:11.554656 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d03189-eb9d-4e77-b468-9ce969940335 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:11.559941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60f1d6-37eb-4da5-b795-9b760fe4824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:11.560719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60f1d6-37eb-4da5-b795-9b760fe4824f admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:11.561016 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60f1d6-37eb-4da5-b795-9b760fe4824f admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:11.561299 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60f1d6-37eb-4da5-b795-9b760fe4824f admin admin] PATH_INFO: `/v3/projects/7b9f2edf1d604c6dbf43802f64d81090/users/7ab1490f0f51486faab10cb1794620f6/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:11.564303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:11.585726 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60f1d6-37eb-4da5-b795-9b760fe4824f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9f2edf1d604c6dbf43802f64d81090, user_id=7ab1490f0f51486faab10cb1794620f6, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:11.589175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60f1d6-37eb-4da5-b795-9b760fe4824f admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:11.623271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 948/1892] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:11 2022] PUT /identity/v3/projects/7b9f2edf1d604c6dbf43802f64d81090/users/7ab1490f0f51486faab10cb1794620f6/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:11.627181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca1db-09c9-4531-8b25-57e1e4e8b45a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:11.637927 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca1db-09c9-4531-8b25-57e1e4e8b45a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:11.669598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60f1d6-37eb-4da5-b795-9b760fe4824f admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:11.678828 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:11.732061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716cc92-0442-4cb2-8518-d5a592baaa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:11.733291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716cc92-0442-4cb2-8518-d5a592baaa20 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:11.733771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716cc92-0442-4cb2-8518-d5a592baaa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:11.734933 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716cc92-0442-4cb2-8518-d5a592baaa20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:11.735939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716cc92-0442-4cb2-8518-d5a592baaa20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:11.738586 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716cc92-0442-4cb2-8518-d5a592baaa20 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:11.750356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60f1d6-37eb-4da5-b795-9b760fe4824f admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:11.756344 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 945/1893] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:11.760006 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537d096-eef3-427b-b7d2-a6a3c11d6ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:11.760819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537d096-eef3-427b-b7d2-a6a3c11d6ebc service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:11.760939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716cc92-0442-4cb2-8518-d5a592baaa20 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:11.761162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537d096-eef3-427b-b7d2-a6a3c11d6ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:11.762211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537d096-eef3-427b-b7d2-a6a3c11d6ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:11.822597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716cc92-0442-4cb2-8518-d5a592baaa20 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:11.874212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5d86b-7457-478a-8cc8-c7c41c601261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:11.888450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5d86b-7457-478a-8cc8-c7c41c601261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:11.888450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5d86b-7457-478a-8cc8-c7c41c601261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:11.888450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5d86b-7457-478a-8cc8-c7c41c601261 admin admin] PATH_INFO: `/v3/projects/7b9f2edf1d604c6dbf43802f64d81090/users/7ab1490f0f51486faab10cb1794620f6/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:11.888450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5d86b-7457-478a-8cc8-c7c41c601261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9f2edf1d604c6dbf43802f64d81090, user_id=7ab1490f0f51486faab10cb1794620f6, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:11.893377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5d86b-7457-478a-8cc8-c7c41c601261 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:11.896768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537d096-eef3-427b-b7d2-a6a3c11d6ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:11.900004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537d096-eef3-427b-b7d2-a6a3c11d6ebc service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:11.922286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 949/1894] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:11.939737 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 946/1895] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:11 2022] PUT /identity/v3/projects/7b9f2edf1d604c6dbf43802f64d81090/users/7ab1490f0f51486faab10cb1794620f6/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:13.061936 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bce3d7-d05a-464a-86bf-8ef352368ce2 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:13.062417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bce3d7-d05a-464a-86bf-8ef352368ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:13.062494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bce3d7-d05a-464a-86bf-8ef352368ce2 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:13.064188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 950/1896] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:11:13.134844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558c01-1f1d-4553-ab7b-bce730146e98 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:13.135406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558c01-1f1d-4553-ab7b-bce730146e98 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:13.135881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558c01-1f1d-4553-ab7b-bce730146e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:13.182695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-bd558c01-1f1d-4553-ab7b-bce730146e98 None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:13.187811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-bd558c01-1f1d-4553-ab7b-bce730146e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:13.425557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 947/1897] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:13.475881 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bce3d7-d05a-464a-86bf-8ef352368ce2 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:13.478333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-83bce3d7-d05a-464a-86bf-8ef352368ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:13.520791 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bce3d7-d05a-464a-86bf-8ef352368ce2 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:13.521296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aefb2b-1077-487a-9ce3-9693d437b48d None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:13.521812 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aefb2b-1077-487a-9ce3-9693d437b48d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:13.522117 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aefb2b-1077-487a-9ce3-9693d437b48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:13.538554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d596f3f-7dc3-4daa-866e-53bec7fa92c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:13.539190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d596f3f-7dc3-4daa-866e-53bec7fa92c0 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:13.539474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d596f3f-7dc3-4daa-866e-53bec7fa92c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:13.539748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d596f3f-7dc3-4daa-866e-53bec7fa92c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:13.563845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d596f3f-7dc3-4daa-866e-53bec7fa92c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:13.571526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d596f3f-7dc3-4daa-866e-53bec7fa92c0 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:13.597140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 951/1898] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:13.612597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-76aefb2b-1077-487a-9ce3-9693d437b48d None None] MFA Rules not processed for user `7ab1490f0f51486faab10cb1794620f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:13.616526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-76aefb2b-1077-487a-9ce3-9693d437b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:13.754121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d596f3f-7dc3-4daa-866e-53bec7fa92c0 service nova] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:13.824950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 948/1899] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:13.826823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f9fc5-f66d-4e2e-b2ae-083408c164d8 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:13.827121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f9fc5-f66d-4e2e-b2ae-083408c164d8 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:13.827403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f9fc5-f66d-4e2e-b2ae-083408c164d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:13.904208 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b90f9fc5-f66d-4e2e-b2ae-083408c164d8 None None] MFA Rules not processed for user `91b99005247f4d1c975676c93e18bbad`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:13.905796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b90f9fc5-f66d-4e2e-b2ae-083408c164d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:13.949542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d596f3f-7dc3-4daa-866e-53bec7fa92c0 service nova] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:13.963481 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4f2c5-1bb1-438c-bf2b-63f0c5812a95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:13.964150 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4f2c5-1bb1-438c-bf2b-63f0c5812a95 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:13.964518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4f2c5-1bb1-438c-bf2b-63f0c5812a95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:13.965152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4f2c5-1bb1-438c-bf2b-63f0c5812a95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:13.969194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b0d4f2c5-1bb1-438c-bf2b-63f0c5812a95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:13.993507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:14.035131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:14.045493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 949/1900] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:14.069885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4f2c5-1bb1-438c-bf2b-63f0c5812a95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:14.072122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4f2c5-1bb1-438c-bf2b-63f0c5812a95 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:14.083741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 952/1901] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:14.312148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f9fc5-f66d-4e2e-b2ae-083408c164d8 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:14.315454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b90f9fc5-f66d-4e2e-b2ae-083408c164d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:14.354026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f9fc5-f66d-4e2e-b2ae-083408c164d8 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:14.360467 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f348d09-b003-4a51-9621-03d483a277dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:14.361332 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348d09-b003-4a51-9621-03d483a277dc service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:14.361634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348d09-b003-4a51-9621-03d483a277dc service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:14.361895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f348d09-b003-4a51-9621-03d483a277dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:14.386047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f348d09-b003-4a51-9621-03d483a277dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:14.388953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f348d09-b003-4a51-9621-03d483a277dc service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:14.412430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 950/1902] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:15.197916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4f2c5-1bb1-438c-bf2b-63f0c5812a95 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:15.275457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4f2c5-1bb1-438c-bf2b-63f0c5812a95 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:15.292102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:15.293500 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:15.293968 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:15.294190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] PATH_INFO: `/v3/users/040972cfbc98402a921d7057620d4079` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:15.295900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=040972cfbc98402a921d7057620d4079)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:15.298360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:15.381469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040972cfbc98402a921d7057620d4079'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:15.391885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040972cfbc98402a921d7057620d4079'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:15.422650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040972cfbc98402a921d7057620d4079'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:15.423462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040972cfbc98402a921d7057620d4079'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:15.424052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040972cfbc98402a921d7057620d4079'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:15.476534 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 953/1903] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:15 2022] DELETE /identity/v3/users/040972cfbc98402a921d7057620d4079 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:15.481259 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31e7bb-26c2-476c-947f-3f673b14e366 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:15.481779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31e7bb-26c2-476c-947f-3f673b14e366 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:15.482092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31e7bb-26c2-476c-947f-3f673b14e366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:15.543052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-8f31e7bb-26c2-476c-947f-3f673b14e366 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:15.545418 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8f31e7bb-26c2-476c-947f-3f673b14e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:15.659993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 951/1904] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:15.670496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:15.673010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:15.749157 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e438c2-8104-4c6a-a81f-6c57ba6082f3 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:15.753770 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe84c0-7252-4d47-8a0d-fea473045d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:15.754526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe84c0-7252-4d47-8a0d-fea473045d71 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:15.754823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe84c0-7252-4d47-8a0d-fea473045d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:15.755098 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe84c0-7252-4d47-8a0d-fea473045d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:15.768459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe84c0-7252-4d47-8a0d-fea473045d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:15.770666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe84c0-7252-4d47-8a0d-fea473045d71 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:15.778188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:15.795097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 954/1905] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:16.104849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31e7bb-26c2-476c-947f-3f673b14e366 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:16.107931 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8f31e7bb-26c2-476c-947f-3f673b14e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:16.136486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31e7bb-26c2-476c-947f-3f673b14e366 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:16.141837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:16.142476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:16.142905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:16.143184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] PATH_INFO: `/v3/projects/27a527b690ce4453b5e1e8250602bbe8` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:16.144310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a527b690ce4453b5e1e8250602bbe8)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:16.146495 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:16.197914 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a527b690ce4453b5e1e8250602bbe8', 'request_id': 'req-b879ed38-3c9e-4bf3-b388-2425e91aae52'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:16.205687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a527b690ce4453b5e1e8250602bbe8', 'request_id': 'req-b879ed38-3c9e-4bf3-b388-2425e91aae52'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:16.215764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a527b690ce4453b5e1e8250602bbe8', 'request_id': 'req-b879ed38-3c9e-4bf3-b388-2425e91aae52'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:16.233514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] The token cache is being invalidate because project 27a527b690ce4453b5e1e8250602bbe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:16.233802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:16.234977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:16.236459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 952/1906] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:16 2022] DELETE /identity/v3/projects/27a527b690ce4453b5e1e8250602bbe8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:16.240491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe84c0-7252-4d47-8a0d-fea473045d71 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:16.250115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe84c0-7252-4d47-8a0d-fea473045d71 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:16.313236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:16.313893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:16.314176 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:16.314630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] PATH_INFO: `/v3/users/e5ba6c9efaa8467ab0592f209f3c385b` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:16.315789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ba6c9efaa8467ab0592f209f3c385b)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:16.322723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:16.372474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ba6c9efaa8467ab0592f209f3c385b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:16.381882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ba6c9efaa8467ab0592f209f3c385b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:16.395544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ba6c9efaa8467ab0592f209f3c385b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:16.397249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ba6c9efaa8467ab0592f209f3c385b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:16.397870 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ba6c9efaa8467ab0592f209f3c385b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:16.415192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 955/1907] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:16 2022] DELETE /identity/v3/users/e5ba6c9efaa8467ab0592f209f3c385b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:16.909414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:16.910806 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:16.925349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879ed38-3c9e-4bf3-b388-2425e91aae52 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:16.953798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:16.955231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:17.027646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:17.041658 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:17.042337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.042880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.043391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] PATH_INFO: `/v3/projects/8868a4f3ee0545a0914c2e9d3fdb8eec` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.044853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8868a4f3ee0545a0914c2e9d3fdb8eec)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:17.046941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:17.047410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f071b08-49f9-43ff-85b7-3bc9b21c2444 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:17.053012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3349c-65b5-437e-888f-8839a75ae245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:17.053736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3349c-65b5-437e-888f-8839a75ae245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.054639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3349c-65b5-437e-888f-8839a75ae245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.054950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3349c-65b5-437e-888f-8839a75ae245 admin admin] PATH_INFO: `/v3/users/c32c499c160045769366ab200836c53a` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.056557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3349c-65b5-437e-888f-8839a75ae245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32c499c160045769366ab200836c53a)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:17.058882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3349c-65b5-437e-888f-8839a75ae245 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:17.090143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:17.101308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8868a4f3ee0545a0914c2e9d3fdb8eec', 'request_id': 'req-46a1fe19-2d6a-4991-a45b-5be0db534142'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:17.109051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8868a4f3ee0545a0914c2e9d3fdb8eec', 'request_id': 'req-46a1fe19-2d6a-4991-a45b-5be0db534142'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:17.115947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-39a3349c-65b5-437e-888f-8839a75ae245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32c499c160045769366ab200836c53a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:17.116617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8868a4f3ee0545a0914c2e9d3fdb8eec', 'request_id': 'req-46a1fe19-2d6a-4991-a45b-5be0db534142'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:17.123808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-39a3349c-65b5-437e-888f-8839a75ae245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32c499c160045769366ab200836c53a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:17.128492 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] The token cache is being invalidate because project 8868a4f3ee0545a0914c2e9d3fdb8eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:17.128829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:17.129469 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:17.131616 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 953/1908] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:16 2022] DELETE /identity/v3/projects/8868a4f3ee0545a0914c2e9d3fdb8eec => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:17.132424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:17.133776 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:17.147170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-39a3349c-65b5-437e-888f-8839a75ae245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32c499c160045769366ab200836c53a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:17.148001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-39a3349c-65b5-437e-888f-8839a75ae245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32c499c160045769366ab200836c53a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:17.149605 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-39a3349c-65b5-437e-888f-8839a75ae245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32c499c160045769366ab200836c53a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:17.167596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 956/1909] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:16 2022] DELETE /identity/v3/users/c32c499c160045769366ab200836c53a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:17.169416 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05379930-523c-47e2-acd6-0a5ed3789e28 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.170381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05379930-523c-47e2-acd6-0a5ed3789e28 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.170869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05379930-523c-47e2-acd6-0a5ed3789e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.196529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-05379930-523c-47e2-acd6-0a5ed3789e28 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:17.198159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-05379930-523c-47e2-acd6-0a5ed3789e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:17.239479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1fe19-2d6a-4991-a45b-5be0db534142 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:17.323535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 957/1910] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:17.326173 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea08628-28b8-4995-b058-bfc50b08055f None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.326678 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea08628-28b8-4995-b058-bfc50b08055f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.327161 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea08628-28b8-4995-b058-bfc50b08055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.328862 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca85956-a723-4bc5-be70-f4c84bd83abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:17.330308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca85956-a723-4bc5-be70-f4c84bd83abf service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.330606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca85956-a723-4bc5-be70-f4c84bd83abf service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.330973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca85956-a723-4bc5-be70-f4c84bd83abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.332995 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2ca85956-a723-4bc5-be70-f4c84bd83abf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:17.352913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-5ea08628-28b8-4995-b058-bfc50b08055f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:17.354758 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-5ea08628-28b8-4995-b058-bfc50b08055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:17.374110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 958/1911] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:17.376217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc7fa1-f67b-4123-8205-2e30ba423d27 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.377419 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc7fa1-f67b-4123-8205-2e30ba423d27 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.380662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc7fa1-f67b-4123-8205-2e30ba423d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.418804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-aadc7fa1-f67b-4123-8205-2e30ba423d27 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:17.419761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-aadc7fa1-f67b-4123-8205-2e30ba423d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:17.430131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 959/1912] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:17.434151 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc7fa1-f67b-4123-8205-2e30ba423d27 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:17.445023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc7fa1-f67b-4123-8205-2e30ba423d27 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:17.454973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:17.455390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1cef2-ddef-436b-89d3-6b0e8417a936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:17.457372 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1cef2-ddef-436b-89d3-6b0e8417a936 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.458004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1cef2-ddef-436b-89d3-6b0e8417a936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.459522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1cef2-ddef-436b-89d3-6b0e8417a936 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.461565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1cef2-ddef-436b-89d3-6b0e8417a936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:17.465690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1cef2-ddef-436b-89d3-6b0e8417a936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:17.468122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1cef2-ddef-436b-89d3-6b0e8417a936 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:17.478295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca85956-a723-4bc5-be70-f4c84bd83abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:17.479910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca85956-a723-4bc5-be70-f4c84bd83abf service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:17.495415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 960/1913] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:11:17.496867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1cef2-ddef-436b-89d3-6b0e8417a936 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:17.499007 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b3a1cef2-ddef-436b-89d3-6b0e8417a936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:17.523469 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 954/1914] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:17.526205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca85956-a723-4bc5-be70-f4c84bd83abf service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:17.546117 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca85956-a723-4bc5-be70-f4c84bd83abf service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:17.554975 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe81d1-ee74-45e2-8be6-34a7f801bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:17.555676 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe81d1-ee74-45e2-8be6-34a7f801bd31 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.555966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe81d1-ee74-45e2-8be6-34a7f801bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.556246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe81d1-ee74-45e2-8be6-34a7f801bd31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.556958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe81d1-ee74-45e2-8be6-34a7f801bd31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:17.559214 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe81d1-ee74-45e2-8be6-34a7f801bd31 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:17.623303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 955/1915] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:17 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:17.627353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe81d1-ee74-45e2-8be6-34a7f801bd31 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:17.639386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1cef2-ddef-436b-89d3-6b0e8417a936 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:17.678359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:17.706925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe81d1-ee74-45e2-8be6-34a7f801bd31 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:17.707778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef9d2f-4cbd-4475-8ffb-24f7299f8609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:17.708393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef9d2f-4cbd-4475-8ffb-24f7299f8609 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.709316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef9d2f-4cbd-4475-8ffb-24f7299f8609 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.709890 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef9d2f-4cbd-4475-8ffb-24f7299f8609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.714731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2144e-8805-4bdc-97e3-2360e4a8320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:17.715482 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2144e-8805-4bdc-97e3-2360e4a8320e admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.715834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2144e-8805-4bdc-97e3-2360e4a8320e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.716110 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2144e-8805-4bdc-97e3-2360e4a8320e admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.716824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2144e-8805-4bdc-97e3-2360e4a8320e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:17.719009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2144e-8805-4bdc-97e3-2360e4a8320e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:17.720736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef9d2f-4cbd-4475-8ffb-24f7299f8609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:17.722208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef9d2f-4cbd-4475-8ffb-24f7299f8609 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:17.733275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 961/1916] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:17.742451 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 956/1917] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:17 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:17.746789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef9d2f-4cbd-4475-8ffb-24f7299f8609 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:17.758597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef9d2f-4cbd-4475-8ffb-24f7299f8609 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:17.763550 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeff71-df77-4d32-8b11-738ac6fd750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:17.764236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeff71-df77-4d32-8b11-738ac6fd750f admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.764646 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeff71-df77-4d32-8b11-738ac6fd750f admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.764998 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeff71-df77-4d32-8b11-738ac6fd750f admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.765714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aeff71-df77-4d32-8b11-738ac6fd750f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:17.767436 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aeff71-df77-4d32-8b11-738ac6fd750f admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:17.782830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 962/1918] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:17.784800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2144e-8805-4bdc-97e3-2360e4a8320e admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:17.795644 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2144e-8805-4bdc-97e3-2360e4a8320e admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:17.800860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559b1bf-7e36-45e4-9f1e-27748cee6ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:17.801657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559b1bf-7e36-45e4-9f1e-27748cee6ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.802133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559b1bf-7e36-45e4-9f1e-27748cee6ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.802481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559b1bf-7e36-45e4-9f1e-27748cee6ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.803962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559b1bf-7e36-45e4-9f1e-27748cee6ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:17.805739 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559b1bf-7e36-45e4-9f1e-27748cee6ec1 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:17.818929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 957/1919] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:17.823141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeff71-df77-4d32-8b11-738ac6fd750f admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:17.837267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeff71-df77-4d32-8b11-738ac6fd750f admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:17.843634 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd866c9-3bde-438c-9212-cde5d0e1bcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:17.845667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd866c9-3bde-438c-9212-cde5d0e1bcad admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.846437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd866c9-3bde-438c-9212-cde5d0e1bcad admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.846437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd866c9-3bde-438c-9212-cde5d0e1bcad admin admin] PATH_INFO: `/v3/projects/a510772f655c4fdd8261a54819309764/users/8a1d84ee60d0499bb6d579ad3b2c49b9/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:17.912281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd866c9-3bde-438c-9212-cde5d0e1bcad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a510772f655c4fdd8261a54819309764, user_id=8a1d84ee60d0499bb6d579ad3b2c49b9, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:17.916335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd866c9-3bde-438c-9212-cde5d0e1bcad admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:17.941807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 963/1920] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:17 2022] PUT /identity/v3/projects/a510772f655c4fdd8261a54819309764/users/8a1d84ee60d0499bb6d579ad3b2c49b9/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:17.952533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9264d-bedf-4506-a7f3-4e2280ddd965 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:17.953142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9264d-bedf-4506-a7f3-4e2280ddd965 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:17.953476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9264d-bedf-4506-a7f3-4e2280ddd965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:18.035921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-4fc9264d-bedf-4506-a7f3-4e2280ddd965 None None] MFA Rules not processed for user `8a1d84ee60d0499bb6d579ad3b2c49b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:18.038574 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4fc9264d-bedf-4506-a7f3-4e2280ddd965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:18.054623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd866c9-3bde-438c-9212-cde5d0e1bcad admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:18.183299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 958/1921] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:18.189025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9264d-bedf-4506-a7f3-4e2280ddd965 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:18.190337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd866c9-3bde-438c-9212-cde5d0e1bcad admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:18.202751 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d07353-3179-478e-a877-2ca2948586d3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7454d5eb50c24907b7857a0894082c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09590777959f49d098b9c15eaff40307', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:18.203532 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d07353-3179-478e-a877-2ca2948586d3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:18.203925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d07353-3179-478e-a877-2ca2948586d3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:18.204309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d07353-3179-478e-a877-2ca2948586d3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:18.205209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d07353-3179-478e-a877-2ca2948586d3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:18.205622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d07353-3179-478e-a877-2ca2948586d3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:18.207353 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d07353-3179-478e-a877-2ca2948586d3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:18.224728 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 964/1922] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:11:18.242533 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d07353-3179-478e-a877-2ca2948586d3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:18.247838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d07353-3179-478e-a877-2ca2948586d3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:18.253028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc713d-489c-48ab-90af-dc49cb505ea3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7454d5eb50c24907b7857a0894082c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09590777959f49d098b9c15eaff40307', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:18.253772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc713d-489c-48ab-90af-dc49cb505ea3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:18.254341 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc713d-489c-48ab-90af-dc49cb505ea3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:18.254712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc713d-489c-48ab-90af-dc49cb505ea3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:18.256528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc713d-489c-48ab-90af-dc49cb505ea3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:18.258388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc713d-489c-48ab-90af-dc49cb505ea3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:18.276304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:18.304727 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 965/1923] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:18 2022] POST /identity/v3/projects => generated 355 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:18.308401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc713d-489c-48ab-90af-dc49cb505ea3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:18.312183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9264d-bedf-4506-a7f3-4e2280ddd965 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:18.430468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc00d2-921e-41ea-819c-5ddbd5549699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:18.431087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc00d2-921e-41ea-819c-5ddbd5549699 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:18.431364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc00d2-921e-41ea-819c-5ddbd5549699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:18.431635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc00d2-921e-41ea-819c-5ddbd5549699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:18.432273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc00d2-921e-41ea-819c-5ddbd5549699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:18.434216 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc00d2-921e-41ea-819c-5ddbd5549699 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:18.439886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc713d-489c-48ab-90af-dc49cb505ea3 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:18.447282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444cc77-626a-4ac6-b8c3-32ba9126866d tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7454d5eb50c24907b7857a0894082c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09590777959f49d098b9c15eaff40307', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:18.448094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444cc77-626a-4ac6-b8c3-32ba9126866d tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:18.448514 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444cc77-626a-4ac6-b8c3-32ba9126866d tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:18.449005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444cc77-626a-4ac6-b8c3-32ba9126866d tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:18.449697 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444cc77-626a-4ac6-b8c3-32ba9126866d tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:18.450011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444cc77-626a-4ac6-b8c3-32ba9126866d tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:18.451628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444cc77-626a-4ac6-b8c3-32ba9126866d tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:18.468960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 966/1924] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:11:18.472298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 959/1925] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:18 2022] POST /identity/v3/projects => generated 377 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:18.473384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444cc77-626a-4ac6-b8c3-32ba9126866d tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:18.473504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc00d2-921e-41ea-819c-5ddbd5549699 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:18.476162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f444cc77-626a-4ac6-b8c3-32ba9126866d tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:18.486900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:18.495740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444cc77-626a-4ac6-b8c3-32ba9126866d tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:18.574915 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc00d2-921e-41ea-819c-5ddbd5549699 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:18.580876 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:18.581115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90269109-f1d1-4d92-9ebc-f24901364ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:18.581662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:18.581806 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90269109-f1d1-4d92-9ebc-f24901364ddd admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:18.582009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90269109-f1d1-4d92-9ebc-f24901364ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:18.582154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:18.582254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90269109-f1d1-4d92-9ebc-f24901364ddd admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:18.582907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90269109-f1d1-4d92-9ebc-f24901364ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:18.585675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90269109-f1d1-4d92-9ebc-f24901364ddd admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:18.589330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] PATH_INFO: `/v3/projects/e964153032fc4c1e85d1497d9aff0ade` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:18.591975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e964153032fc4c1e85d1497d9aff0ade)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:18.596399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:18.626140 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 960/1926] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:18 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:18.626140 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90269109-f1d1-4d92-9ebc-f24901364ddd admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:18.680355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e964153032fc4c1e85d1497d9aff0ade', 'request_id': 'req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:18.690849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e964153032fc4c1e85d1497d9aff0ade', 'request_id': 'req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:18.712340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e964153032fc4c1e85d1497d9aff0ade', 'request_id': 'req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:18.728623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] The token cache is being invalidate because project e964153032fc4c1e85d1497d9aff0ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:18.729542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:18.730659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:18.732440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 967/1927] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:18 2022] DELETE /identity/v3/projects/e964153032fc4c1e85d1497d9aff0ade => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:18.733621 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:18.735216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:18.737837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:18.745235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90269109-f1d1-4d92-9ebc-f24901364ddd admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:18.846141 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7454d5eb50c24907b7857a0894082c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09590777959f49d098b9c15eaff40307', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:18.846857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:18.847291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:18.847582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] PATH_INFO: `/v3/projects/66b017f95796498192810b075bf4aee3` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:18.848949 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: Authorizing `identity:delete_project(project_id=66b017f95796498192810b075bf4aee3)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:18.851808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:18.894008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30b767-c6a4-4bcd-9b23-a65f0619dc64 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:18.902125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a10148-6f82-46de-a75b-ddfbeaab5a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:18.902951 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a10148-6f82-46de-a75b-ddfbeaab5a89 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:18.904185 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a10148-6f82-46de-a75b-ddfbeaab5a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:18.904478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a10148-6f82-46de-a75b-ddfbeaab5a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:18.905365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a10148-6f82-46de-a75b-ddfbeaab5a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:18.907544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a10148-6f82-46de-a75b-ddfbeaab5a89 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:18.923634 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 968/1928] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:18.923634 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a10148-6f82-46de-a75b-ddfbeaab5a89 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:18.930179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f6a10148-6f82-46de-a75b-ddfbeaab5a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:18.951125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a10148-6f82-46de-a75b-ddfbeaab5a89 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:18.956939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b017f95796498192810b075bf4aee3', 'request_id': 'req-7f03db4c-d257-444d-ba11-7e805606ae56'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:18.966236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b017f95796498192810b075bf4aee3', 'request_id': 'req-7f03db4c-d257-444d-ba11-7e805606ae56'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:18.971905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b017f95796498192810b075bf4aee3', 'request_id': 'req-7f03db4c-d257-444d-ba11-7e805606ae56'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:18.981481 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:18.984802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] The token cache is being invalidate because project 66b017f95796498192810b075bf4aee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:18.985100 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:18.986052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:18.987410 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 961/1929] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:18 2022] DELETE /identity/v3/projects/66b017f95796498192810b075bf4aee3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:18.988255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:18.999034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:19.047493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53041ee2-4e88-41b6-b88e-194f64886659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:19.047712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53041ee2-4e88-41b6-b88e-194f64886659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:19.048125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53041ee2-4e88-41b6-b88e-194f64886659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:19.048423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53041ee2-4e88-41b6-b88e-194f64886659 admin admin] PATH_INFO: `/v3/users/03cff49f354749bb8fac9eb104af2a60` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:19.050514 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53041ee2-4e88-41b6-b88e-194f64886659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03cff49f354749bb8fac9eb104af2a60)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:19.054879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53041ee2-4e88-41b6-b88e-194f64886659 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:19.189402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-53041ee2-4e88-41b6-b88e-194f64886659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03cff49f354749bb8fac9eb104af2a60'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:19.210016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03db4c-d257-444d-ba11-7e805606ae56 tempest-VolumeQuotaClassesTest-1750937920 tempest-VolumeQuotaClassesTest-1750937920-project-admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:19.228226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20115d8-3d55-4f47-a2c7-ab2b5e23e254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:19.230837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20115d8-3d55-4f47-a2c7-ab2b5e23e254 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:19.231619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20115d8-3d55-4f47-a2c7-ab2b5e23e254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:19.236041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20115d8-3d55-4f47-a2c7-ab2b5e23e254 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:19.239396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20115d8-3d55-4f47-a2c7-ab2b5e23e254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:19.244759 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-53041ee2-4e88-41b6-b88e-194f64886659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03cff49f354749bb8fac9eb104af2a60'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:19.245557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20115d8-3d55-4f47-a2c7-ab2b5e23e254 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:19.274894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 962/1930] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:19.276992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20115d8-3d55-4f47-a2c7-ab2b5e23e254 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:19.306398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20115d8-3d55-4f47-a2c7-ab2b5e23e254 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:19.312763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-53041ee2-4e88-41b6-b88e-194f64886659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03cff49f354749bb8fac9eb104af2a60'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:19.314518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-53041ee2-4e88-41b6-b88e-194f64886659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03cff49f354749bb8fac9eb104af2a60'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:19.322517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-53041ee2-4e88-41b6-b88e-194f64886659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03cff49f354749bb8fac9eb104af2a60'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:19.323803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7ba6a-28fb-4fa2-93c3-ae21f7d44db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:19.326547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7ba6a-28fb-4fa2-93c3-ae21f7d44db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:19.326943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7ba6a-28fb-4fa2-93c3-ae21f7d44db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:19.339016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7ba6a-28fb-4fa2-93c3-ae21f7d44db5 admin admin] PATH_INFO: `/v3/projects/c57ca7ead0a14a47a2f53ff96490af2b/users/aba266f57fb54f3c91741e480c5f2b2a/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:19.375519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 969/1931] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:18 2022] DELETE /identity/v3/users/03cff49f354749bb8fac9eb104af2a60 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:19.398452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7ba6a-28fb-4fa2-93c3-ae21f7d44db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57ca7ead0a14a47a2f53ff96490af2b, user_id=aba266f57fb54f3c91741e480c5f2b2a, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:19.411383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7ba6a-28fb-4fa2-93c3-ae21f7d44db5 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:19.463672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53eccd-17c8-4ae4-9083-e612c327faa3 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:19.464224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53eccd-17c8-4ae4-9083-e612c327faa3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:19.464224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53eccd-17c8-4ae4-9083-e612c327faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:19.467386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 963/1932] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:19 2022] PUT /identity/v3/projects/c57ca7ead0a14a47a2f53ff96490af2b/users/aba266f57fb54f3c91741e480c5f2b2a/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:19.547681 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-6f53eccd-17c8-4ae4-9083-e612c327faa3 None None] MFA Rules not processed for user `aba266f57fb54f3c91741e480c5f2b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:19.549172 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6f53eccd-17c8-4ae4-9083-e612c327faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:19.658782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7ba6a-28fb-4fa2-93c3-ae21f7d44db5 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:19.660935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1ef7ba6a-28fb-4fa2-93c3-ae21f7d44db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:19.679806 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:19.762082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 970/1933] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:19.763655 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53eccd-17c8-4ae4-9083-e612c327faa3 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:19.765206 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6f53eccd-17c8-4ae4-9083-e612c327faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:19.774011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7ba6a-28fb-4fa2-93c3-ae21f7d44db5 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:19.779847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de406c42-1224-4cc8-8231-94a20401d0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:19.780502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de406c42-1224-4cc8-8231-94a20401d0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:19.780820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de406c42-1224-4cc8-8231-94a20401d0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:19.781100 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de406c42-1224-4cc8-8231-94a20401d0c0 admin admin] PATH_INFO: `/v3/users/cd04de1249f04dbb872852cbbc6a2679` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:19.782706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de406c42-1224-4cc8-8231-94a20401d0c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd04de1249f04dbb872852cbbc6a2679)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:19.784764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de406c42-1224-4cc8-8231-94a20401d0c0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:19.790404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53eccd-17c8-4ae4-9083-e612c327faa3 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:19.796771 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea486137-5fe1-427f-85a3-acb8d8145213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:19.797670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea486137-5fe1-427f-85a3-acb8d8145213 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:19.798223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea486137-5fe1-427f-85a3-acb8d8145213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:19.798539 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea486137-5fe1-427f-85a3-acb8d8145213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:19.799251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea486137-5fe1-427f-85a3-acb8d8145213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:19.801395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea486137-5fe1-427f-85a3-acb8d8145213 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:19.858049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 971/1934] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:19 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:19.862593 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-de406c42-1224-4cc8-8231-94a20401d0c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd04de1249f04dbb872852cbbc6a2679'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:19.868809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea486137-5fe1-427f-85a3-acb8d8145213 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:19.877103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-de406c42-1224-4cc8-8231-94a20401d0c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd04de1249f04dbb872852cbbc6a2679'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:19.878354 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-de406c42-1224-4cc8-8231-94a20401d0c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd04de1249f04dbb872852cbbc6a2679'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:19.879857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-de406c42-1224-4cc8-8231-94a20401d0c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd04de1249f04dbb872852cbbc6a2679'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:19.905895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:19.915615 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-de406c42-1224-4cc8-8231-94a20401d0c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd04de1249f04dbb872852cbbc6a2679'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:19.938061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 964/1935] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:19 2022] DELETE /identity/v3/users/cd04de1249f04dbb872852cbbc6a2679 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:19.943353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87776b-43f6-4555-8c36-ad6d938cd681 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:19.943749 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87776b-43f6-4555-8c36-ad6d938cd681 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:19.944377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87776b-43f6-4555-8c36-ad6d938cd681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:19.973373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-fa87776b-43f6-4555-8c36-ad6d938cd681 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:19.975170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-fa87776b-43f6-4555-8c36-ad6d938cd681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:20.030078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea486137-5fe1-427f-85a3-acb8d8145213 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:20.064501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 965/1936] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:20.085830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87776b-43f6-4555-8c36-ad6d938cd681 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:20.087711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-fa87776b-43f6-4555-8c36-ad6d938cd681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:20.148240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc516e-2821-40ae-9453-2d3712e202f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:20.149503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc516e-2821-40ae-9453-2d3712e202f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:20.149503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc516e-2821-40ae-9453-2d3712e202f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:20.149503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc516e-2821-40ae-9453-2d3712e202f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:20.149777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc516e-2821-40ae-9453-2d3712e202f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:20.151674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc516e-2821-40ae-9453-2d3712e202f3 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:20.203583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:20.204104 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 972/1937] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:19 2022] POST /identity/v3/users => generated 295 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:20.205301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc516e-2821-40ae-9453-2d3712e202f3 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:20.210708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c5cc516e-2821-40ae-9453-2d3712e202f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:20.238272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc516e-2821-40ae-9453-2d3712e202f3 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:20.249906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0515f22-8ac1-46fa-b1f4-d68a10d19d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:20.251266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0515f22-8ac1-46fa-b1f4-d68a10d19d98 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:20.251684 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0515f22-8ac1-46fa-b1f4-d68a10d19d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:20.252100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0515f22-8ac1-46fa-b1f4-d68a10d19d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:20.252838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0515f22-8ac1-46fa-b1f4-d68a10d19d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:20.254507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0515f22-8ac1-46fa-b1f4-d68a10d19d98 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:20.272836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 973/1938] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:20.273170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87776b-43f6-4555-8c36-ad6d938cd681 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:20.274761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0515f22-8ac1-46fa-b1f4-d68a10d19d98 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:20.282366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e4ee0-7f7b-4d15-9042-b051bb38bdad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:20.284392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e4ee0-7f7b-4d15-9042-b051bb38bdad service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:20.285523 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e4ee0-7f7b-4d15-9042-b051bb38bdad service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:20.298661 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e4ee0-7f7b-4d15-9042-b051bb38bdad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:20.317092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0515f22-8ac1-46fa-b1f4-d68a10d19d98 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:20.329087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a6865-727e-4975-99e2-9639f6ae5719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:20.330101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e4ee0-7f7b-4d15-9042-b051bb38bdad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:20.331733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a6865-727e-4975-99e2-9639f6ae5719 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:20.332116 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a6865-727e-4975-99e2-9639f6ae5719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:20.332397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a6865-727e-4975-99e2-9639f6ae5719 admin admin] PATH_INFO: `/v3/projects/eee6f000f6b04b80bc0ae1268a86c0a6/users/82d4f078f6aa41dd9aae37a4432df353/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:20.334646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e4ee0-7f7b-4d15-9042-b051bb38bdad service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:20.351233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a6865-727e-4975-99e2-9639f6ae5719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee6f000f6b04b80bc0ae1268a86c0a6, user_id=82d4f078f6aa41dd9aae37a4432df353, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:20.352805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 966/1939] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:20.354265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a6865-727e-4975-99e2-9639f6ae5719 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:20.378311 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 974/1940] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:20 2022] PUT /identity/v3/projects/eee6f000f6b04b80bc0ae1268a86c0a6/users/82d4f078f6aa41dd9aae37a4432df353/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:20.383892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e4ee0-7f7b-4d15-9042-b051bb38bdad service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:20.422269 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e4ee0-7f7b-4d15-9042-b051bb38bdad service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:20.507561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a6865-727e-4975-99e2-9639f6ae5719 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:20.517534 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e04a6865-727e-4975-99e2-9639f6ae5719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:20.581447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcb69e-ddb8-48ab-83b6-3f3feae47dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:20.584941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcb69e-ddb8-48ab-83b6-3f3feae47dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:20.585821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcb69e-ddb8-48ab-83b6-3f3feae47dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:20.586867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcb69e-ddb8-48ab-83b6-3f3feae47dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:20.590157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcb69e-ddb8-48ab-83b6-3f3feae47dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:20.595869 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcb69e-ddb8-48ab-83b6-3f3feae47dc8 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:20.621784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 967/1941] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:20.626260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcb69e-ddb8-48ab-83b6-3f3feae47dc8 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:20.640460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcb69e-ddb8-48ab-83b6-3f3feae47dc8 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:20.645437 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f95f3a-ec7e-4e46-b76a-d68f80e412a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:20.646085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f95f3a-ec7e-4e46-b76a-d68f80e412a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:20.646580 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f95f3a-ec7e-4e46-b76a-d68f80e412a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:20.646863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f95f3a-ec7e-4e46-b76a-d68f80e412a6 admin admin] PATH_INFO: `/v3/projects/eee6f000f6b04b80bc0ae1268a86c0a6/users/82d4f078f6aa41dd9aae37a4432df353/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:20.649228 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f95f3a-ec7e-4e46-b76a-d68f80e412a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee6f000f6b04b80bc0ae1268a86c0a6, user_id=82d4f078f6aa41dd9aae37a4432df353, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:20.651280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a6865-727e-4975-99e2-9639f6ae5719 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:20.652031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f95f3a-ec7e-4e46-b76a-d68f80e412a6 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:20.667015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 968/1942] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:20 2022] PUT /identity/v3/projects/eee6f000f6b04b80bc0ae1268a86c0a6/users/82d4f078f6aa41dd9aae37a4432df353/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:20.667228 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:20.668142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:20.668710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:20.669201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] PATH_INFO: `/v3/projects/a71a39ebea094e10b1c05cd3e33c9ce7` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:20.675423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71a39ebea094e10b1c05cd3e33c9ce7)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:20.678556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e45cd0-9f4a-429f-b546-bd17889c92c6 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:20.678556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e45cd0-9f4a-429f-b546-bd17889c92c6 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:20.678795 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e45cd0-9f4a-429f-b546-bd17889c92c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:20.684557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:20.714370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-e3e45cd0-9f4a-429f-b546-bd17889c92c6 None None] MFA Rules not processed for user `82d4f078f6aa41dd9aae37a4432df353`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:20.715766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e3e45cd0-9f4a-429f-b546-bd17889c92c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:20.745301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:20.818023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71a39ebea094e10b1c05cd3e33c9ce7', 'request_id': 'req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:20.837356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71a39ebea094e10b1c05cd3e33c9ce7', 'request_id': 'req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:20.867989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71a39ebea094e10b1c05cd3e33c9ce7', 'request_id': 'req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:20.894259 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 969/1943] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:20.901722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e45cd0-9f4a-429f-b546-bd17889c92c6 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:20.904206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e3e45cd0-9f4a-429f-b546-bd17889c92c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:20.920928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] The token cache is being invalidate because project a71a39ebea094e10b1c05cd3e33c9ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:20.921278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:20.921990 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:20.923754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 975/1944] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:20 2022] DELETE /identity/v3/projects/a71a39ebea094e10b1c05cd3e33c9ce7 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:20.928500 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:20.929879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:21.036710 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:21.072325 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e45cd0-9f4a-429f-b546-bd17889c92c6 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:21.146530 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfafc77-b7c9-42b8-8ffb-a57c7f1a5eb8 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:21.159396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:21.160826 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:21.161162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:21.164089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] PATH_INFO: `/v3/users/c068b1d3edb8408d83f8d53ca03b20e0` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:21.166069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c068b1d3edb8408d83f8d53ca03b20e0)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:21.168772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:21.181542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72317e5-ba22-4460-8e79-379d078b8f2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:21.182239 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72317e5-ba22-4460-8e79-379d078b8f2b service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:21.182524 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72317e5-ba22-4460-8e79-379d078b8f2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:21.182802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72317e5-ba22-4460-8e79-379d078b8f2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:21.186671 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a72317e5-ba22-4460-8e79-379d078b8f2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:21.247242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c068b1d3edb8408d83f8d53ca03b20e0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.259810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c068b1d3edb8408d83f8d53ca03b20e0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.279761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c068b1d3edb8408d83f8d53ca03b20e0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.281649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c068b1d3edb8408d83f8d53ca03b20e0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.282771 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c068b1d3edb8408d83f8d53ca03b20e0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.313166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 976/1945] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:20 2022] DELETE /identity/v3/users/c068b1d3edb8408d83f8d53ca03b20e0 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:21.314299 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:21.316772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:21.324612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72317e5-ba22-4460-8e79-379d078b8f2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:21.326694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72317e5-ba22-4460-8e79-379d078b8f2b service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:21.343808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 970/1946] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:21.365516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:21.403662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72317e5-ba22-4460-8e79-379d078b8f2b service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:21.405642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a72317e5-ba22-4460-8e79-379d078b8f2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:21.429592 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72317e5-ba22-4460-8e79-379d078b8f2b service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:21.434316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0fc7f-7dbb-4fec-ae08-8b036a613d99 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:21.440267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:21.441136 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:21.441542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:21.441914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] PATH_INFO: `/v3/projects/d76007821708489ebfb7221e66e093e0` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:21.443201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76007821708489ebfb7221e66e093e0)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:21.445352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:21.521911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e9c3-f272-4bb4-89e0-2ec4a468515e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:21.522348 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e9c3-f272-4bb4-89e0-2ec4a468515e service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:21.522871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e9c3-f272-4bb4-89e0-2ec4a468515e service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:21.523329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e9c3-f272-4bb4-89e0-2ec4a468515e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:21.526518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-52e3e9c3-f272-4bb4-89e0-2ec4a468515e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:21.540880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76007821708489ebfb7221e66e093e0', 'request_id': 'req-e67a6c30-d88d-48f2-9d63-ea4b40907df1'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.567814 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76007821708489ebfb7221e66e093e0', 'request_id': 'req-e67a6c30-d88d-48f2-9d63-ea4b40907df1'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.579065 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76007821708489ebfb7221e66e093e0', 'request_id': 'req-e67a6c30-d88d-48f2-9d63-ea4b40907df1'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.617081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] The token cache is being invalidate because project d76007821708489ebfb7221e66e093e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:21.618163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.619641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.628718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 977/1947] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:21 2022] DELETE /identity/v3/projects/d76007821708489ebfb7221e66e093e0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:21.633330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e9c3-f272-4bb4-89e0-2ec4a468515e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:21.634957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e9c3-f272-4bb4-89e0-2ec4a468515e service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:21.640729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:21.641163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:21.644932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:21.652509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 971/1948] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:21.763383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a6c30-d88d-48f2-9d63-ea4b40907df1 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:21.769290 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27d8f1-3bab-4541-9ffa-d0292c018328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:21.769982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27d8f1-3bab-4541-9ffa-d0292c018328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:21.770265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27d8f1-3bab-4541-9ffa-d0292c018328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:21.770542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27d8f1-3bab-4541-9ffa-d0292c018328 admin admin] PATH_INFO: `/v3/users/7454d5eb50c24907b7857a0894082c2c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:21.773240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27d8f1-3bab-4541-9ffa-d0292c018328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7454d5eb50c24907b7857a0894082c2c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:21.775314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27d8f1-3bab-4541-9ffa-d0292c018328 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:21.851292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3d27d8f1-3bab-4541-9ffa-d0292c018328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7454d5eb50c24907b7857a0894082c2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.863143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3d27d8f1-3bab-4541-9ffa-d0292c018328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7454d5eb50c24907b7857a0894082c2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.871242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:21.901986 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3d27d8f1-3bab-4541-9ffa-d0292c018328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7454d5eb50c24907b7857a0894082c2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.906056 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3d27d8f1-3bab-4541-9ffa-d0292c018328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7454d5eb50c24907b7857a0894082c2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.908442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3d27d8f1-3bab-4541-9ffa-d0292c018328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7454d5eb50c24907b7857a0894082c2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:21.942709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 978/1949] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:21 2022] DELETE /identity/v3/users/7454d5eb50c24907b7857a0894082c2c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:22.217059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e9c3-f272-4bb4-89e0-2ec4a468515e service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:22.230097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-52e3e9c3-f272-4bb4-89e0-2ec4a468515e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:22.285230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e9c3-f272-4bb4-89e0-2ec4a468515e service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:22.407122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4adfd9-decb-48ab-a368-8b5aae80a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:22.407977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4adfd9-decb-48ab-a368-8b5aae80a73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:22.408322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4adfd9-decb-48ab-a368-8b5aae80a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:22.408742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4adfd9-decb-48ab-a368-8b5aae80a73a admin admin] PATH_INFO: `/v3/projects/3de6d4591a4d431e9f51652395f041c3` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:22.410031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4adfd9-decb-48ab-a368-8b5aae80a73a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de6d4591a4d431e9f51652395f041c3)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:22.413817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4adfd9-decb-48ab-a368-8b5aae80a73a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:22.472180 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-8d4adfd9-decb-48ab-a368-8b5aae80a73a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de6d4591a4d431e9f51652395f041c3', 'request_id': 'req-8d4adfd9-decb-48ab-a368-8b5aae80a73a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:22.482293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-8d4adfd9-decb-48ab-a368-8b5aae80a73a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de6d4591a4d431e9f51652395f041c3', 'request_id': 'req-8d4adfd9-decb-48ab-a368-8b5aae80a73a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:22.492777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-8d4adfd9-decb-48ab-a368-8b5aae80a73a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de6d4591a4d431e9f51652395f041c3', 'request_id': 'req-8d4adfd9-decb-48ab-a368-8b5aae80a73a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:22.507317 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-8d4adfd9-decb-48ab-a368-8b5aae80a73a admin admin] The token cache is being invalidate because project 3de6d4591a4d431e9f51652395f041c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:22.507701 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-8d4adfd9-decb-48ab-a368-8b5aae80a73a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:22.508437 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-8d4adfd9-decb-48ab-a368-8b5aae80a73a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:22.510917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 972/1950] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:22 2022] DELETE /identity/v3/projects/3de6d4591a4d431e9f51652395f041c3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:22.516921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c6031-0ad4-4701-a14b-905d1df40aee None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:22.517231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c6031-0ad4-4701-a14b-905d1df40aee None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:22.517489 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c6031-0ad4-4701-a14b-905d1df40aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:22.542918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8d3c6031-0ad4-4701-a14b-905d1df40aee None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:22.544135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8d3c6031-0ad4-4701-a14b-905d1df40aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:22.617060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 979/1951] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:22.632059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20817e3-f81f-47e7-b5d9-d09f8ccc1d90 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:22.632995 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20817e3-f81f-47e7-b5d9-d09f8ccc1d90 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:22.632995 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20817e3-f81f-47e7-b5d9-d09f8ccc1d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:22.668197 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-e20817e3-f81f-47e7-b5d9-d09f8ccc1d90 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:22.670426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e20817e3-f81f-47e7-b5d9-d09f8ccc1d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:22.686743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 973/1952] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:22.693619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c6031-0ad4-4701-a14b-905d1df40aee None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:22.705435 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c6031-0ad4-4701-a14b-905d1df40aee None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:22.711398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97ad73-41df-4cd1-908a-6020746c482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:22.712181 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97ad73-41df-4cd1-908a-6020746c482f admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:22.712591 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97ad73-41df-4cd1-908a-6020746c482f admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:22.712882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97ad73-41df-4cd1-908a-6020746c482f admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:22.713606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97ad73-41df-4cd1-908a-6020746c482f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:22.714258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97ad73-41df-4cd1-908a-6020746c482f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:22.715999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97ad73-41df-4cd1-908a-6020746c482f admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:22.723283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20817e3-f81f-47e7-b5d9-d09f8ccc1d90 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:22.725192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e20817e3-f81f-47e7-b5d9-d09f8ccc1d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:22.763371 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20817e3-f81f-47e7-b5d9-d09f8ccc1d90 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:22.776217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a564bd5-4add-4f06-b6e0-31870a4d1b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:22.779093 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a564bd5-4add-4f06-b6e0-31870a4d1b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:22.780517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a564bd5-4add-4f06-b6e0-31870a4d1b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:22.781773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a564bd5-4add-4f06-b6e0-31870a4d1b95 admin admin] PATH_INFO: `/v3/projects/09590777959f49d098b9c15eaff40307` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:22.787812 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 980/1953] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:11:22.789926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97ad73-41df-4cd1-908a-6020746c482f admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:22.790438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a564bd5-4add-4f06-b6e0-31870a4d1b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09590777959f49d098b9c15eaff40307)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:22.805638 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97ad73-41df-4cd1-908a-6020746c482f admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:22.807836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a564bd5-4add-4f06-b6e0-31870a4d1b95 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:22.812333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7197eb-f852-4167-87de-377aebd8bc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:22.813240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7197eb-f852-4167-87de-377aebd8bc09 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:22.813756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7197eb-f852-4167-87de-377aebd8bc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:22.814260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7197eb-f852-4167-87de-377aebd8bc09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:22.814915 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7197eb-f852-4167-87de-377aebd8bc09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:22.818030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7197eb-f852-4167-87de-377aebd8bc09 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:22.871100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 981/1954] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:22 2022] POST /identity/v3/projects => generated 401 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:22.872894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7197eb-f852-4167-87de-377aebd8bc09 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:22.936756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5a564bd5-4add-4f06-b6e0-31870a4d1b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09590777959f49d098b9c15eaff40307', 'request_id': 'req-5a564bd5-4add-4f06-b6e0-31870a4d1b95'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:22.979348 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5a564bd5-4add-4f06-b6e0-31870a4d1b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09590777959f49d098b9c15eaff40307', 'request_id': 'req-5a564bd5-4add-4f06-b6e0-31870a4d1b95'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:23.006424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5a564bd5-4add-4f06-b6e0-31870a4d1b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09590777959f49d098b9c15eaff40307', 'request_id': 'req-5a564bd5-4add-4f06-b6e0-31870a4d1b95'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:23.031194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7197eb-f852-4167-87de-377aebd8bc09 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.037159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5a564bd5-4add-4f06-b6e0-31870a4d1b95 admin admin] The token cache is being invalidate because project 09590777959f49d098b9c15eaff40307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:23.037578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5a564bd5-4add-4f06-b6e0-31870a4d1b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:23.042343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5a564bd5-4add-4f06-b6e0-31870a4d1b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:23.045405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 974/1955] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:22 2022] DELETE /identity/v3/projects/09590777959f49d098b9c15eaff40307 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:23.050193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a444a2-0570-4f8d-81b3-d42ec6347bb7 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.050598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a444a2-0570-4f8d-81b3-d42ec6347bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.050949 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a444a2-0570-4f8d-81b3-d42ec6347bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.065925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:23.098925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-71a444a2-0570-4f8d-81b3-d42ec6347bb7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:23.100192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-71a444a2-0570-4f8d-81b3-d42ec6347bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:23.122836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:23.170032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ca868-ebd0-4493-874f-fe8f4b77b6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.170665 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ca868-ebd0-4493-874f-fe8f4b77b6bb admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.170948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ca868-ebd0-4493-874f-fe8f4b77b6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.171450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ca868-ebd0-4493-874f-fe8f4b77b6bb admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.172082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ca868-ebd0-4493-874f-fe8f4b77b6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.174602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ca868-ebd0-4493-874f-fe8f4b77b6bb admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.180476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 975/1956] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:23.189818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732cdc2-fe49-4e21-853e-2371e44731e9 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.190154 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732cdc2-fe49-4e21-853e-2371e44731e9 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.190511 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732cdc2-fe49-4e21-853e-2371e44731e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.197992 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 982/1957] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:22 2022] POST /identity/v3/users => generated 301 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:23.202057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ca868-ebd0-4493-874f-fe8f4b77b6bb admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.204276 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-025ca868-ebd0-4493-874f-fe8f4b77b6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:23.218854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ca868-ebd0-4493-874f-fe8f4b77b6bb admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.222421 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-5732cdc2-fe49-4e21-853e-2371e44731e9 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:23.225830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5732cdc2-fe49-4e21-853e-2371e44731e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:23.227124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a96788-9474-4f5a-a405-7e033d28dec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.227775 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a96788-9474-4f5a-a405-7e033d28dec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.228050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a96788-9474-4f5a-a405-7e033d28dec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.228321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a96788-9474-4f5a-a405-7e033d28dec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.229007 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a96788-9474-4f5a-a405-7e033d28dec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.230640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a96788-9474-4f5a-a405-7e033d28dec8 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.240247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 976/1958] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:23.244664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732cdc2-fe49-4e21-853e-2371e44731e9 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.255869 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732cdc2-fe49-4e21-853e-2371e44731e9 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.256640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 983/1959] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:23.258504 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a96788-9474-4f5a-a405-7e033d28dec8 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.259583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38929101-3ed9-41de-8b4c-191236639035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.260210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38929101-3ed9-41de-8b4c-191236639035 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.260646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38929101-3ed9-41de-8b4c-191236639035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.260964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38929101-3ed9-41de-8b4c-191236639035 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.261622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38929101-3ed9-41de-8b4c-191236639035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:23.262021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38929101-3ed9-41de-8b4c-191236639035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.263628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38929101-3ed9-41de-8b4c-191236639035 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.272288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a96788-9474-4f5a-a405-7e033d28dec8 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.278919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0c349-3170-43ad-9482-dd57c5713eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.279903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0c349-3170-43ad-9482-dd57c5713eda admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.280283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0c349-3170-43ad-9482-dd57c5713eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.280652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0c349-3170-43ad-9482-dd57c5713eda admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.281690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0c349-3170-43ad-9482-dd57c5713eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.283520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 977/1960] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:11:23.283982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0c349-3170-43ad-9482-dd57c5713eda admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.294502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38929101-3ed9-41de-8b4c-191236639035 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.302763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 984/1961] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:23.303714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0c349-3170-43ad-9482-dd57c5713eda admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.315557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0c349-3170-43ad-9482-dd57c5713eda admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.321293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38929101-3ed9-41de-8b4c-191236639035 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.322107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffbeec-4d5d-4e78-ad28-618e9d9c30c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.323139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffbeec-4d5d-4e78-ad28-618e9d9c30c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.323425 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffbeec-4d5d-4e78-ad28-618e9d9c30c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.323752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffbeec-4d5d-4e78-ad28-618e9d9c30c5 admin admin] PATH_INFO: `/v3/projects/9b4f743915154640929a55cc8bdc8c67/users/d8ab3ffa0c994512802268fed11fe880/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.345503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968a57-e5e4-47c2-9b74-2ab1f673d4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.346598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffbeec-4d5d-4e78-ad28-618e9d9c30c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4f743915154640929a55cc8bdc8c67, user_id=d8ab3ffa0c994512802268fed11fe880, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.347770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968a57-e5e4-47c2-9b74-2ab1f673d4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.348046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968a57-e5e4-47c2-9b74-2ab1f673d4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.348315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968a57-e5e4-47c2-9b74-2ab1f673d4f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.349155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a968a57-e5e4-47c2-9b74-2ab1f673d4f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.352394 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a968a57-e5e4-47c2-9b74-2ab1f673d4f9 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.354137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffbeec-4d5d-4e78-ad28-618e9d9c30c5 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.381297 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 985/1962] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:23 2022] PUT /identity/v3/projects/9b4f743915154640929a55cc8bdc8c67/users/d8ab3ffa0c994512802268fed11fe880/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:23.393329 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af9676-e6f8-4f0a-ac86-84ff458fc190 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.394020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af9676-e6f8-4f0a-ac86-84ff458fc190 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.394507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af9676-e6f8-4f0a-ac86-84ff458fc190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.412858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 978/1963] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:23 2022] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:23.419256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968a57-e5e4-47c2-9b74-2ab1f673d4f9 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.460774 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-03af9676-e6f8-4f0a-ac86-84ff458fc190 None None] MFA Rules not processed for user `d8ab3ffa0c994512802268fed11fe880`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:23.462360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-03af9676-e6f8-4f0a-ac86-84ff458fc190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:23.548204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968a57-e5e4-47c2-9b74-2ab1f673d4f9 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.562689 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adad60-9eb4-404e-a84b-69cd36ac1881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.563348 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adad60-9eb4-404e-a84b-69cd36ac1881 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.563631 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adad60-9eb4-404e-a84b-69cd36ac1881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.563910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adad60-9eb4-404e-a84b-69cd36ac1881 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.564555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adad60-9eb4-404e-a84b-69cd36ac1881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.566531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adad60-9eb4-404e-a84b-69cd36ac1881 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.574989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 986/1964] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:23 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:23.579881 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af9676-e6f8-4f0a-ac86-84ff458fc190 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.592960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af9676-e6f8-4f0a-ac86-84ff458fc190 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.596576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 979/1965] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:23 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:23.599921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef4518-5516-4d2b-82d3-7a8543681163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.600469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef4518-5516-4d2b-82d3-7a8543681163 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.600469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef4518-5516-4d2b-82d3-7a8543681163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.600709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef4518-5516-4d2b-82d3-7a8543681163 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.601476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef4518-5516-4d2b-82d3-7a8543681163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.601628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adad60-9eb4-404e-a84b-69cd36ac1881 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.603380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef4518-5516-4d2b-82d3-7a8543681163 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.650659 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adad60-9eb4-404e-a84b-69cd36ac1881 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.662905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc493590-0bcd-4d23-ae75-ebc6f8c3dd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.663180 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc493590-0bcd-4d23-ae75-ebc6f8c3dd66 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.663844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc493590-0bcd-4d23-ae75-ebc6f8c3dd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.664130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc493590-0bcd-4d23-ae75-ebc6f8c3dd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.666642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc493590-0bcd-4d23-ae75-ebc6f8c3dd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.670891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 987/1966] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:23 2022] POST /identity/v3/projects => generated 401 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:23.671074 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc493590-0bcd-4d23-ae75-ebc6f8c3dd66 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.672465 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef4518-5516-4d2b-82d3-7a8543681163 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.694680 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 980/1967] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:23.698546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc493590-0bcd-4d23-ae75-ebc6f8c3dd66 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.715963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc493590-0bcd-4d23-ae75-ebc6f8c3dd66 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.763693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef4518-5516-4d2b-82d3-7a8543681163 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.770008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:23.770933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7106b75-6725-4113-a954-6ec0d02fb328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.772647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7106b75-6725-4113-a954-6ec0d02fb328 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.773115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7106b75-6725-4113-a954-6ec0d02fb328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.773741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7106b75-6725-4113-a954-6ec0d02fb328 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.774511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7106b75-6725-4113-a954-6ec0d02fb328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.777107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7106b75-6725-4113-a954-6ec0d02fb328 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.788691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:23.796288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e6092-1d52-4de0-bddf-3aa0ec499129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.796958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e6092-1d52-4de0-bddf-3aa0ec499129 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.797420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e6092-1d52-4de0-bddf-3aa0ec499129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.797959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e6092-1d52-4de0-bddf-3aa0ec499129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.798786 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e6092-1d52-4de0-bddf-3aa0ec499129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.801161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e6092-1d52-4de0-bddf-3aa0ec499129 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.816800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 988/1968] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:23 2022] POST /identity/v3/users => generated 307 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:23.816999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 981/1969] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:23.818848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7106b75-6725-4113-a954-6ec0d02fb328 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.821166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e6092-1d52-4de0-bddf-3aa0ec499129 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.837427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7106b75-6725-4113-a954-6ec0d02fb328 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.841321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e6092-1d52-4de0-bddf-3aa0ec499129 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.842961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66839d9-9cf9-44a1-8ca4-8668db4a139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.843593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66839d9-9cf9-44a1-8ca4-8668db4a139b admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.843877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66839d9-9cf9-44a1-8ca4-8668db4a139b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.844154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66839d9-9cf9-44a1-8ca4-8668db4a139b admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.845566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66839d9-9cf9-44a1-8ca4-8668db4a139b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.847459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66839d9-9cf9-44a1-8ca4-8668db4a139b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.849888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09339922-3bde-4642-989d-0f3533b8de27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.851059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09339922-3bde-4642-989d-0f3533b8de27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.851813 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09339922-3bde-4642-989d-0f3533b8de27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.852196 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09339922-3bde-4642-989d-0f3533b8de27 admin admin] PATH_INFO: `/v3/projects/da3e756f22b545178978c21b7e40143b/users/b1fa698b20c0427b81b102a80dc4beea/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.861262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 989/1970] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:23.867561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66839d9-9cf9-44a1-8ca4-8668db4a139b admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.876358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09339922-3bde-4642-989d-0f3533b8de27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3e756f22b545178978c21b7e40143b, user_id=b1fa698b20c0427b81b102a80dc4beea, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.881543 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66839d9-9cf9-44a1-8ca4-8668db4a139b admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:23.886324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09339922-3bde-4642-989d-0f3533b8de27 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.887839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9398211-fd75-4ef7-a4fb-f95b86c3fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:23.888852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9398211-fd75-4ef7-a4fb-f95b86c3fdff admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.889206 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9398211-fd75-4ef7-a4fb-f95b86c3fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.889555 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9398211-fd75-4ef7-a4fb-f95b86c3fdff admin admin] PATH_INFO: `/v3/projects/8fc9fd611e124f4b8908ac4f33075a44/users/c34f4117c42a45baa15526563781b2df/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.913026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9398211-fd75-4ef7-a4fb-f95b86c3fdff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc9fd611e124f4b8908ac4f33075a44, user_id=c34f4117c42a45baa15526563781b2df, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:23.913828 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 982/1971] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:23 2022] PUT /identity/v3/projects/da3e756f22b545178978c21b7e40143b/users/b1fa698b20c0427b81b102a80dc4beea/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:23.919032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9398211-fd75-4ef7-a4fb-f95b86c3fdff admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:23.925327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ab906-018b-4734-bd0b-206c176caf1b None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:23.925838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ab906-018b-4734-bd0b-206c176caf1b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:23.926233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ab906-018b-4734-bd0b-206c176caf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:23.945446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 990/1972] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:23 2022] PUT /identity/v3/projects/8fc9fd611e124f4b8908ac4f33075a44/users/c34f4117c42a45baa15526563781b2df/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:23.949264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9398211-fd75-4ef7-a4fb-f95b86c3fdff admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:23.959073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-141ab906-018b-4734-bd0b-206c176caf1b None None] MFA Rules not processed for user `b1fa698b20c0427b81b102a80dc4beea`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:23.960312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-141ab906-018b-4734-bd0b-206c176caf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:24.036093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9398211-fd75-4ef7-a4fb-f95b86c3fdff admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:24.042885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5d29a-9e9b-446f-84a2-0ac91d223694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:24.043976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5d29a-9e9b-446f-84a2-0ac91d223694 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.044331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5d29a-9e9b-446f-84a2-0ac91d223694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.044700 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5d29a-9e9b-446f-84a2-0ac91d223694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.045502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5d29a-9e9b-446f-84a2-0ac91d223694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:24.047447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5d29a-9e9b-446f-84a2-0ac91d223694 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:24.050027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 983/1973] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:24.055617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ab906-018b-4734-bd0b-206c176caf1b None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:24.061067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 991/1974] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:24.064936 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5d29a-9e9b-446f-84a2-0ac91d223694 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:24.069625 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ab906-018b-4734-bd0b-206c176caf1b None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:24.075500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0937834-aff3-4d44-b743-d1a39d486a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:24.076272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0937834-aff3-4d44-b743-d1a39d486a48 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.076586 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0937834-aff3-4d44-b743-d1a39d486a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.076897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0937834-aff3-4d44-b743-d1a39d486a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.077558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0937834-aff3-4d44-b743-d1a39d486a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:24.078369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5d29a-9e9b-446f-84a2-0ac91d223694 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:24.079461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0937834-aff3-4d44-b743-d1a39d486a48 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:24.083887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f81e61-4916-47dc-856a-5ea71da860fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:24.084667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f81e61-4916-47dc-856a-5ea71da860fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.085044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f81e61-4916-47dc-856a-5ea71da860fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.085397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f81e61-4916-47dc-856a-5ea71da860fa admin admin] PATH_INFO: `/v3/projects/8fc9fd611e124f4b8908ac4f33075a44/users/c34f4117c42a45baa15526563781b2df/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.087977 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f81e61-4916-47dc-856a-5ea71da860fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc9fd611e124f4b8908ac4f33075a44, user_id=c34f4117c42a45baa15526563781b2df, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:24.091047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f81e61-4916-47dc-856a-5ea71da860fa admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:24.103671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 992/1975] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:24 2022] PUT /identity/v3/projects/8fc9fd611e124f4b8908ac4f33075a44/users/c34f4117c42a45baa15526563781b2df/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:24.115049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d38d3-45e9-47ff-90e8-594a50275645 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.116062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d38d3-45e9-47ff-90e8-594a50275645 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.116802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d38d3-45e9-47ff-90e8-594a50275645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.127577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 984/1976] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:24 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:24.132697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0937834-aff3-4d44-b743-d1a39d486a48 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:24.185326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c36d38d3-45e9-47ff-90e8-594a50275645 None None] MFA Rules not processed for user `c34f4117c42a45baa15526563781b2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:24.187545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c36d38d3-45e9-47ff-90e8-594a50275645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:24.222022 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0937834-aff3-4d44-b743-d1a39d486a48 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:24.229641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040ed46-9d5e-4357-bedb-095287951f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:24.230277 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040ed46-9d5e-4357-bedb-095287951f46 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.230563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040ed46-9d5e-4357-bedb-095287951f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.230841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040ed46-9d5e-4357-bedb-095287951f46 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.231488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040ed46-9d5e-4357-bedb-095287951f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:24.233634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040ed46-9d5e-4357-bedb-095287951f46 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:24.272225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 985/1977] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:24 2022] POST /identity/v3/users => generated 301 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:24.273200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040ed46-9d5e-4357-bedb-095287951f46 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:24.286024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040ed46-9d5e-4357-bedb-095287951f46 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:24.293603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5a81b-2e28-4e31-b967-5b1fa0465e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:24.294222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a81b-2e28-4e31-b967-5b1fa0465e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.294698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a81b-2e28-4e31-b967-5b1fa0465e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.294928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a81b-2e28-4e31-b967-5b1fa0465e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.295800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5a81b-2e28-4e31-b967-5b1fa0465e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:24.297533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5a81b-2e28-4e31-b967-5b1fa0465e41 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:24.298920 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 993/1978] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:24 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:24.306412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d38d3-45e9-47ff-90e8-594a50275645 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:24.307208 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:24.309029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c36d38d3-45e9-47ff-90e8-594a50275645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:24.315400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 986/1979] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:24.320933 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5a81b-2e28-4e31-b967-5b1fa0465e41 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:24.333135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5a81b-2e28-4e31-b967-5b1fa0465e41 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:24.339323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2df61-ff15-48b8-9e0a-aa5cc9760d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:24.340552 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2df61-ff15-48b8-9e0a-aa5cc9760d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.340854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2df61-ff15-48b8-9e0a-aa5cc9760d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.341237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2df61-ff15-48b8-9e0a-aa5cc9760d66 admin admin] PATH_INFO: `/v3/projects/4543d72eac194642a28d3d61bfe30e29/users/a1a844c45e594d2d9d5e6f6bd1e5f7ba/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.352564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:24.362210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2df61-ff15-48b8-9e0a-aa5cc9760d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4543d72eac194642a28d3d61bfe30e29, user_id=a1a844c45e594d2d9d5e6f6bd1e5f7ba, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:24.367478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2df61-ff15-48b8-9e0a-aa5cc9760d66 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:24.386695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 987/1980] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:24 2022] PUT /identity/v3/projects/4543d72eac194642a28d3d61bfe30e29/users/a1a844c45e594d2d9d5e6f6bd1e5f7ba/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:24.390705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2df61-ff15-48b8-9e0a-aa5cc9760d66 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:24.397515 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d38d3-45e9-47ff-90e8-594a50275645 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:24.457788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df220b2-64a9-487e-b071-cb884f4468cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:24.458202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df220b2-64a9-487e-b071-cb884f4468cd service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.459286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df220b2-64a9-487e-b071-cb884f4468cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.459602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df220b2-64a9-487e-b071-cb884f4468cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.477971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2df61-ff15-48b8-9e0a-aa5cc9760d66 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:24.482522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877e253-b188-40e2-be61-d2ed042e87ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:24.483124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877e253-b188-40e2-be61-d2ed042e87ec admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.483411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877e253-b188-40e2-be61-d2ed042e87ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.483719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877e253-b188-40e2-be61-d2ed042e87ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.484359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877e253-b188-40e2-be61-d2ed042e87ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:24.485988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877e253-b188-40e2-be61-d2ed042e87ec admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:24.497622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 988/1981] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:24.501377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877e253-b188-40e2-be61-d2ed042e87ec admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:24.514960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877e253-b188-40e2-be61-d2ed042e87ec admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:24.521846 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c99851-ff71-4b54-9334-143e280cec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:24.523188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c99851-ff71-4b54-9334-143e280cec29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.523488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c99851-ff71-4b54-9334-143e280cec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.523766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c99851-ff71-4b54-9334-143e280cec29 admin admin] PATH_INFO: `/v3/projects/4543d72eac194642a28d3d61bfe30e29/users/a1a844c45e594d2d9d5e6f6bd1e5f7ba/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.526135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c99851-ff71-4b54-9334-143e280cec29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4543d72eac194642a28d3d61bfe30e29, user_id=a1a844c45e594d2d9d5e6f6bd1e5f7ba, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:24.528770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c99851-ff71-4b54-9334-143e280cec29 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:24.536163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df220b2-64a9-487e-b071-cb884f4468cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:24.541330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df220b2-64a9-487e-b071-cb884f4468cd service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:24.545420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 989/1982] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:24 2022] PUT /identity/v3/projects/4543d72eac194642a28d3d61bfe30e29/users/a1a844c45e594d2d9d5e6f6bd1e5f7ba/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:24.556575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aae18-ed5c-40c5-94f9-8ff32701ff48 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.558383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aae18-ed5c-40c5-94f9-8ff32701ff48 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.558383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aae18-ed5c-40c5-94f9-8ff32701ff48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.558549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 994/1983] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:24 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:24.603885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7e3aae18-ed5c-40c5-94f9-8ff32701ff48 None None] MFA Rules not processed for user `a1a844c45e594d2d9d5e6f6bd1e5f7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:24.606829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7e3aae18-ed5c-40c5-94f9-8ff32701ff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:24.676029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df220b2-64a9-487e-b071-cb884f4468cd service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:24.678503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6df220b2-64a9-487e-b071-cb884f4468cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:24.694037 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df220b2-64a9-487e-b071-cb884f4468cd service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:24.725651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 990/1984] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:24 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:24.738424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aae18-ed5c-40c5-94f9-8ff32701ff48 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:24.777257 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cd67b-6b0b-4c56-84ee-9366e8c1dc6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:24.778135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd67b-6b0b-4c56-84ee-9366e8c1dc6d service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.778457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd67b-6b0b-4c56-84ee-9366e8c1dc6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.778737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd67b-6b0b-4c56-84ee-9366e8c1dc6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.826224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:24.839238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:24.848639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aae18-ed5c-40c5-94f9-8ff32701ff48 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:24.855665 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110a2df-0d7a-4dcd-8f0b-8354a31e5d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:24.856582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110a2df-0d7a-4dcd-8f0b-8354a31e5d34 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:24.857248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110a2df-0d7a-4dcd-8f0b-8354a31e5d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:24.857803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110a2df-0d7a-4dcd-8f0b-8354a31e5d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:24.861128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cd67b-6b0b-4c56-84ee-9366e8c1dc6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:24.862606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cd67b-6b0b-4c56-84ee-9366e8c1dc6d service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:24.876517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110a2df-0d7a-4dcd-8f0b-8354a31e5d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:24.877903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 995/1985] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:24 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:24.878589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110a2df-0d7a-4dcd-8f0b-8354a31e5d34 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:24.890186 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 991/1986] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:24 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:25.104191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cd67b-6b0b-4c56-84ee-9366e8c1dc6d service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:25.105674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-203cd67b-6b0b-4c56-84ee-9366e8c1dc6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:25.221722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cd67b-6b0b-4c56-84ee-9366e8c1dc6d service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:25.229138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10280e-65c0-4632-82e1-e1a3b31683f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:25.230379 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10280e-65c0-4632-82e1-e1a3b31683f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:25.230858 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10280e-65c0-4632-82e1-e1a3b31683f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:25.231614 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10280e-65c0-4632-82e1-e1a3b31683f2 admin admin] PATH_INFO: `/v3/users/8a1d84ee60d0499bb6d579ad3b2c49b9` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:25.232980 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10280e-65c0-4632-82e1-e1a3b31683f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1d84ee60d0499bb6d579ad3b2c49b9)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:25.235240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10280e-65c0-4632-82e1-e1a3b31683f2 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:25.348437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-be10280e-65c0-4632-82e1-e1a3b31683f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1d84ee60d0499bb6d579ad3b2c49b9'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:25.375575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-be10280e-65c0-4632-82e1-e1a3b31683f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1d84ee60d0499bb6d579ad3b2c49b9'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:25.383289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110a2df-0d7a-4dcd-8f0b-8354a31e5d34 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:25.401559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110a2df-0d7a-4dcd-8f0b-8354a31e5d34 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:25.410337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-be10280e-65c0-4632-82e1-e1a3b31683f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1d84ee60d0499bb6d579ad3b2c49b9'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:25.411140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-be10280e-65c0-4632-82e1-e1a3b31683f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1d84ee60d0499bb6d579ad3b2c49b9'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:25.412114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6980dea-8ebe-481b-ac83-efd988d82e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:25.412273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-be10280e-65c0-4632-82e1-e1a3b31683f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1d84ee60d0499bb6d579ad3b2c49b9'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:25.412912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6980dea-8ebe-481b-ac83-efd988d82e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:25.413987 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6980dea-8ebe-481b-ac83-efd988d82e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:25.414422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6980dea-8ebe-481b-ac83-efd988d82e25 admin admin] PATH_INFO: `/v3/users/b1fa698b20c0427b81b102a80dc4beea` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:25.425759 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6980dea-8ebe-481b-ac83-efd988d82e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1fa698b20c0427b81b102a80dc4beea)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:25.430570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6980dea-8ebe-481b-ac83-efd988d82e25 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:25.432831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 996/1987] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:25 2022] DELETE /identity/v3/users/8a1d84ee60d0499bb6d579ad3b2c49b9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:25.437352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3198a4d-519d-4ce5-aae4-69bf94290027 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:25.437644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3198a4d-519d-4ce5-aae4-69bf94290027 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:25.437926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3198a4d-519d-4ce5-aae4-69bf94290027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:25.462768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-d3198a4d-519d-4ce5-aae4-69bf94290027 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:25.468725 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d3198a4d-519d-4ce5-aae4-69bf94290027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:25.509544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d6980dea-8ebe-481b-ac83-efd988d82e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1fa698b20c0427b81b102a80dc4beea'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:25.519458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d6980dea-8ebe-481b-ac83-efd988d82e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1fa698b20c0427b81b102a80dc4beea'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:25.521599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d6980dea-8ebe-481b-ac83-efd988d82e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1fa698b20c0427b81b102a80dc4beea'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:25.522403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d6980dea-8ebe-481b-ac83-efd988d82e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1fa698b20c0427b81b102a80dc4beea'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:25.540434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d6980dea-8ebe-481b-ac83-efd988d82e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1fa698b20c0427b81b102a80dc4beea'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:25.552886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 997/1988] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:25.559843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3198a4d-519d-4ce5-aae4-69bf94290027 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:25.562211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d3198a4d-519d-4ce5-aae4-69bf94290027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:25.566899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 992/1989] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:25 2022] DELETE /identity/v3/users/b1fa698b20c0427b81b102a80dc4beea => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:25.573703 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55449a84-e3ca-4fe9-a07c-adb2a2f12399 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:25.574292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55449a84-e3ca-4fe9-a07c-adb2a2f12399 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:25.574750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55449a84-e3ca-4fe9-a07c-adb2a2f12399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:25.579269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:25.608065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-55449a84-e3ca-4fe9-a07c-adb2a2f12399 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:25.610369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-55449a84-e3ca-4fe9-a07c-adb2a2f12399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:25.647637 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3198a4d-519d-4ce5-aae4-69bf94290027 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:25.696090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 993/1990] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:25.724713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55449a84-e3ca-4fe9-a07c-adb2a2f12399 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:25.735833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8f693-2915-48f4-a605-7176729a2084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:25.736661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8f693-2915-48f4-a605-7176729a2084 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:25.737227 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8f693-2915-48f4-a605-7176729a2084 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:25.737647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8f693-2915-48f4-a605-7176729a2084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:25.748949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8f693-2915-48f4-a605-7176729a2084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:25.750857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8f693-2915-48f4-a605-7176729a2084 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:25.763306 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 998/1991] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:25.796127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55449a84-e3ca-4fe9-a07c-adb2a2f12399 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:25.806616 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18902de9-5b62-4612-b760-9b7f9de2f057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:25.807791 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18902de9-5b62-4612-b760-9b7f9de2f057 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:25.807937 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18902de9-5b62-4612-b760-9b7f9de2f057 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:25.808183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18902de9-5b62-4612-b760-9b7f9de2f057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:25.823392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18902de9-5b62-4612-b760-9b7f9de2f057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:25.825777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18902de9-5b62-4612-b760-9b7f9de2f057 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:25.851375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 994/1992] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:26.464639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8f693-2915-48f4-a605-7176729a2084 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:26.466357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-66e8f693-2915-48f4-a605-7176729a2084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:26.494680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8f693-2915-48f4-a605-7176729a2084 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:26.500657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:26.501831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:26.501980 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:26.502398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] PATH_INFO: `/v3/projects/a510772f655c4fdd8261a54819309764` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:26.515617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a510772f655c4fdd8261a54819309764)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:26.523577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:26.659440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a510772f655c4fdd8261a54819309764', 'request_id': 'req-3e37409e-33c6-4273-ae34-c4bb2c751f97'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:26.670057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a510772f655c4fdd8261a54819309764', 'request_id': 'req-3e37409e-33c6-4273-ae34-c4bb2c751f97'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:26.682854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a510772f655c4fdd8261a54819309764', 'request_id': 'req-3e37409e-33c6-4273-ae34-c4bb2c751f97'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:26.707327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] The token cache is being invalidate because project a510772f655c4fdd8261a54819309764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:26.707706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:26.710304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:26.713044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 999/1993] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:26 2022] DELETE /identity/v3/projects/a510772f655c4fdd8261a54819309764 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:26.717085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18902de9-5b62-4612-b760-9b7f9de2f057 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:26.723216 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:26.731781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18902de9-5b62-4612-b760-9b7f9de2f057 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:26.827195 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:26.829258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:26.902830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:26.903733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:26.905993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:26.907670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] PATH_INFO: `/v3/users/aba266f57fb54f3c91741e480c5f2b2a` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:26.910769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba266f57fb54f3c91741e480c5f2b2a)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:26.918903 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:26.965249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:27.004163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37409e-33c6-4273-ae34-c4bb2c751f97 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:27.006508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba266f57fb54f3c91741e480c5f2b2a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.014966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:27.015888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:27.016141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:27.016453 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] PATH_INFO: `/v3/projects/da3e756f22b545178978c21b7e40143b` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:27.018184 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3e756f22b545178978c21b7e40143b)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:27.018704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba266f57fb54f3c91741e480c5f2b2a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.019601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba266f57fb54f3c91741e480c5f2b2a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.020499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba266f57fb54f3c91741e480c5f2b2a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.028263 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:27.066663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba266f57fb54f3c91741e480c5f2b2a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.097794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 995/1994] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:26 2022] DELETE /identity/v3/users/aba266f57fb54f3c91741e480c5f2b2a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:27.137476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3e756f22b545178978c21b7e40143b', 'request_id': 'req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.161170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3e756f22b545178978c21b7e40143b', 'request_id': 'req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.197000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3e756f22b545178978c21b7e40143b', 'request_id': 'req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.213608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] The token cache is being invalidate because project da3e756f22b545178978c21b7e40143b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:27.213608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.217104 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.218870 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1000/1995] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:26 2022] DELETE /identity/v3/projects/da3e756f22b545178978c21b7e40143b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:27.223164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:27.225781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:27.377362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6eb33-f840-40ba-845f-f8ce4f40f5b0 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:27.426815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:27.506396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:27.507130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:27.507412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:27.507687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] PATH_INFO: `/v3/users/a1a844c45e594d2d9d5e6f6bd1e5f7ba` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:27.514886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a844c45e594d2d9d5e6f6bd1e5f7ba)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:27.519516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:27.638053 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a844c45e594d2d9d5e6f6bd1e5f7ba'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.657005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a844c45e594d2d9d5e6f6bd1e5f7ba'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.658133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a844c45e594d2d9d5e6f6bd1e5f7ba'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.659465 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a844c45e594d2d9d5e6f6bd1e5f7ba'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.690924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a844c45e594d2d9d5e6f6bd1e5f7ba'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:27.724090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 996/1996] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:27 2022] DELETE /identity/v3/users/a1a844c45e594d2d9d5e6f6bd1e5f7ba => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:27.937591 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:27.939486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:27.971873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c1cf1-5e71-4488-8cbd-d6cfc72cef87 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:28.079975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:28.080757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:28.081047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:28.081324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] PATH_INFO: `/v3/projects/c57ca7ead0a14a47a2f53ff96490af2b` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:28.084846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57ca7ead0a14a47a2f53ff96490af2b)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:28.086879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:28.167522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57ca7ead0a14a47a2f53ff96490af2b', 'request_id': 'req-8714272e-cb4e-4d7e-b867-2fb7c289695d'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.175148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57ca7ead0a14a47a2f53ff96490af2b', 'request_id': 'req-8714272e-cb4e-4d7e-b867-2fb7c289695d'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.189525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57ca7ead0a14a47a2f53ff96490af2b', 'request_id': 'req-8714272e-cb4e-4d7e-b867-2fb7c289695d'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.206392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] The token cache is being invalidate because project c57ca7ead0a14a47a2f53ff96490af2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:28.206849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.207619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.212923 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1001/1997] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:27 2022] DELETE /identity/v3/projects/c57ca7ead0a14a47a2f53ff96490af2b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:28.214695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:28.216112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:28.237047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efb8c3-70c1-4640-82ce-6d70b9a4cd4f admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:28.316529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:28.318357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:28.327300 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:28.372409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f12a1-f788-4daf-ae51-f75924012209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:28.375169 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f12a1-f788-4daf-ae51-f75924012209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:28.380566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f12a1-f788-4daf-ae51-f75924012209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:28.381326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f12a1-f788-4daf-ae51-f75924012209 admin admin] PATH_INFO: `/v3/users/82d4f078f6aa41dd9aae37a4432df353` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:28.382836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f12a1-f788-4daf-ae51-f75924012209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d4f078f6aa41dd9aae37a4432df353)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:28.391061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f12a1-f788-4daf-ae51-f75924012209 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:28.445396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714272e-cb4e-4d7e-b867-2fb7c289695d admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:28.467239 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754899b-911f-49f2-ac20-f82685556226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:28.467904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754899b-911f-49f2-ac20-f82685556226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:28.468188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754899b-911f-49f2-ac20-f82685556226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:28.468472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754899b-911f-49f2-ac20-f82685556226 admin admin] PATH_INFO: `/v3/projects/4543d72eac194642a28d3d61bfe30e29` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:28.469743 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754899b-911f-49f2-ac20-f82685556226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4543d72eac194642a28d3d61bfe30e29)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:28.471941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754899b-911f-49f2-ac20-f82685556226 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:28.483252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3e5f12a1-f788-4daf-ae51-f75924012209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d4f078f6aa41dd9aae37a4432df353'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.487047 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:28.497270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3e5f12a1-f788-4daf-ae51-f75924012209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d4f078f6aa41dd9aae37a4432df353'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.498383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3e5f12a1-f788-4daf-ae51-f75924012209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d4f078f6aa41dd9aae37a4432df353'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.499444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3e5f12a1-f788-4daf-ae51-f75924012209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d4f078f6aa41dd9aae37a4432df353'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.517442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3e5f12a1-f788-4daf-ae51-f75924012209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d4f078f6aa41dd9aae37a4432df353'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.531200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 997/1998] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:28 2022] DELETE /identity/v3/users/82d4f078f6aa41dd9aae37a4432df353 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:28.570004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4754899b-911f-49f2-ac20-f82685556226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4543d72eac194642a28d3d61bfe30e29', 'request_id': 'req-4754899b-911f-49f2-ac20-f82685556226'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.578860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4754899b-911f-49f2-ac20-f82685556226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4543d72eac194642a28d3d61bfe30e29', 'request_id': 'req-4754899b-911f-49f2-ac20-f82685556226'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.592061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4754899b-911f-49f2-ac20-f82685556226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4543d72eac194642a28d3d61bfe30e29', 'request_id': 'req-4754899b-911f-49f2-ac20-f82685556226'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.615760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4754899b-911f-49f2-ac20-f82685556226 admin admin] The token cache is being invalidate because project 4543d72eac194642a28d3d61bfe30e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:28.616248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4754899b-911f-49f2-ac20-f82685556226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.617152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4754899b-911f-49f2-ac20-f82685556226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:28.622342 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1002/1999] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:28 2022] DELETE /identity/v3/projects/4543d72eac194642a28d3d61bfe30e29 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:28.625072 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252d655-82c5-4811-a668-e45a5d9b5448 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:28.625633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252d655-82c5-4811-a668-e45a5d9b5448 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:28.625831 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252d655-82c5-4811-a668-e45a5d9b5448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:28.673846 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-0252d655-82c5-4811-a668-e45a5d9b5448 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:28.679642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0252d655-82c5-4811-a668-e45a5d9b5448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:28.778947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 998/2000] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:28.788204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c9c42-a87e-4b9a-a891-c0827662d1d3 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:28.788765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c9c42-a87e-4b9a-a891-c0827662d1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:28.789130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c9c42-a87e-4b9a-a891-c0827662d1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:28.823087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-fa0c9c42-a87e-4b9a-a891-c0827662d1d3 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:28.824522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-fa0c9c42-a87e-4b9a-a891-c0827662d1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:28.838709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1003/2001] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:28.844651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252d655-82c5-4811-a668-e45a5d9b5448 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:28.858423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252d655-82c5-4811-a668-e45a5d9b5448 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:28.871721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6db67a-92d3-42d5-852b-c8d24f97cbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:28.872541 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6db67a-92d3-42d5-852b-c8d24f97cbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:28.872949 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6db67a-92d3-42d5-852b-c8d24f97cbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:28.873531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6db67a-92d3-42d5-852b-c8d24f97cbd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:28.874303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6db67a-92d3-42d5-852b-c8d24f97cbd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:28.874725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6db67a-92d3-42d5-852b-c8d24f97cbd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:28.878982 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6db67a-92d3-42d5-852b-c8d24f97cbd1 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:28.905103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 999/2002] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:11:28.907016 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c9c42-a87e-4b9a-a891-c0827662d1d3 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:28.921303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c9c42-a87e-4b9a-a891-c0827662d1d3 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:28.929565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cffea6-ba6f-4b02-b974-37dc9f4a092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:28.930735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cffea6-ba6f-4b02-b974-37dc9f4a092a admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:28.931074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cffea6-ba6f-4b02-b974-37dc9f4a092a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:28.931303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cffea6-ba6f-4b02-b974-37dc9f4a092a admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:28.931955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cffea6-ba6f-4b02-b974-37dc9f4a092a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:28.934354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cffea6-ba6f-4b02-b974-37dc9f4a092a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.018477 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1004/2003] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:28 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:29.019630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6db67a-92d3-42d5-852b-c8d24f97cbd1 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.034913 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6db67a-92d3-42d5-852b-c8d24f97cbd1 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.121625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cffea6-ba6f-4b02-b974-37dc9f4a092a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.133471 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de88b8-427a-40ab-9af8-48d75270e1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.134108 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de88b8-427a-40ab-9af8-48d75270e1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.134353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de88b8-427a-40ab-9af8-48d75270e1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.134624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de88b8-427a-40ab-9af8-48d75270e1c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.135288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de88b8-427a-40ab-9af8-48d75270e1c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.136791 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-a5cffea6-ba6f-4b02-b974-37dc9f4a092a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:29.137226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de88b8-427a-40ab-9af8-48d75270e1c1 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.150904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cffea6-ba6f-4b02-b974-37dc9f4a092a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.157661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced43e7-6a3b-4dd5-b136-1718617833f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.159082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced43e7-6a3b-4dd5-b136-1718617833f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.159491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced43e7-6a3b-4dd5-b136-1718617833f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.159755 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced43e7-6a3b-4dd5-b136-1718617833f0 admin admin] PATH_INFO: `/v3/projects/eee6f000f6b04b80bc0ae1268a86c0a6` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.160857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1000/2004] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:29 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:29.164208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced43e7-6a3b-4dd5-b136-1718617833f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee6f000f6b04b80bc0ae1268a86c0a6)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.165032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de88b8-427a-40ab-9af8-48d75270e1c1 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.166349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced43e7-6a3b-4dd5-b136-1718617833f0 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.174520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de88b8-427a-40ab-9af8-48d75270e1c1 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.180349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79532221-0cec-4bd4-9eab-87ff88913e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.181162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79532221-0cec-4bd4-9eab-87ff88913e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.181442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79532221-0cec-4bd4-9eab-87ff88913e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.181709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79532221-0cec-4bd4-9eab-87ff88913e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.182340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79532221-0cec-4bd4-9eab-87ff88913e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.183907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79532221-0cec-4bd4-9eab-87ff88913e0b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.195968 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1001/2005] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:29.200535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79532221-0cec-4bd4-9eab-87ff88913e0b admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.214914 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79532221-0cec-4bd4-9eab-87ff88913e0b admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.220756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9ced43e7-6a3b-4dd5-b136-1718617833f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee6f000f6b04b80bc0ae1268a86c0a6', 'request_id': 'req-9ced43e7-6a3b-4dd5-b136-1718617833f0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:29.226985 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9ced43e7-6a3b-4dd5-b136-1718617833f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee6f000f6b04b80bc0ae1268a86c0a6', 'request_id': 'req-9ced43e7-6a3b-4dd5-b136-1718617833f0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:29.230114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:29.237102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9ced43e7-6a3b-4dd5-b136-1718617833f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee6f000f6b04b80bc0ae1268a86c0a6', 'request_id': 'req-9ced43e7-6a3b-4dd5-b136-1718617833f0'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:29.247490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:29.251130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9ced43e7-6a3b-4dd5-b136-1718617833f0 admin admin] The token cache is being invalidate because project eee6f000f6b04b80bc0ae1268a86c0a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:29.251428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9ced43e7-6a3b-4dd5-b136-1718617833f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:29.252093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9ced43e7-6a3b-4dd5-b136-1718617833f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:29.253933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1005/2006] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:29 2022] DELETE /identity/v3/projects/eee6f000f6b04b80bc0ae1268a86c0a6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:29.260659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466375c2-b076-4f7a-94ff-842acd3f8b53 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.261118 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466375c2-b076-4f7a-94ff-842acd3f8b53 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.261622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466375c2-b076-4f7a-94ff-842acd3f8b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.277274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f22cc-e6a6-43ea-a39f-65840807645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.278125 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f22cc-e6a6-43ea-a39f-65840807645e admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.278411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f22cc-e6a6-43ea-a39f-65840807645e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.278683 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f22cc-e6a6-43ea-a39f-65840807645e admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.279323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f22cc-e6a6-43ea-a39f-65840807645e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.281257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f22cc-e6a6-43ea-a39f-65840807645e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.283381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-466375c2-b076-4f7a-94ff-842acd3f8b53 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:29.284602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-466375c2-b076-4f7a-94ff-842acd3f8b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:29.292049 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1002/2007] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:29.294220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1006/2008] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:29.302598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f22cc-e6a6-43ea-a39f-65840807645e admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.302598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6a5f22cc-e6a6-43ea-a39f-65840807645e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:29.303817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c437a7-ca63-46a1-8f60-a29d200d4314 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.304097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c437a7-ca63-46a1-8f60-a29d200d4314 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.304366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c437a7-ca63-46a1-8f60-a29d200d4314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.311474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f22cc-e6a6-43ea-a39f-65840807645e admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.316145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fbd3d-6177-4e3d-97ff-7938d325d96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.316837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fbd3d-6177-4e3d-97ff-7938d325d96d admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.317120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fbd3d-6177-4e3d-97ff-7938d325d96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.317407 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fbd3d-6177-4e3d-97ff-7938d325d96d admin admin] PATH_INFO: `/v3/projects/2b02ad17a8d74b8295a4fe3d11646e58/users/113ac9dab63b4300b1c46505de3b010e/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.325648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-99c437a7-ca63-46a1-8f60-a29d200d4314 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:29.326867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-99c437a7-ca63-46a1-8f60-a29d200d4314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:29.333693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fbd3d-6177-4e3d-97ff-7938d325d96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b02ad17a8d74b8295a4fe3d11646e58, user_id=113ac9dab63b4300b1c46505de3b010e, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.335598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1007/2009] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:29.337583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fbd3d-6177-4e3d-97ff-7938d325d96d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.339804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c437a7-ca63-46a1-8f60-a29d200d4314 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.350135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c437a7-ca63-46a1-8f60-a29d200d4314 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.353019 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1003/2010] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:29 2022] PUT /identity/v3/projects/2b02ad17a8d74b8295a4fe3d11646e58/users/113ac9dab63b4300b1c46505de3b010e/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:29.363962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e32a7-aa48-418f-a446-0465487456c3 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.364824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e32a7-aa48-418f-a446-0465487456c3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.365399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e32a7-aa48-418f-a446-0465487456c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.395001 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-032e32a7-aa48-418f-a446-0465487456c3 None None] MFA Rules not processed for user `113ac9dab63b4300b1c46505de3b010e`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:29.396501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-032e32a7-aa48-418f-a446-0465487456c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:29.413079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71b35a-e762-478c-9c2f-aa671c72ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.413775 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71b35a-e762-478c-9c2f-aa671c72ba08 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.414010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71b35a-e762-478c-9c2f-aa671c72ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.414281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71b35a-e762-478c-9c2f-aa671c72ba08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.414932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71b35a-e762-478c-9c2f-aa671c72ba08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:29.415235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71b35a-e762-478c-9c2f-aa671c72ba08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.417243 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71b35a-e762-478c-9c2f-aa671c72ba08 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.432439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1008/2011] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:11:29.435146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71b35a-e762-478c-9c2f-aa671c72ba08 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.446990 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71b35a-e762-478c-9c2f-aa671c72ba08 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.453832 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018e4cf-da3a-4a1a-b65e-3d61e21cea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.454377 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e4cf-da3a-4a1a-b65e-3d61e21cea52 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.454685 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e4cf-da3a-4a1a-b65e-3d61e21cea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.454962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e4cf-da3a-4a1a-b65e-3d61e21cea52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.455605 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018e4cf-da3a-4a1a-b65e-3d61e21cea52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.457552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018e4cf-da3a-4a1a-b65e-3d61e21cea52 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.480280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1004/2012] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:29.485110 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e32a7-aa48-418f-a446-0465487456c3 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.491235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1009/2013] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:29 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:29.492244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018e4cf-da3a-4a1a-b65e-3d61e21cea52 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.497243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e32a7-aa48-418f-a446-0465487456c3 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.571324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018e4cf-da3a-4a1a-b65e-3d61e21cea52 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.576450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b7e47-dd43-4e1a-b06b-f5d2942c81d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.577226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b7e47-dd43-4e1a-b06b-f5d2942c81d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.577612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b7e47-dd43-4e1a-b06b-f5d2942c81d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.577920 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27eb12-4030-4c8a-b114-2d35c46d02b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.578077 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b7e47-dd43-4e1a-b06b-f5d2942c81d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.578545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27eb12-4030-4c8a-b114-2d35c46d02b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.578831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27eb12-4030-4c8a-b114-2d35c46d02b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.579686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b7e47-dd43-4e1a-b06b-f5d2942c81d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.579912 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27eb12-4030-4c8a-b114-2d35c46d02b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.579912 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27eb12-4030-4c8a-b114-2d35c46d02b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.581283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b7e47-dd43-4e1a-b06b-f5d2942c81d3 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.581809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27eb12-4030-4c8a-b114-2d35c46d02b9 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.616948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1010/2014] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:29 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:29.631742 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27eb12-4030-4c8a-b114-2d35c46d02b9 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.639660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27eb12-4030-4c8a-b114-2d35c46d02b9 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.644748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1005/2015] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:29 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:29.645068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f4a0f-07cb-4826-b2e9-3e4c37ac6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.645898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f4a0f-07cb-4826-b2e9-3e4c37ac6ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.646274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f4a0f-07cb-4826-b2e9-3e4c37ac6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.646559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f4a0f-07cb-4826-b2e9-3e4c37ac6ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.647298 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f4a0f-07cb-4826-b2e9-3e4c37ac6ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.648249 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b7e47-dd43-4e1a-b06b-f5d2942c81d3 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.649234 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f4a0f-07cb-4826-b2e9-3e4c37ac6ae4 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.664616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1011/2016] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:29.665515 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f4a0f-07cb-4826-b2e9-3e4c37ac6ae4 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.681148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f4a0f-07cb-4826-b2e9-3e4c37ac6ae4 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.682295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:29.712843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:29.732289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b7e47-dd43-4e1a-b06b-f5d2942c81d3 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.737152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7e745-190d-410d-b130-1127c71f3a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.737901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7e745-190d-410d-b130-1127c71f3a7f admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.738258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7e745-190d-410d-b130-1127c71f3a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.738609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7e745-190d-410d-b130-1127c71f3a7f admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.739384 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7e745-190d-410d-b130-1127c71f3a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.741562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7e745-190d-410d-b130-1127c71f3a7f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.758701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed69ed0-acdf-4aad-8817-3a282f1f8580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.759611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69ed0-acdf-4aad-8817-3a282f1f8580 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.760174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69ed0-acdf-4aad-8817-3a282f1f8580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.760776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69ed0-acdf-4aad-8817-3a282f1f8580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.761877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed69ed0-acdf-4aad-8817-3a282f1f8580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.765502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed69ed0-acdf-4aad-8817-3a282f1f8580 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.775227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1006/2017] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:29 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:29.776335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7e745-190d-410d-b130-1127c71f3a7f admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.780223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1012/2018] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:29.781784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed69ed0-acdf-4aad-8817-3a282f1f8580 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.793767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed69ed0-acdf-4aad-8817-3a282f1f8580 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.795254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7e745-190d-410d-b130-1127c71f3a7f admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.800280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cdbc5-7366-438c-9d29-55a95590a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.801098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c068b4f-8329-4b71-b675-dab016783f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.801373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cdbc5-7366-438c-9d29-55a95590a0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.801690 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068b4f-8329-4b71-b675-dab016783f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.801858 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cdbc5-7366-438c-9d29-55a95590a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.802132 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068b4f-8329-4b71-b675-dab016783f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.802361 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068b4f-8329-4b71-b675-dab016783f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.802674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cdbc5-7366-438c-9d29-55a95590a0f0 admin admin] PATH_INFO: `/v3/projects/0440cf9f5b7e4ec9bf869538f69f2764/users/463767837e08493c88b933d8605259d4/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.803126 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c068b4f-8329-4b71-b675-dab016783f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.804778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c068b4f-8329-4b71-b675-dab016783f06 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.820729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cdbc5-7366-438c-9d29-55a95590a0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0440cf9f5b7e4ec9bf869538f69f2764, user_id=463767837e08493c88b933d8605259d4, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.823255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cdbc5-7366-438c-9d29-55a95590a0f0 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.826848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1007/2019] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:29.827551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c068b4f-8329-4b71-b675-dab016783f06 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.841760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c068b4f-8329-4b71-b675-dab016783f06 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:29.844836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1013/2020] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:29 2022] PUT /identity/v3/projects/0440cf9f5b7e4ec9bf869538f69f2764/users/463767837e08493c88b933d8605259d4/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:29.856436 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de4931-024f-4d8b-8d09-fb71e0eb45ce None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.856667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de4931-024f-4d8b-8d09-fb71e0eb45ce None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.856979 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de4931-024f-4d8b-8d09-fb71e0eb45ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.890751 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c6de4931-024f-4d8b-8d09-fb71e0eb45ce None None] MFA Rules not processed for user `463767837e08493c88b933d8605259d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:29.892768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c6de4931-024f-4d8b-8d09-fb71e0eb45ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:29.928005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ac90b-4232-48d7-a01b-2ca416666c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:29.928700 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac90b-4232-48d7-a01b-2ca416666c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:29.928994 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac90b-4232-48d7-a01b-2ca416666c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:29.929271 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac90b-4232-48d7-a01b-2ca416666c9c admin admin] PATH_INFO: `/v3/projects/bacdcb388b014b5fa6994765565442f0/users/e6f6bb5056704e1aa045b54386d27d9f/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:29.947934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ac90b-4232-48d7-a01b-2ca416666c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacdcb388b014b5fa6994765565442f0, user_id=e6f6bb5056704e1aa045b54386d27d9f, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:29.952426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ac90b-4232-48d7-a01b-2ca416666c9c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:29.965999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1014/2021] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:29.966858 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de4931-024f-4d8b-8d09-fb71e0eb45ce None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:29.971805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c6de4931-024f-4d8b-8d09-fb71e0eb45ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:29.977618 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1008/2022] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:29 2022] PUT /identity/v3/projects/bacdcb388b014b5fa6994765565442f0/users/e6f6bb5056704e1aa045b54386d27d9f/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:29.978445 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ac90b-4232-48d7-a01b-2ca416666c9c admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:30.002214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de4931-024f-4d8b-8d09-fb71e0eb45ce None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:30.094665 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ac90b-4232-48d7-a01b-2ca416666c9c admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:30.103424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20a2df-ef3d-4e9e-8fb3-4b3a37b35433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:30.104059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20a2df-ef3d-4e9e-8fb3-4b3a37b35433 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.104344 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20a2df-ef3d-4e9e-8fb3-4b3a37b35433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.104622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20a2df-ef3d-4e9e-8fb3-4b3a37b35433 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.105581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20a2df-ef3d-4e9e-8fb3-4b3a37b35433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:30.107751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20a2df-ef3d-4e9e-8fb3-4b3a37b35433 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:30.117374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:30.118602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.119978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.120250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] PATH_INFO: `/v3/users/d8ab3ffa0c994512802268fed11fe880` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.122417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ab3ffa0c994512802268fed11fe880)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:30.124369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:30.163070 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1009/2023] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:29 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:30.165156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20a2df-ef3d-4e9e-8fb3-4b3a37b35433 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:30.179105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:30.193182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:30.228867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ab3ffa0c994512802268fed11fe880'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:30.242061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ab3ffa0c994512802268fed11fe880'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:30.259884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ab3ffa0c994512802268fed11fe880'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:30.260897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ab3ffa0c994512802268fed11fe880'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:30.261520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ab3ffa0c994512802268fed11fe880'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:30.280344 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20a2df-ef3d-4e9e-8fb3-4b3a37b35433 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:30.284819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1015/2024] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:29 2022] DELETE /identity/v3/users/d8ab3ffa0c994512802268fed11fe880 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:30.285768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:30.287317 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:30.375439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f9e4b-37ab-4d1e-9f7e-fdfe8771716e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:30.390814 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2eebe-7bf8-4c4b-aafb-86df359a97dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:30.391620 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2eebe-7bf8-4c4b-aafb-86df359a97dd admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.392000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2eebe-7bf8-4c4b-aafb-86df359a97dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.392359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2eebe-7bf8-4c4b-aafb-86df359a97dd admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.393146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2eebe-7bf8-4c4b-aafb-86df359a97dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:30.395187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2eebe-7bf8-4c4b-aafb-86df359a97dd admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:30.397717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6a395-6142-43a1-9ea5-a91136b01bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:30.398338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6a395-6142-43a1-9ea5-a91136b01bea admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.398618 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6a395-6142-43a1-9ea5-a91136b01bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.398887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6a395-6142-43a1-9ea5-a91136b01bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.399528 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6a395-6142-43a1-9ea5-a91136b01bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:30.401130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6a395-6142-43a1-9ea5-a91136b01bea admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:30.413654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1010/2025] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:30.423396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b808c-9734-4d61-8f4a-fc5915de1867 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.424527 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b808c-9734-4d61-8f4a-fc5915de1867 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.426576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b808c-9734-4d61-8f4a-fc5915de1867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.434316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1016/2026] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:30 2022] POST /identity/v3/users => generated 298 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:30.434316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2eebe-7bf8-4c4b-aafb-86df359a97dd admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:30.434316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-dea2eebe-7bf8-4c4b-aafb-86df359a97dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:30.450491 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7c8b808c-9734-4d61-8f4a-fc5915de1867 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:30.451695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7c8b808c-9734-4d61-8f4a-fc5915de1867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:30.453390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2eebe-7bf8-4c4b-aafb-86df359a97dd admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:30.459255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9905-46bb-4307-beec-e2eb6cf68c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:30.459940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1011/2027] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:30.460349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9905-46bb-4307-beec-e2eb6cf68c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.460636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9905-46bb-4307-beec-e2eb6cf68c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.460888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b808c-9734-4d61-8f4a-fc5915de1867 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:30.461005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9905-46bb-4307-beec-e2eb6cf68c94 admin admin] PATH_INFO: `/v3/projects/bacdcb388b014b5fa6994765565442f0/users/e6f6bb5056704e1aa045b54386d27d9f/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.462908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee9905-46bb-4307-beec-e2eb6cf68c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacdcb388b014b5fa6994765565442f0, user_id=e6f6bb5056704e1aa045b54386d27d9f, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:30.465951 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee9905-46bb-4307-beec-e2eb6cf68c94 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:30.470408 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b808c-9734-4d61-8f4a-fc5915de1867 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:30.475307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2d330-d67c-4499-9f46-111cda94d27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:30.475897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2d330-d67c-4499-9f46-111cda94d27f admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.476178 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2d330-d67c-4499-9f46-111cda94d27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.476449 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2d330-d67c-4499-9f46-111cda94d27f admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.477141 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2d330-d67c-4499-9f46-111cda94d27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:30.478705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2d330-d67c-4499-9f46-111cda94d27f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:30.490257 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1017/2028] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:30 2022] PUT /identity/v3/projects/bacdcb388b014b5fa6994765565442f0/users/e6f6bb5056704e1aa045b54386d27d9f/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:30.490257 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9905-46bb-4307-beec-e2eb6cf68c94 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:30.490522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1012/2029] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:30.491795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d2ee9905-46bb-4307-beec-e2eb6cf68c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:30.494007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91706d5-bac4-4586-b1ac-9ed535f65aa3 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.494530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91706d5-bac4-4586-b1ac-9ed535f65aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.494710 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91706d5-bac4-4586-b1ac-9ed535f65aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.526497 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f91706d5-bac4-4586-b1ac-9ed535f65aa3 None None] MFA Rules not processed for user `e6f6bb5056704e1aa045b54386d27d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:30.527956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f91706d5-bac4-4586-b1ac-9ed535f65aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:30.579267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9905-46bb-4307-beec-e2eb6cf68c94 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:30.584244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c44ec3-bb3a-4d2f-9c07-c3ed555a0ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:30.585190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c44ec3-bb3a-4d2f-9c07-c3ed555a0ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.585673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c44ec3-bb3a-4d2f-9c07-c3ed555a0ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.586644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c44ec3-bb3a-4d2f-9c07-c3ed555a0ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.623897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1013/2030] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:30.628286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91706d5-bac4-4586-b1ac-9ed535f65aa3 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:30.650098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:30.653620 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:30.707194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c44ec3-bb3a-4d2f-9c07-c3ed555a0ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:30.709976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c44ec3-bb3a-4d2f-9c07-c3ed555a0ff8 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:30.718364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91706d5-bac4-4586-b1ac-9ed535f65aa3 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:30.725815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a44d9-3714-4362-b645-957184f1b314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:30.726740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a44d9-3714-4362-b645-957184f1b314 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.727180 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a44d9-3714-4362-b645-957184f1b314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.727613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a44d9-3714-4362-b645-957184f1b314 admin admin] PATH_INFO: `/v3/projects/9124c47ccad64fddad700f56e527230f/users/916c6075257d45e6893b06886afc8a14/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.732735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1018/2031] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:30.734688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c44ec3-bb3a-4d2f-9c07-c3ed555a0ff8 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:30.740700 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c7c44ec3-bb3a-4d2f-9c07-c3ed555a0ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:30.763097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a44d9-3714-4362-b645-957184f1b314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9124c47ccad64fddad700f56e527230f, user_id=916c6075257d45e6893b06886afc8a14, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:30.766643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a44d9-3714-4362-b645-957184f1b314 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:30.801307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1014/2032] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:30 2022] PUT /identity/v3/projects/9124c47ccad64fddad700f56e527230f/users/916c6075257d45e6893b06886afc8a14/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:30.803720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a44d9-3714-4362-b645-957184f1b314 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:30.840374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c44ec3-bb3a-4d2f-9c07-c3ed555a0ff8 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:30.914070 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a44d9-3714-4362-b645-957184f1b314 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:30.920093 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408f1e3-af55-4039-a6ec-ba12d75127c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:30.921046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408f1e3-af55-4039-a6ec-ba12d75127c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.921432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408f1e3-af55-4039-a6ec-ba12d75127c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.921807 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408f1e3-af55-4039-a6ec-ba12d75127c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.922562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408f1e3-af55-4039-a6ec-ba12d75127c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:30.924003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88032e-2818-4f6b-b2c4-cdd685b058c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:30.924607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408f1e3-af55-4039-a6ec-ba12d75127c7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:30.925250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88032e-2818-4f6b-b2c4-cdd685b058c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.925539 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88032e-2818-4f6b-b2c4-cdd685b058c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.925820 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88032e-2818-4f6b-b2c4-cdd685b058c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.928453 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2f88032e-2818-4f6b-b2c4-cdd685b058c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:30.940888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1015/2033] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:30.945129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408f1e3-af55-4039-a6ec-ba12d75127c7 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:30.955363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408f1e3-af55-4039-a6ec-ba12d75127c7 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:30.960854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34bcf3-c789-447a-9341-d0f6576bc24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:30.961598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34bcf3-c789-447a-9341-d0f6576bc24f admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.961956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34bcf3-c789-447a-9341-d0f6576bc24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.962233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34bcf3-c789-447a-9341-d0f6576bc24f admin admin] PATH_INFO: `/v3/projects/9124c47ccad64fddad700f56e527230f/users/916c6075257d45e6893b06886afc8a14/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:30.964176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34bcf3-c789-447a-9341-d0f6576bc24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9124c47ccad64fddad700f56e527230f, user_id=916c6075257d45e6893b06886afc8a14, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:30.966967 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34bcf3-c789-447a-9341-d0f6576bc24f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:30.979222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1016/2034] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:30 2022] PUT /identity/v3/projects/9124c47ccad64fddad700f56e527230f/users/916c6075257d45e6893b06886afc8a14/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:30.994086 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aefdb-435e-460d-803b-d28a95bd7b49 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:30.994086 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aefdb-435e-460d-803b-d28a95bd7b49 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:30.994086 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aefdb-435e-460d-803b-d28a95bd7b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:31.022359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88032e-2818-4f6b-b2c4-cdd685b058c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:31.027287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88032e-2818-4f6b-b2c4-cdd685b058c6 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:31.036861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-6c4aefdb-435e-460d-803b-d28a95bd7b49 None None] MFA Rules not processed for user `916c6075257d45e6893b06886afc8a14`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:31.040822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6c4aefdb-435e-460d-803b-d28a95bd7b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:31.041856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1019/2035] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:31.180001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88032e-2818-4f6b-b2c4-cdd685b058c6 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:31.181450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2f88032e-2818-4f6b-b2c4-cdd685b058c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:31.190800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1017/2036] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:31.217834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88032e-2818-4f6b-b2c4-cdd685b058c6 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:31.283962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:31.309733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:31.310397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:31.310736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:31.311020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] PATH_INFO: `/v3/projects/9b4f743915154640929a55cc8bdc8c67` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:31.312859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4f743915154640929a55cc8bdc8c67)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:31.316277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:31.338439 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4aefdb-435e-460d-803b-d28a95bd7b49 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:31.340092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6c4aefdb-435e-460d-803b-d28a95bd7b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:31.363058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:31.427558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4f743915154640929a55cc8bdc8c67', 'request_id': 'req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:31.446051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4f743915154640929a55cc8bdc8c67', 'request_id': 'req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:31.448159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4aefdb-435e-460d-803b-d28a95bd7b49 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:31.457141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4f743915154640929a55cc8bdc8c67', 'request_id': 'req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:31.477471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] The token cache is being invalidate because project 9b4f743915154640929a55cc8bdc8c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:31.478245 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:31.483764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:31.488808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1020/2037] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:31 2022] DELETE /identity/v3/projects/9b4f743915154640929a55cc8bdc8c67 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:31.489904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:31.491807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:31.547950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef211c-4f8c-4383-9050-c7f21c4a19a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:31.548621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef211c-4f8c-4383-9050-c7f21c4a19a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:31.548950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef211c-4f8c-4383-9050-c7f21c4a19a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:31.549275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef211c-4f8c-4383-9050-c7f21c4a19a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:31.551535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-73ef211c-4f8c-4383-9050-c7f21c4a19a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:31.633958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f68d63-32ff-4b2d-9424-f9763ff6cf16 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:31.652578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:31.653323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:31.653606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:31.653886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] PATH_INFO: `/v3/users/c34f4117c42a45baa15526563781b2df` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:31.671288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34f4117c42a45baa15526563781b2df)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:31.673397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:31.683274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef211c-4f8c-4383-9050-c7f21c4a19a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:31.685243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef211c-4f8c-4383-9050-c7f21c4a19a8 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:31.701689 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1018/2038] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:31.734516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34f4117c42a45baa15526563781b2df'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:31.742528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34f4117c42a45baa15526563781b2df'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:31.756071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34f4117c42a45baa15526563781b2df'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:31.757133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34f4117c42a45baa15526563781b2df'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:31.757877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34f4117c42a45baa15526563781b2df'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:31.764360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:31.774820 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1021/2039] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:31 2022] DELETE /identity/v3/users/c34f4117c42a45baa15526563781b2df => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:31.805184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef211c-4f8c-4383-9050-c7f21c4a19a8 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:31.807356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-73ef211c-4f8c-4383-9050-c7f21c4a19a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:31.819881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef211c-4f8c-4383-9050-c7f21c4a19a8 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:31.885986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9856686-85ff-4700-a350-6932144bd396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:31.886973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9856686-85ff-4700-a350-6932144bd396 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:31.887318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9856686-85ff-4700-a350-6932144bd396 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:31.887595 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9856686-85ff-4700-a350-6932144bd396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:31.889671 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b9856686-85ff-4700-a350-6932144bd396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:31.927150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:31.967877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9856686-85ff-4700-a350-6932144bd396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:31.969898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9856686-85ff-4700-a350-6932144bd396 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:31.981404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1019/2040] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:32.118043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:32.119723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:32.199597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451fa9f-f9cb-46d3-97a5-fba7d187c737 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:32.205620 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60456c-958b-43fc-8684-aec87e123911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:32.206117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60456c-958b-43fc-8684-aec87e123911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.206396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60456c-958b-43fc-8684-aec87e123911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.209640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60456c-958b-43fc-8684-aec87e123911 admin admin] PATH_INFO: `/v3/projects/8fc9fd611e124f4b8908ac4f33075a44` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:32.221260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60456c-958b-43fc-8684-aec87e123911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc9fd611e124f4b8908ac4f33075a44)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:32.225636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60456c-958b-43fc-8684-aec87e123911 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:32.281301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-ac60456c-958b-43fc-8684-aec87e123911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc9fd611e124f4b8908ac4f33075a44', 'request_id': 'req-ac60456c-958b-43fc-8684-aec87e123911'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:32.283730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9856686-85ff-4700-a350-6932144bd396 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:32.285364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b9856686-85ff-4700-a350-6932144bd396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:32.288737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-ac60456c-958b-43fc-8684-aec87e123911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc9fd611e124f4b8908ac4f33075a44', 'request_id': 'req-ac60456c-958b-43fc-8684-aec87e123911'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:32.297569 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-ac60456c-958b-43fc-8684-aec87e123911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc9fd611e124f4b8908ac4f33075a44', 'request_id': 'req-ac60456c-958b-43fc-8684-aec87e123911'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:32.300429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9856686-85ff-4700-a350-6932144bd396 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:32.310292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-ac60456c-958b-43fc-8684-aec87e123911 admin admin] The token cache is being invalidate because project 8fc9fd611e124f4b8908ac4f33075a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:32.310668 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-ac60456c-958b-43fc-8684-aec87e123911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:32.311375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-ac60456c-958b-43fc-8684-aec87e123911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:32.313043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1022/2041] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:32 2022] DELETE /identity/v3/projects/8fc9fd611e124f4b8908ac4f33075a44 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:32.319000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15099b-27b1-4e3e-90cd-baa7760e1c0a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.319286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15099b-27b1-4e3e-90cd-baa7760e1c0a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.319597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15099b-27b1-4e3e-90cd-baa7760e1c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:32.341851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-2e15099b-27b1-4e3e-90cd-baa7760e1c0a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:32.343838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2e15099b-27b1-4e3e-90cd-baa7760e1c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:32.368635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab725bcd-6d60-45c4-9957-7d1531f3bb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:32.369148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab725bcd-6d60-45c4-9957-7d1531f3bb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.369420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab725bcd-6d60-45c4-9957-7d1531f3bb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.369697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab725bcd-6d60-45c4-9957-7d1531f3bb3e admin admin] PATH_INFO: `/v3/users/463767837e08493c88b933d8605259d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:32.370823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab725bcd-6d60-45c4-9957-7d1531f3bb3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=463767837e08493c88b933d8605259d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:32.372921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab725bcd-6d60-45c4-9957-7d1531f3bb3e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:32.418334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1023/2042] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:32.424441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ab725bcd-6d60-45c4-9957-7d1531f3bb3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463767837e08493c88b933d8605259d4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:32.427528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eadf44-fffd-4c49-8809-985c27988d39 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.428093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eadf44-fffd-4c49-8809-985c27988d39 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.428093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eadf44-fffd-4c49-8809-985c27988d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:32.435539 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ab725bcd-6d60-45c4-9957-7d1531f3bb3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463767837e08493c88b933d8605259d4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:32.436429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ab725bcd-6d60-45c4-9957-7d1531f3bb3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463767837e08493c88b933d8605259d4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:32.437349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ab725bcd-6d60-45c4-9957-7d1531f3bb3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463767837e08493c88b933d8605259d4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:32.450539 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-41eadf44-fffd-4c49-8809-985c27988d39 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:32.451985 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-41eadf44-fffd-4c49-8809-985c27988d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:32.457267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-ab725bcd-6d60-45c4-9957-7d1531f3bb3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463767837e08493c88b933d8605259d4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:32.460889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1024/2043] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:32.465053 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eadf44-fffd-4c49-8809-985c27988d39 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:32.474914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eadf44-fffd-4c49-8809-985c27988d39 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:32.475856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1020/2044] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:32 2022] DELETE /identity/v3/users/463767837e08493c88b933d8605259d4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:32.480386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c6f78-e0d4-4de9-930b-9fc6ccd9456c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.480879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c6f78-e0d4-4de9-930b-9fc6ccd9456c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.481331 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c6f78-e0d4-4de9-930b-9fc6ccd9456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:32.491745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:32.503657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-883c6f78-e0d4-4de9-930b-9fc6ccd9456c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:32.506063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-883c6f78-e0d4-4de9-930b-9fc6ccd9456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:32.547980 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cc5bb-3c59-4e6a-9337-4fb00ed0ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:32.548591 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc5bb-3c59-4e6a-9337-4fb00ed0ef00 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.549031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc5bb-3c59-4e6a-9337-4fb00ed0ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.549201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc5bb-3c59-4e6a-9337-4fb00ed0ef00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:32.549908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cc5bb-3c59-4e6a-9337-4fb00ed0ef00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:32.550272 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cc5bb-3c59-4e6a-9337-4fb00ed0ef00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:32.551901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cc5bb-3c59-4e6a-9337-4fb00ed0ef00 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:32.563917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:32.566318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1025/2045] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:11:32.571561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cc5bb-3c59-4e6a-9337-4fb00ed0ef00 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:32.584886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cc5bb-3c59-4e6a-9337-4fb00ed0ef00 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:32.586945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1021/2046] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:32.590004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058f94a-3671-4e79-8f7f-3f8294d76f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:32.590757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058f94a-3671-4e79-8f7f-3f8294d76f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.590925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058f94a-3671-4e79-8f7f-3f8294d76f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.591165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058f94a-3671-4e79-8f7f-3f8294d76f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:32.591814 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058f94a-3671-4e79-8f7f-3f8294d76f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:32.593808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058f94a-3671-4e79-8f7f-3f8294d76f85 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:32.597428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c6f78-e0d4-4de9-930b-9fc6ccd9456c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:32.600172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-883c6f78-e0d4-4de9-930b-9fc6ccd9456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:32.647297 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1026/2047] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:32 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:32.667620 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058f94a-3671-4e79-8f7f-3f8294d76f85 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:32.720930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c6f78-e0d4-4de9-930b-9fc6ccd9456c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:32.741193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058f94a-3671-4e79-8f7f-3f8294d76f85 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:32.753394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24747e-23f3-4e64-9c2a-6684f46e898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:32.754033 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24747e-23f3-4e64-9c2a-6684f46e898c admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.754321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24747e-23f3-4e64-9c2a-6684f46e898c admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.754615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24747e-23f3-4e64-9c2a-6684f46e898c admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:32.756199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24747e-23f3-4e64-9c2a-6684f46e898c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:32.760800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24747e-23f3-4e64-9c2a-6684f46e898c admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:32.823345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1027/2048] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:32 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:32.824280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24747e-23f3-4e64-9c2a-6684f46e898c admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:32.842477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e76d1b-d53a-433c-8ba3-0665916b3579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:32.843161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e76d1b-d53a-433c-8ba3-0665916b3579 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.843314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e76d1b-d53a-433c-8ba3-0665916b3579 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.843587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e76d1b-d53a-433c-8ba3-0665916b3579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:32.849042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24747e-23f3-4e64-9c2a-6684f46e898c admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:32.854785 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691c322-73f8-4aa9-accb-251c848360c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:32.855519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691c322-73f8-4aa9-accb-251c848360c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.855895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691c322-73f8-4aa9-accb-251c848360c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.856384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691c322-73f8-4aa9-accb-251c848360c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:32.857545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691c322-73f8-4aa9-accb-251c848360c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:32.860045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691c322-73f8-4aa9-accb-251c848360c0 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:32.861416 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e76d1b-d53a-433c-8ba3-0665916b3579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:32.863949 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e76d1b-d53a-433c-8ba3-0665916b3579 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:32.876729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1028/2049] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:32.879879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1022/2050] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:32.882902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691c322-73f8-4aa9-accb-251c848360c0 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:32.894666 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691c322-73f8-4aa9-accb-251c848360c0 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:32.899884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ea23-d5e6-44e1-a9c2-35b215ac1c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:32.900507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ea23-d5e6-44e1-a9c2-35b215ac1c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.900849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ea23-d5e6-44e1-a9c2-35b215ac1c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.901134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ea23-d5e6-44e1-a9c2-35b215ac1c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:32.901826 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311ea23-d5e6-44e1-a9c2-35b215ac1c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:32.903695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311ea23-d5e6-44e1-a9c2-35b215ac1c46 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:32.916483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1029/2051] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:32.920760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e76d1b-d53a-433c-8ba3-0665916b3579 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:32.932507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e76d1b-d53a-433c-8ba3-0665916b3579 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:32.938164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8b00c-2e29-4339-bda3-eb3776e5d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:32.938852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8b00c-2e29-4339-bda3-eb3776e5d06c admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.939321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8b00c-2e29-4339-bda3-eb3776e5d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.939610 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8b00c-2e29-4339-bda3-eb3776e5d06c admin admin] PATH_INFO: `/v3/projects/214e95a338be4389ab1d905498e1b9c1/users/a282e1c4f70b4a60b03cf51500c1fa47/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:32.958740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8b00c-2e29-4339-bda3-eb3776e5d06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=214e95a338be4389ab1d905498e1b9c1, user_id=a282e1c4f70b4a60b03cf51500c1fa47, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:32.961871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8b00c-2e29-4339-bda3-eb3776e5d06c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:32.985768 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1023/2052] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:32 2022] PUT /identity/v3/projects/214e95a338be4389ab1d905498e1b9c1/users/a282e1c4f70b4a60b03cf51500c1fa47/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:32.996959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3c95d-3e1b-43a9-a65d-f29188f74413 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:32.997384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3c95d-3e1b-43a9-a65d-f29188f74413 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:32.997754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3c95d-3e1b-43a9-a65d-f29188f74413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:33.041191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-cdf3c95d-3e1b-43a9-a65d-f29188f74413 None None] MFA Rules not processed for user `a282e1c4f70b4a60b03cf51500c1fa47`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:33.043238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-cdf3c95d-3e1b-43a9-a65d-f29188f74413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:33.146792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:33.184732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1030/2053] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:33.189829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8b00c-2e29-4339-bda3-eb3776e5d06c admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:33.305749 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8b00c-2e29-4339-bda3-eb3776e5d06c admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:33.312788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115aeeb4-2df9-4701-ae73-87a3e8a9f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:33.313585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aeeb4-2df9-4701-ae73-87a3e8a9f877 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:33.314098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aeeb4-2df9-4701-ae73-87a3e8a9f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:33.314912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aeeb4-2df9-4701-ae73-87a3e8a9f877 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:33.316035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115aeeb4-2df9-4701-ae73-87a3e8a9f877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:33.320441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115aeeb4-2df9-4701-ae73-87a3e8a9f877 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:33.406053 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1024/2054] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:33 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:33.410227 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3c95d-3e1b-43a9-a65d-f29188f74413 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:33.422576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3c95d-3e1b-43a9-a65d-f29188f74413 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:33.512874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767f145-650e-4336-9aa5-1d8ef9ce2f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:33.513834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767f145-650e-4336-9aa5-1d8ef9ce2f1e admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:33.514406 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767f145-650e-4336-9aa5-1d8ef9ce2f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:33.514767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767f145-650e-4336-9aa5-1d8ef9ce2f1e admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:33.515938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767f145-650e-4336-9aa5-1d8ef9ce2f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:33.518958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767f145-650e-4336-9aa5-1d8ef9ce2f1e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:33.544525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115aeeb4-2df9-4701-ae73-87a3e8a9f877 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:33.547312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-115aeeb4-2df9-4701-ae73-87a3e8a9f877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:33.566699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115aeeb4-2df9-4701-ae73-87a3e8a9f877 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:33.570932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1031/2055] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:33 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:33.581008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:33.582099 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:33.582529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:33.583028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] PATH_INFO: `/v3/projects/0440cf9f5b7e4ec9bf869538f69f2764` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:33.586031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0440cf9f5b7e4ec9bf869538f69f2764)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:33.586504 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767f145-650e-4336-9aa5-1d8ef9ce2f1e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:33.588978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:33.592914 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:33.603148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767f145-650e-4336-9aa5-1d8ef9ce2f1e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:33.646169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d27426-f258-4400-b2fb-454389a94481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:33.647021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d27426-f258-4400-b2fb-454389a94481 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:33.647482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d27426-f258-4400-b2fb-454389a94481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:33.647963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d27426-f258-4400-b2fb-454389a94481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:33.649079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d27426-f258-4400-b2fb-454389a94481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:33.651775 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d27426-f258-4400-b2fb-454389a94481 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:33.674445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1032/2056] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:33.675773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d27426-f258-4400-b2fb-454389a94481 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:33.692222 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d27426-f258-4400-b2fb-454389a94481 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:33.710183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0440cf9f5b7e4ec9bf869538f69f2764', 'request_id': 'req-47cb7900-6aff-4379-a55d-b7808546d6e7'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:33.723334 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0440cf9f5b7e4ec9bf869538f69f2764', 'request_id': 'req-47cb7900-6aff-4379-a55d-b7808546d6e7'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:33.732925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0440cf9f5b7e4ec9bf869538f69f2764', 'request_id': 'req-47cb7900-6aff-4379-a55d-b7808546d6e7'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:33.751585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] The token cache is being invalidate because project 0440cf9f5b7e4ec9bf869538f69f2764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:33.751946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:33.752726 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:33.754671 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1025/2057] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:33 2022] DELETE /identity/v3/projects/0440cf9f5b7e4ec9bf869538f69f2764 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:33.758733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:33.760315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:33.775029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadd689-1c01-4d81-9943-9f793bb7245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:33.776332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadd689-1c01-4d81-9943-9f793bb7245d admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:33.776332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadd689-1c01-4d81-9943-9f793bb7245d admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:33.776821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadd689-1c01-4d81-9943-9f793bb7245d admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:33.777259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadd689-1c01-4d81-9943-9f793bb7245d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:33.778765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadd689-1c01-4d81-9943-9f793bb7245d admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:33.791855 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1033/2058] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:33.796788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadd689-1c01-4d81-9943-9f793bb7245d admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:33.798972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2dadd689-1c01-4d81-9943-9f793bb7245d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:33.820309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadd689-1c01-4d81-9943-9f793bb7245d admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:33.826034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e392536-c68c-41b9-b3d1-e12824915475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:33.826884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e392536-c68c-41b9-b3d1-e12824915475 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:33.827487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e392536-c68c-41b9-b3d1-e12824915475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:33.827627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e392536-c68c-41b9-b3d1-e12824915475 admin admin] PATH_INFO: `/v3/projects/01bf0a3e799c4b09a5dc8413a5ceb9d6/users/38a62d97367f411c9dc9bb86c1c008aa/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:33.840117 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb7900-6aff-4379-a55d-b7808546d6e7 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:33.844804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e392536-c68c-41b9-b3d1-e12824915475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bf0a3e799c4b09a5dc8413a5ceb9d6, user_id=38a62d97367f411c9dc9bb86c1c008aa, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:33.844926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:33.845465 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:33.845742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:33.846013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] PATH_INFO: `/v3/users/916c6075257d45e6893b06886afc8a14` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:33.847139 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=916c6075257d45e6893b06886afc8a14)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:33.849857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e392536-c68c-41b9-b3d1-e12824915475 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:33.850731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:33.867545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1034/2059] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:33 2022] PUT /identity/v3/projects/01bf0a3e799c4b09a5dc8413a5ceb9d6/users/38a62d97367f411c9dc9bb86c1c008aa/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:33.881610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be7749-65ba-4233-b018-8c633d1c6a19 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:33.881887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be7749-65ba-4233-b018-8c633d1c6a19 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:33.882180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be7749-65ba-4233-b018-8c633d1c6a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:33.908989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916c6075257d45e6893b06886afc8a14'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:33.913717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e1be7749-65ba-4233-b018-8c633d1c6a19 None None] MFA Rules not processed for user `38a62d97367f411c9dc9bb86c1c008aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:33.915094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e1be7749-65ba-4233-b018-8c633d1c6a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:33.920722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916c6075257d45e6893b06886afc8a14'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:33.921348 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916c6075257d45e6893b06886afc8a14'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:33.921980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916c6075257d45e6893b06886afc8a14'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:33.935939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916c6075257d45e6893b06886afc8a14'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:33.944704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:33.950662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1026/2060] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:33 2022] DELETE /identity/v3/users/916c6075257d45e6893b06886afc8a14 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:33.996573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1035/2061] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:34.001645 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:34.003156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:34.018398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:34.085766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d6256-664c-4c0f-9b59-a02ed99612ba admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:34.091137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c50f6-8fc2-41ca-b33c-44a75ac9cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:34.091751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c50f6-8fc2-41ca-b33c-44a75ac9cb4a admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:34.092468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c50f6-8fc2-41ca-b33c-44a75ac9cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:34.092783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c50f6-8fc2-41ca-b33c-44a75ac9cb4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:34.093441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c50f6-8fc2-41ca-b33c-44a75ac9cb4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:34.095404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c50f6-8fc2-41ca-b33c-44a75ac9cb4a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:34.126878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1027/2062] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:33 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:34.131187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be7749-65ba-4233-b018-8c633d1c6a19 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:34.198602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be7749-65ba-4233-b018-8c633d1c6a19 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:34.266289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275c0c0-347b-4773-8960-f109f7d0723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:34.266909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c0c0-347b-4773-8960-f109f7d0723a admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:34.267190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c0c0-347b-4773-8960-f109f7d0723a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:34.267465 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c0c0-347b-4773-8960-f109f7d0723a admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:34.268120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275c0c0-347b-4773-8960-f109f7d0723a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:34.270089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275c0c0-347b-4773-8960-f109f7d0723a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:34.287576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c50f6-8fc2-41ca-b33c-44a75ac9cb4a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:34.290769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-758c50f6-8fc2-41ca-b33c-44a75ac9cb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:34.295781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1036/2063] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:34 2022] POST /identity/v3/users => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:34.296827 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275c0c0-347b-4773-8960-f109f7d0723a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:34.310282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c50f6-8fc2-41ca-b33c-44a75ac9cb4a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:34.311062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275c0c0-347b-4773-8960-f109f7d0723a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:34.316111 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfd6cf-1757-4556-a9a6-b768392b915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:34.316922 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfd6cf-1757-4556-a9a6-b768392b915d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:34.317288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfd6cf-1757-4556-a9a6-b768392b915d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:34.318169 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfd6cf-1757-4556-a9a6-b768392b915d admin admin] PATH_INFO: `/v3/projects/9124c47ccad64fddad700f56e527230f` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:34.319958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfd6cf-1757-4556-a9a6-b768392b915d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9124c47ccad64fddad700f56e527230f)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:34.321102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dbd35-830d-4610-86aa-9bdf97899605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:34.321716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dbd35-830d-4610-86aa-9bdf97899605 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:34.321998 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dbd35-830d-4610-86aa-9bdf97899605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:34.322152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfd6cf-1757-4556-a9a6-b768392b915d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:34.322287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dbd35-830d-4610-86aa-9bdf97899605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:34.326014 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dbd35-830d-4610-86aa-9bdf97899605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:34.329488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dbd35-830d-4610-86aa-9bdf97899605 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:34.346798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1037/2064] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:34.350867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dbd35-830d-4610-86aa-9bdf97899605 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:34.374401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dbd35-830d-4610-86aa-9bdf97899605 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:34.416631 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9bdfd6cf-1757-4556-a9a6-b768392b915d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9124c47ccad64fddad700f56e527230f', 'request_id': 'req-9bdfd6cf-1757-4556-a9a6-b768392b915d'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:34.427894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9bdfd6cf-1757-4556-a9a6-b768392b915d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9124c47ccad64fddad700f56e527230f', 'request_id': 'req-9bdfd6cf-1757-4556-a9a6-b768392b915d'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:34.434760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9bdfd6cf-1757-4556-a9a6-b768392b915d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9124c47ccad64fddad700f56e527230f', 'request_id': 'req-9bdfd6cf-1757-4556-a9a6-b768392b915d'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:34.448794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9bdfd6cf-1757-4556-a9a6-b768392b915d admin admin] The token cache is being invalidate because project 9124c47ccad64fddad700f56e527230f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:34.449181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9bdfd6cf-1757-4556-a9a6-b768392b915d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:34.449911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9bdfd6cf-1757-4556-a9a6-b768392b915d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:34.452735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1028/2065] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:34 2022] DELETE /identity/v3/projects/9124c47ccad64fddad700f56e527230f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:34.456541 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a395b-6d43-4eb8-a56d-f8415d2cf655 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:34.456925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a395b-6d43-4eb8-a56d-f8415d2cf655 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:34.457260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a395b-6d43-4eb8-a56d-f8415d2cf655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:34.483282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7f1a395b-6d43-4eb8-a56d-f8415d2cf655 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:34.484517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7f1a395b-6d43-4eb8-a56d-f8415d2cf655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:34.487118 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:34.498418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ecec0-399c-49cd-b0bc-15060f65bf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:34.498951 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ecec0-399c-49cd-b0bc-15060f65bf16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:34.499237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ecec0-399c-49cd-b0bc-15060f65bf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:34.499518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ecec0-399c-49cd-b0bc-15060f65bf16 admin admin] PATH_INFO: `/v3/projects/95597889911b4dc2a1b381581e251741/users/79a8c67c9d7d4dca9be4d3c527cfbb58/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:34.518334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ecec0-399c-49cd-b0bc-15060f65bf16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95597889911b4dc2a1b381581e251741, user_id=79a8c67c9d7d4dca9be4d3c527cfbb58, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:34.529099 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ecec0-399c-49cd-b0bc-15060f65bf16 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:34.551419 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1038/2066] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:34 2022] PUT /identity/v3/projects/95597889911b4dc2a1b381581e251741/users/79a8c67c9d7d4dca9be4d3c527cfbb58/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:34.556336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ecec0-399c-49cd-b0bc-15060f65bf16 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:34.559058 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-377ecec0-399c-49cd-b0bc-15060f65bf16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:34.593625 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1029/2067] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:34.604159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257ee25-3678-43fb-a691-e26446bc03c5 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:34.604460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257ee25-3678-43fb-a691-e26446bc03c5 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:34.604818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257ee25-3678-43fb-a691-e26446bc03c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:34.632084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7257ee25-3678-43fb-a691-e26446bc03c5 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:34.633817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7257ee25-3678-43fb-a691-e26446bc03c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:34.648995 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:34.679512 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ecec0-399c-49cd-b0bc-15060f65bf16 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:34.684192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9225f0-44c0-4b64-8ca9-909748b651e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:34.684820 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9225f0-44c0-4b64-8ca9-909748b651e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:34.685100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9225f0-44c0-4b64-8ca9-909748b651e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:34.685371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9225f0-44c0-4b64-8ca9-909748b651e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:34.686028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9225f0-44c0-4b64-8ca9-909748b651e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:34.687627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9225f0-44c0-4b64-8ca9-909748b651e2 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:34.699442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1039/2068] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:34.703515 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9225f0-44c0-4b64-8ca9-909748b651e2 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:34.714299 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9225f0-44c0-4b64-8ca9-909748b651e2 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:34.719504 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbcfd0-e0bd-4f19-835a-53dec213c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:34.720259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbcfd0-e0bd-4f19-835a-53dec213c65c admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:34.720543 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbcfd0-e0bd-4f19-835a-53dec213c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:34.720850 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbcfd0-e0bd-4f19-835a-53dec213c65c admin admin] PATH_INFO: `/v3/projects/95597889911b4dc2a1b381581e251741/users/79a8c67c9d7d4dca9be4d3c527cfbb58/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:34.721519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1030/2069] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:34.726841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257ee25-3678-43fb-a691-e26446bc03c5 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:34.727637 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbcfd0-e0bd-4f19-835a-53dec213c65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95597889911b4dc2a1b381581e251741, user_id=79a8c67c9d7d4dca9be4d3c527cfbb58, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:34.732933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbcfd0-e0bd-4f19-835a-53dec213c65c admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:34.740271 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257ee25-3678-43fb-a691-e26446bc03c5 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:34.750764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1040/2070] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:34 2022] PUT /identity/v3/projects/95597889911b4dc2a1b381581e251741/users/79a8c67c9d7d4dca9be4d3c527cfbb58/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:34.763345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4d3c1-e042-4d36-9b41-4e9fc55dc92a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:34.763345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4d3c1-e042-4d36-9b41-4e9fc55dc92a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:34.763345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4d3c1-e042-4d36-9b41-4e9fc55dc92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:34.801736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-83a4d3c1-e042-4d36-9b41-4e9fc55dc92a None None] MFA Rules not processed for user `79a8c67c9d7d4dca9be4d3c527cfbb58`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:34.804122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-83a4d3c1-e042-4d36-9b41-4e9fc55dc92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:34.839929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575907a-a14a-4374-bf5d-548834bd6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:34.841207 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575907a-a14a-4374-bf5d-548834bd6474 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:34.841706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575907a-a14a-4374-bf5d-548834bd6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:34.842427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575907a-a14a-4374-bf5d-548834bd6474 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:34.845521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575907a-a14a-4374-bf5d-548834bd6474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:34.847330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575907a-a14a-4374-bf5d-548834bd6474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:34.849150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575907a-a14a-4374-bf5d-548834bd6474 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:34.868165 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1031/2071] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:11:34.869358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575907a-a14a-4374-bf5d-548834bd6474 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:34.890168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575907a-a14a-4374-bf5d-548834bd6474 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:34.900724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0addb-93c6-4cb0-a5d7-ede8bb9c4af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:34.902775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0addb-93c6-4cb0-a5d7-ede8bb9c4af0 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:34.904419 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0addb-93c6-4cb0-a5d7-ede8bb9c4af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:34.904502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0addb-93c6-4cb0-a5d7-ede8bb9c4af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:34.905161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0addb-93c6-4cb0-a5d7-ede8bb9c4af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:34.908281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0addb-93c6-4cb0-a5d7-ede8bb9c4af0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:34.915766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1041/2072] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:34.951432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1032/2073] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:34 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:34.952932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4d3c1-e042-4d36-9b41-4e9fc55dc92a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:34.973228 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4d3c1-e042-4d36-9b41-4e9fc55dc92a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:34.989568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0addb-93c6-4cb0-a5d7-ede8bb9c4af0 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:34.991669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-72b0addb-93c6-4cb0-a5d7-ede8bb9c4af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:35.029860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:35.071872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152803c-5157-4e69-8621-af237c4d8d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:35.072496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152803c-5157-4e69-8621-af237c4d8d10 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:35.072968 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152803c-5157-4e69-8621-af237c4d8d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:35.073257 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152803c-5157-4e69-8621-af237c4d8d10 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:35.074052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152803c-5157-4e69-8621-af237c4d8d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:35.076800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152803c-5157-4e69-8621-af237c4d8d10 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:35.087222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0addb-93c6-4cb0-a5d7-ede8bb9c4af0 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:35.092783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac500c2-086b-4c20-a704-9c0c1ecab27d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:35.093879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac500c2-086b-4c20-a704-9c0c1ecab27d service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:35.093879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac500c2-086b-4c20-a704-9c0c1ecab27d service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:35.095624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac500c2-086b-4c20-a704-9c0c1ecab27d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:35.098337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-bac500c2-086b-4c20-a704-9c0c1ecab27d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:35.103913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1042/2074] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:34 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:35.107583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152803c-5157-4e69-8621-af237c4d8d10 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:35.125959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152803c-5157-4e69-8621-af237c4d8d10 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:35.133894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d885a-559d-496c-aad7-9c33cfa63e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:35.134622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d885a-559d-496c-aad7-9c33cfa63e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:35.135013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d885a-559d-496c-aad7-9c33cfa63e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:35.135394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d885a-559d-496c-aad7-9c33cfa63e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:35.136155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d885a-559d-496c-aad7-9c33cfa63e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:35.138241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d885a-559d-496c-aad7-9c33cfa63e24 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:35.150445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1043/2075] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:35.154749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d885a-559d-496c-aad7-9c33cfa63e24 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:35.167520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d885a-559d-496c-aad7-9c33cfa63e24 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:35.172962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034863a1-72dc-4ec1-98b6-77759e42f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:35.173707 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034863a1-72dc-4ec1-98b6-77759e42f2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:35.174359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034863a1-72dc-4ec1-98b6-77759e42f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:35.174651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034863a1-72dc-4ec1-98b6-77759e42f2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:35.175065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:35.175634 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034863a1-72dc-4ec1-98b6-77759e42f2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:35.177139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034863a1-72dc-4ec1-98b6-77759e42f2c3 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:35.193081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1044/2076] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:35.194100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034863a1-72dc-4ec1-98b6-77759e42f2c3 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:35.200753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac500c2-086b-4c20-a704-9c0c1ecab27d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:35.203411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac500c2-086b-4c20-a704-9c0c1ecab27d service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:35.215094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034863a1-72dc-4ec1-98b6-77759e42f2c3 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:35.221316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac3935-0776-4f81-9c8f-d53d9abe1592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:35.221528 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1033/2077] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:35.222412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac3935-0776-4f81-9c8f-d53d9abe1592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:35.222796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac3935-0776-4f81-9c8f-d53d9abe1592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:35.224318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac3935-0776-4f81-9c8f-d53d9abe1592 admin admin] PATH_INFO: `/v3/projects/72bdb66df0a0428b811834c5185fcd6e/users/87dd3b1f8b4d46f0a9c076ab708bb870/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:35.229852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac500c2-086b-4c20-a704-9c0c1ecab27d service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:35.233391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-bac500c2-086b-4c20-a704-9c0c1ecab27d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:35.245381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac3935-0776-4f81-9c8f-d53d9abe1592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bdb66df0a0428b811834c5185fcd6e, user_id=87dd3b1f8b4d46f0a9c076ab708bb870, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:35.248304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac3935-0776-4f81-9c8f-d53d9abe1592 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:35.254569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac500c2-086b-4c20-a704-9c0c1ecab27d service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:35.259740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64a776-cd74-4604-89d9-987014db99bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:35.260421 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64a776-cd74-4604-89d9-987014db99bd service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:35.260740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64a776-cd74-4604-89d9-987014db99bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:35.261164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64a776-cd74-4604-89d9-987014db99bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:35.263463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-fc64a776-cd74-4604-89d9-987014db99bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:35.267807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1045/2078] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:35 2022] PUT /identity/v3/projects/72bdb66df0a0428b811834c5185fcd6e/users/87dd3b1f8b4d46f0a9c076ab708bb870/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:35.278455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc18d-ba3a-46a8-aa21-f7472e1508c1 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:35.278738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc18d-ba3a-46a8-aa21-f7472e1508c1 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:35.280211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc18d-ba3a-46a8-aa21-f7472e1508c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:35.311675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-06ebc18d-ba3a-46a8-aa21-f7472e1508c1 None None] MFA Rules not processed for user `87dd3b1f8b4d46f0a9c076ab708bb870`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:35.322884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-06ebc18d-ba3a-46a8-aa21-f7472e1508c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:35.375081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64a776-cd74-4604-89d9-987014db99bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:35.377607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64a776-cd74-4604-89d9-987014db99bd service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:35.390841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1034/2079] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:35.421908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1046/2080] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:35.546413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64a776-cd74-4604-89d9-987014db99bd service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:35.566008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64a776-cd74-4604-89d9-987014db99bd service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:35.630639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669d5c8-0ee1-424f-9b7c-2aae7b538235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:35.631584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669d5c8-0ee1-424f-9b7c-2aae7b538235 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:35.632004 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669d5c8-0ee1-424f-9b7c-2aae7b538235 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:35.632286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669d5c8-0ee1-424f-9b7c-2aae7b538235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:35.657353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669d5c8-0ee1-424f-9b7c-2aae7b538235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:35.659095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669d5c8-0ee1-424f-9b7c-2aae7b538235 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:35.678903 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1035/2081] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:35.707433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc18d-ba3a-46a8-aa21-f7472e1508c1 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:35.859881 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc18d-ba3a-46a8-aa21-f7472e1508c1 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:35.867785 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:35.868492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:35.868865 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:35.869141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] PATH_INFO: `/v3/users/87dd3b1f8b4d46f0a9c076ab708bb870` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:35.870884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] RBAC: Authorizing `identity:delete_user(user_id=87dd3b1f8b4d46f0a9c076ab708bb870)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:35.873112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:35.899215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:35.933440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87dd3b1f8b4d46f0a9c076ab708bb870'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:35.941051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87dd3b1f8b4d46f0a9c076ab708bb870'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:35.954913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87dd3b1f8b4d46f0a9c076ab708bb870'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:35.955690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87dd3b1f8b4d46f0a9c076ab708bb870'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:35.956390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87dd3b1f8b4d46f0a9c076ab708bb870'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:35.969148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1047/2082] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:35 2022] DELETE /identity/v3/users/87dd3b1f8b4d46f0a9c076ab708bb870 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:35.973405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5e1da-bc0e-42c7-a9d0-1e9ae1a4a82f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:35.974176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5e1da-bc0e-42c7-a9d0-1e9ae1a4a82f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:35.974518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5e1da-bc0e-42c7-a9d0-1e9ae1a4a82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:35.994651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-3fc5e1da-bc0e-42c7-a9d0-1e9ae1a4a82f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:35.996005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3fc5e1da-bc0e-42c7-a9d0-1e9ae1a4a82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:36.072982 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1036/2083] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:36.081028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:36.082869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:36.143039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5e1da-bc0e-42c7-a9d0-1e9ae1a4a82f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:36.144533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3fc5e1da-bc0e-42c7-a9d0-1e9ae1a4a82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:36.180264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e92a55-3767-4eda-bd08-df36abd4143e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:36.184364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:36.184959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d38d-41a8-445c-b341-4bbfa892c14a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:36.185797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d38d-41a8-445c-b341-4bbfa892c14a service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:36.186262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d38d-41a8-445c-b341-4bbfa892c14a service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:36.187089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d38d-41a8-445c-b341-4bbfa892c14a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:36.208643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1d38d-41a8-445c-b341-4bbfa892c14a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:36.208643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1d38d-41a8-445c-b341-4bbfa892c14a service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:36.224884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1048/2084] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:36.228991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5e1da-bc0e-42c7-a9d0-1e9ae1a4a82f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:36.234513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb6855-da66-4a44-9e94-78c9fdfcff9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:36.235588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb6855-da66-4a44-9e94-78c9fdfcff9c service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:36.236162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb6855-da66-4a44-9e94-78c9fdfcff9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:36.236628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb6855-da66-4a44-9e94-78c9fdfcff9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:36.240489 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-acdb6855-da66-4a44-9e94-78c9fdfcff9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:36.359512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb6855-da66-4a44-9e94-78c9fdfcff9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:36.361440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb6855-da66-4a44-9e94-78c9fdfcff9c service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:36.376379 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1037/2085] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:37.093779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d38d-41a8-445c-b341-4bbfa892c14a service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:37.105454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d38d-41a8-445c-b341-4bbfa892c14a service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:37.105636 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb6855-da66-4a44-9e94-78c9fdfcff9c service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:37.107467 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-acdb6855-da66-4a44-9e94-78c9fdfcff9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:37.110305 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14ddf7-f5f4-48c7-b6d2-f63c5c0637db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:37.111012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14ddf7-f5f4-48c7-b6d2-f63c5c0637db service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:37.111362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14ddf7-f5f4-48c7-b6d2-f63c5c0637db service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:37.111703 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14ddf7-f5f4-48c7-b6d2-f63c5c0637db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:37.114466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-fd14ddf7-f5f4-48c7-b6d2-f63c5c0637db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:37.122066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb6855-da66-4a44-9e94-78c9fdfcff9c service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:37.128833 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:37.130342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:37.130638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:37.131024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9 admin admin] PATH_INFO: `/v3/projects/72bdb66df0a0428b811834c5185fcd6e` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:37.132616 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bdb66df0a0428b811834c5185fcd6e)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:37.134793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:37.185914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14ddf7-f5f4-48c7-b6d2-f63c5c0637db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:37.187379 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14ddf7-f5f4-48c7-b6d2-f63c5c0637db service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:37.201562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bdb66df0a0428b811834c5185fcd6e', 'request_id': 'req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:37.212080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bdb66df0a0428b811834c5185fcd6e', 'request_id': 'req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:37.218988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bdb66df0a0428b811834c5185fcd6e', 'request_id': 'req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:37.219574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1049/2086] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:37.233435 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9 admin admin] The token cache is being invalidate because project 72bdb66df0a0428b811834c5185fcd6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:37.233733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:37.234404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6c3a2ef0-fbe9-4b6b-8b0c-781f255b28d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:37.236445 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1038/2087] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:37 2022] DELETE /identity/v3/projects/72bdb66df0a0428b811834c5185fcd6e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:37.241893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06429f9f-e52a-4d72-a8ae-1567167c5227 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:37.242178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06429f9f-e52a-4d72-a8ae-1567167c5227 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:37.242664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06429f9f-e52a-4d72-a8ae-1567167c5227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:37.275795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-06429f9f-e52a-4d72-a8ae-1567167c5227 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:37.277473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-06429f9f-e52a-4d72-a8ae-1567167c5227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:37.323683 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:37.372858 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1050/2088] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:37.381315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c32c9d-1319-45cd-835a-42558c898cfa None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:37.381592 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c32c9d-1319-45cd-835a-42558c898cfa None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:37.382013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c32c9d-1319-45cd-835a-42558c898cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:37.404438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-d9c32c9d-1319-45cd-835a-42558c898cfa None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:37.405688 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d9c32c9d-1319-45cd-835a-42558c898cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:37.420422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1039/2089] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:37.424427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06429f9f-e52a-4d72-a8ae-1567167c5227 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:37.434781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06429f9f-e52a-4d72-a8ae-1567167c5227 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:37.440051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb566531-bcf9-4314-8273-44c5bd0f449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:37.440660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb566531-bcf9-4314-8273-44c5bd0f449a admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:37.440966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb566531-bcf9-4314-8273-44c5bd0f449a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:37.441325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb566531-bcf9-4314-8273-44c5bd0f449a admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:37.441985 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb566531-bcf9-4314-8273-44c5bd0f449a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:37.442337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb566531-bcf9-4314-8273-44c5bd0f449a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:37.444097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb566531-bcf9-4314-8273-44c5bd0f449a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:37.460427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1051/2090] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:11:37.461607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c32c9d-1319-45cd-835a-42558c898cfa None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:37.473584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c32c9d-1319-45cd-835a-42558c898cfa None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:37.480777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d615fdd-26af-4ae3-8067-2442e3287983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:37.481579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d615fdd-26af-4ae3-8067-2442e3287983 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:37.481878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d615fdd-26af-4ae3-8067-2442e3287983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:37.482187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d615fdd-26af-4ae3-8067-2442e3287983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:37.483109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d615fdd-26af-4ae3-8067-2442e3287983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:37.485230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d615fdd-26af-4ae3-8067-2442e3287983 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:37.544410 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1040/2091] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:37 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:37.545604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb566531-bcf9-4314-8273-44c5bd0f449a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:37.557359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb566531-bcf9-4314-8273-44c5bd0f449a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:37.685357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38030219-3f24-4501-a035-215f9835a326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:37.686472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38030219-3f24-4501-a035-215f9835a326 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:37.686762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38030219-3f24-4501-a035-215f9835a326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:37.687057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38030219-3f24-4501-a035-215f9835a326 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:37.687864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38030219-3f24-4501-a035-215f9835a326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:37.691904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38030219-3f24-4501-a035-215f9835a326 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:37.726724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1052/2092] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:37 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:37.731230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d615fdd-26af-4ae3-8067-2442e3287983 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:37.742879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d615fdd-26af-4ae3-8067-2442e3287983 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:37.766843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e3811-459b-4207-b99a-3b38cc14c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:37.767706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e3811-459b-4207-b99a-3b38cc14c1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:37.767989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e3811-459b-4207-b99a-3b38cc14c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:37.768265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e3811-459b-4207-b99a-3b38cc14c1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:37.768964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e3811-459b-4207-b99a-3b38cc14c1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:37.771203 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e3811-459b-4207-b99a-3b38cc14c1f9 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:37.786973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38030219-3f24-4501-a035-215f9835a326 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:37.792715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1041/2093] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:37.800741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38030219-3f24-4501-a035-215f9835a326 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:37.807382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc48a0-58f2-41c6-a730-08668d454875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:37.808338 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc48a0-58f2-41c6-a730-08668d454875 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:37.808626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc48a0-58f2-41c6-a730-08668d454875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:37.808979 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc48a0-58f2-41c6-a730-08668d454875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:37.809644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc48a0-58f2-41c6-a730-08668d454875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:37.811487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc48a0-58f2-41c6-a730-08668d454875 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:37.830803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e3811-459b-4207-b99a-3b38cc14c1f9 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:37.838246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1053/2094] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:37.850910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e3811-459b-4207-b99a-3b38cc14c1f9 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:37.899900 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24739c84-3f06-4862-8802-f4861cb448ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:37.901282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24739c84-3f06-4862-8802-f4861cb448ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:37.901282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24739c84-3f06-4862-8802-f4861cb448ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:37.901282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24739c84-3f06-4862-8802-f4861cb448ac admin admin] PATH_INFO: `/v3/projects/ee70731d84ff4db4acf7d6542b072f18/users/c83970ccef5f4f5caaf2177fd3e09035/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:37.936168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24739c84-3f06-4862-8802-f4861cb448ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee70731d84ff4db4acf7d6542b072f18, user_id=c83970ccef5f4f5caaf2177fd3e09035, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:37.945068 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24739c84-3f06-4862-8802-f4861cb448ac admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:37.949502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:37.972269 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1042/2095] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:37 2022] PUT /identity/v3/projects/ee70731d84ff4db4acf7d6542b072f18/users/c83970ccef5f4f5caaf2177fd3e09035/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:37.999200 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbb428-9362-42ad-b53b-76ff93a161c4 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:37.999598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbb428-9362-42ad-b53b-76ff93a161c4 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:37.999884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbb428-9362-42ad-b53b-76ff93a161c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:38.028993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24739c84-3f06-4862-8802-f4861cb448ac admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:38.030905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-24739c84-3f06-4862-8802-f4861cb448ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:38.073767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e7fbb428-9362-42ad-b53b-76ff93a161c4 None None] MFA Rules not processed for user `c83970ccef5f4f5caaf2177fd3e09035`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:38.075012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e7fbb428-9362-42ad-b53b-76ff93a161c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:38.121175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24739c84-3f06-4862-8802-f4861cb448ac admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:38.135960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899bf40-d9f3-4806-a8bb-487dfc34ad14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:38.136590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899bf40-d9f3-4806-a8bb-487dfc34ad14 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:38.136901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899bf40-d9f3-4806-a8bb-487dfc34ad14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:38.137233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899bf40-d9f3-4806-a8bb-487dfc34ad14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:38.141413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a899bf40-d9f3-4806-a8bb-487dfc34ad14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:38.194824 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1054/2096] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:38.237941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbb428-9362-42ad-b53b-76ff93a161c4 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:38.244252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e7fbb428-9362-42ad-b53b-76ff93a161c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:38.276201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbb428-9362-42ad-b53b-76ff93a161c4 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:38.307260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20e8c8-306b-4430-a4e5-3ecfc9f122f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:38.308288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20e8c8-306b-4430-a4e5-3ecfc9f122f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:38.308851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20e8c8-306b-4430-a4e5-3ecfc9f122f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:38.309325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20e8c8-306b-4430-a4e5-3ecfc9f122f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:38.322109 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20e8c8-306b-4430-a4e5-3ecfc9f122f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:38.323698 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20e8c8-306b-4430-a4e5-3ecfc9f122f8 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:38.350108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1055/2097] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:38.403963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20e8c8-306b-4430-a4e5-3ecfc9f122f8 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:38.405136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899bf40-d9f3-4806-a8bb-487dfc34ad14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:38.406964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899bf40-d9f3-4806-a8bb-487dfc34ad14 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:38.427412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1043/2098] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:38.461918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:38.578012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20e8c8-306b-4430-a4e5-3ecfc9f122f8 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:38.605805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:38.606482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:38.607014 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:38.607574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] PATH_INFO: `/v3/users/c83970ccef5f4f5caaf2177fd3e09035` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:38.609147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83970ccef5f4f5caaf2177fd3e09035)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:38.611408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:38.699603 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83970ccef5f4f5caaf2177fd3e09035'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:38.717395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83970ccef5f4f5caaf2177fd3e09035'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:38.737364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83970ccef5f4f5caaf2177fd3e09035'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:38.738360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83970ccef5f4f5caaf2177fd3e09035'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:38.739005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83970ccef5f4f5caaf2177fd3e09035'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:38.764082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1056/2099] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:38 2022] DELETE /identity/v3/users/c83970ccef5f4f5caaf2177fd3e09035 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:38.768817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5bbe-91d0-4142-931b-af2f82c35b6c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:38.769262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5bbe-91d0-4142-931b-af2f82c35b6c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:38.769635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5bbe-91d0-4142-931b-af2f82c35b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:38.796418 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-28ab5bbe-91d0-4142-931b-af2f82c35b6c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:38.798624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-28ab5bbe-91d0-4142-931b-af2f82c35b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:38.879342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1044/2100] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:38.933494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:38.935308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:39.024754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d8721-4748-45c1-b2c7-bc48b4acf86b admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:39.037515 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45d451-8cf5-4d23-a581-1cccdd371087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:39.038363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45d451-8cf5-4d23-a581-1cccdd371087 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:39.038810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45d451-8cf5-4d23-a581-1cccdd371087 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:39.039226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45d451-8cf5-4d23-a581-1cccdd371087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:39.051025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45d451-8cf5-4d23-a581-1cccdd371087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:39.053214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45d451-8cf5-4d23-a581-1cccdd371087 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:39.090410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1057/2101] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:40.177985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5bbe-91d0-4142-931b-af2f82c35b6c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:40.180377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-28ab5bbe-91d0-4142-931b-af2f82c35b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:40.222502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5bbe-91d0-4142-931b-af2f82c35b6c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:40.243535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:40.245155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:40.245769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:40.246300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a admin admin] PATH_INFO: `/v3/projects/ee70731d84ff4db4acf7d6542b072f18` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:40.248045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee70731d84ff4db4acf7d6542b072f18)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:40.251038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:40.384171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:40.398851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee70731d84ff4db4acf7d6542b072f18', 'request_id': 'req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:40.417930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee70731d84ff4db4acf7d6542b072f18', 'request_id': 'req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:40.449757 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee70731d84ff4db4acf7d6542b072f18', 'request_id': 'req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:40.478436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a admin admin] The token cache is being invalidate because project ee70731d84ff4db4acf7d6542b072f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:40.479086 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:40.480017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0b7d0e8a-ed28-4b87-a6d9-cd5c2295bd2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:40.485515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1045/2102] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:40 2022] DELETE /identity/v3/projects/ee70731d84ff4db4acf7d6542b072f18 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:40.487066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29bf14-dd05-46c1-b6f7-2bbb100781a6 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:40.487569 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29bf14-dd05-46c1-b6f7-2bbb100781a6 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:40.487838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29bf14-dd05-46c1-b6f7-2bbb100781a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:40.527790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9b29bf14-dd05-46c1-b6f7-2bbb100781a6 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:40.532517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9b29bf14-dd05-46c1-b6f7-2bbb100781a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:40.589913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:40.618028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1058/2103] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:40.626974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ead5e-b3ca-4a64-af6a-c1e26806719e None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:40.627278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ead5e-b3ca-4a64-af6a-c1e26806719e None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:40.627768 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ead5e-b3ca-4a64-af6a-c1e26806719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:40.651998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-5a6ead5e-b3ca-4a64-af6a-c1e26806719e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:40.653583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5a6ead5e-b3ca-4a64-af6a-c1e26806719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:40.663887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1046/2104] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:40.668547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d18239-00ae-4f49-ae9c-9d0ab68c3f99 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:40.668869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d18239-00ae-4f49-ae9c-9d0ab68c3f99 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:40.669153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d18239-00ae-4f49-ae9c-9d0ab68c3f99 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:40.670513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1059/2105] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:11:40.671664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ead5e-b3ca-4a64-af6a-c1e26806719e None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:40.682969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ead5e-b3ca-4a64-af6a-c1e26806719e None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:40.686251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b40a8-f058-4a03-8b5b-506f3441c363 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:40.687180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b40a8-f058-4a03-8b5b-506f3441c363 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:40.687180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b40a8-f058-4a03-8b5b-506f3441c363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:40.704953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72c6d8-22a5-4e53-8be5-4f7d523b8bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:40.706147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c6d8-22a5-4e53-8be5-4f7d523b8bba admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:40.707581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c6d8-22a5-4e53-8be5-4f7d523b8bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:40.709750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c6d8-22a5-4e53-8be5-4f7d523b8bba admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:40.712019 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72c6d8-22a5-4e53-8be5-4f7d523b8bba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:40.712337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72c6d8-22a5-4e53-8be5-4f7d523b8bba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:40.714825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72c6d8-22a5-4e53-8be5-4f7d523b8bba admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:40.720437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e70b40a8-f058-4a03-8b5b-506f3441c363 None None] MFA Rules not processed for user `b918da0f83754f3887de1cfa2e4df028`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:40.723972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e70b40a8-f058-4a03-8b5b-506f3441c363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:40.733302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1047/2106] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:11:40.738003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72c6d8-22a5-4e53-8be5-4f7d523b8bba admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:40.757663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72c6d8-22a5-4e53-8be5-4f7d523b8bba admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:40.771292 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656b83b-9038-4831-b5c5-1869fecab94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:40.772571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656b83b-9038-4831-b5c5-1869fecab94a admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:40.772932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656b83b-9038-4831-b5c5-1869fecab94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:40.773152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656b83b-9038-4831-b5c5-1869fecab94a admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:40.773799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656b83b-9038-4831-b5c5-1869fecab94a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:40.775807 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656b83b-9038-4831-b5c5-1869fecab94a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:40.821932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1048/2107] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:40 2022] POST /identity/v3/projects => generated 391 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:40.821932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656b83b-9038-4831-b5c5-1869fecab94a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:40.821932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7656b83b-9038-4831-b5c5-1869fecab94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:40.841045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1060/2108] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:40.841766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b40a8-f058-4a03-8b5b-506f3441c363 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:40.853164 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b40a8-f058-4a03-8b5b-506f3441c363 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:40.893320 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656b83b-9038-4831-b5c5-1869fecab94a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:40.898638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:40.899264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:40.899545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:40.899845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] PATH_INFO: `/v3/users/a82ffedb9d854ad0a5044c5cbec62ca4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:40.901001 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82ffedb9d854ad0a5044c5cbec62ca4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:40.902973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:40.918335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb86af-d0a5-45df-80ff-457d59f31e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:40.918961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb86af-d0a5-45df-80ff-457d59f31e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:40.920160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb86af-d0a5-45df-80ff-457d59f31e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:40.920458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb86af-d0a5-45df-80ff-457d59f31e62 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:40.921146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb86af-d0a5-45df-80ff-457d59f31e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:40.923383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb86af-d0a5-45df-80ff-457d59f31e62 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:40.948737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1061/2109] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:40 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:40.948925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb86af-d0a5-45df-80ff-457d59f31e62 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:40.950456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-44cb86af-d0a5-45df-80ff-457d59f31e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:40.953386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82ffedb9d854ad0a5044c5cbec62ca4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:40.964326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82ffedb9d854ad0a5044c5cbec62ca4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:40.965005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82ffedb9d854ad0a5044c5cbec62ca4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:40.965658 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82ffedb9d854ad0a5044c5cbec62ca4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:40.979087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82ffedb9d854ad0a5044c5cbec62ca4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:41.001800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1049/2110] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:40 2022] DELETE /identity/v3/users/a82ffedb9d854ad0a5044c5cbec62ca4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:41.002998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:41.009599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:41.017946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:41.072470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb86af-d0a5-45df-80ff-457d59f31e62 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:41.085108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:41.136303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41fb1a-e9ae-44cb-9992-95f6a6542d1d admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:41.146352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f997d-bc83-41eb-9a8c-2134cd6cc4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:41.147379 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f997d-bc83-41eb-9a8c-2134cd6cc4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:41.147669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f997d-bc83-41eb-9a8c-2134cd6cc4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:41.148094 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f997d-bc83-41eb-9a8c-2134cd6cc4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:41.149302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f997d-bc83-41eb-9a8c-2134cd6cc4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:41.152176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f997d-bc83-41eb-9a8c-2134cd6cc4f5 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:41.167955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1050/2111] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:41.169679 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f997d-bc83-41eb-9a8c-2134cd6cc4f5 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:41.183767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f997d-bc83-41eb-9a8c-2134cd6cc4f5 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:41.193010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282f6f9-3a3c-4942-90bf-c218d39f2159 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b918da0f83754f3887de1cfa2e4df028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:41.194241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282f6f9-3a3c-4942-90bf-c218d39f2159 service placement] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:41.194525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282f6f9-3a3c-4942-90bf-c218d39f2159 service placement] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:41.194799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282f6f9-3a3c-4942-90bf-c218d39f2159 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:41.195185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78700a30-837e-40d0-90cd-528bb2a2f374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:41.195986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78700a30-837e-40d0-90cd-528bb2a2f374 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:41.196533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78700a30-837e-40d0-90cd-528bb2a2f374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:41.196997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78700a30-837e-40d0-90cd-528bb2a2f374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:41.197863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78700a30-837e-40d0-90cd-528bb2a2f374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:41.199701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4282f6f9-3a3c-4942-90bf-c218d39f2159 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:41.200067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78700a30-837e-40d0-90cd-528bb2a2f374 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:41.217314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1051/2112] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:41.219566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78700a30-837e-40d0-90cd-528bb2a2f374 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:41.232588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78700a30-837e-40d0-90cd-528bb2a2f374 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:41.233680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282f6f9-3a3c-4942-90bf-c218d39f2159 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:41.237823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282f6f9-3a3c-4942-90bf-c218d39f2159 service placement] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:41.237961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0044430-2a4c-4c7a-9a34-8261f1d484bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:41.238957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0044430-2a4c-4c7a-9a34-8261f1d484bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:41.239717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0044430-2a4c-4c7a-9a34-8261f1d484bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:41.241045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0044430-2a4c-4c7a-9a34-8261f1d484bf admin admin] PATH_INFO: `/v3/projects/23c8e5e3fc1643a6b226bbf3ad71d163/users/f6370a19e6be4f4982129aa4986a4c7a/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:41.266450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0044430-2a4c-4c7a-9a34-8261f1d484bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c8e5e3fc1643a6b226bbf3ad71d163, user_id=f6370a19e6be4f4982129aa4986a4c7a, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:41.272849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0044430-2a4c-4c7a-9a34-8261f1d484bf admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:41.303577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1052/2114] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:41 2022] PUT /identity/v3/projects/23c8e5e3fc1643a6b226bbf3ad71d163/users/f6370a19e6be4f4982129aa4986a4c7a/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:41.303761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1062/2114] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:41.317832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0044430-2a4c-4c7a-9a34-8261f1d484bf admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:41.318722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc371231-184b-486a-9c7a-4f77ee0b3b44 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:41.318722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc371231-184b-486a-9c7a-4f77ee0b3b44 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:41.319043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc371231-184b-486a-9c7a-4f77ee0b3b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:41.320326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d0044430-2a4c-4c7a-9a34-8261f1d484bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:41.383829 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-dc371231-184b-486a-9c7a-4f77ee0b3b44 None None] MFA Rules not processed for user `f6370a19e6be4f4982129aa4986a4c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:41.388129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-dc371231-184b-486a-9c7a-4f77ee0b3b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:41.437894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0044430-2a4c-4c7a-9a34-8261f1d484bf admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:41.446024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:41.446780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:41.447068 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:41.447396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76 admin admin] PATH_INFO: `/v3/projects/3ad402b5380b4f2da2137bf09fb23783` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:41.448545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad402b5380b4f2da2137bf09fb23783)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:41.451016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:41.503887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1063/2115] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:41.547364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc371231-184b-486a-9c7a-4f77ee0b3b44 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:41.549413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-dc371231-184b-486a-9c7a-4f77ee0b3b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:41.550167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad402b5380b4f2da2137bf09fb23783', 'request_id': 'req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:41.566928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad402b5380b4f2da2137bf09fb23783', 'request_id': 'req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:41.578779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad402b5380b4f2da2137bf09fb23783', 'request_id': 'req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:41.596157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:41.613482 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76 admin admin] The token cache is being invalidate because project 3ad402b5380b4f2da2137bf09fb23783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:41.615623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:41.616459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-dc6c94cf-30f1-4cbe-ab1b-0abe4767bb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:41.635661 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1053/2116] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:41 2022] DELETE /identity/v3/projects/3ad402b5380b4f2da2137bf09fb23783 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:41.640391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61841da7-a5cb-4eac-880c-a7348c72a479 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:41.640815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61841da7-a5cb-4eac-880c-a7348c72a479 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:41.641327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc371231-184b-486a-9c7a-4f77ee0b3b44 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:41.641664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61841da7-a5cb-4eac-880c-a7348c72a479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:41.665986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-61841da7-a5cb-4eac-880c-a7348c72a479 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:41.667238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-61841da7-a5cb-4eac-880c-a7348c72a479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:41.742447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:41.750594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccef02-654b-4d57-a335-98572cfcae33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:41.751658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccef02-654b-4d57-a335-98572cfcae33 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:41.752022 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccef02-654b-4d57-a335-98572cfcae33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:41.752670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccef02-654b-4d57-a335-98572cfcae33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:41.755474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-a6ccef02-654b-4d57-a335-98572cfcae33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:41.760201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1054/2117] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:41.767697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd1d6-c711-4483-b23e-2b43c22caf79 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:41.767985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd1d6-c711-4483-b23e-2b43c22caf79 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:41.768253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd1d6-c711-4483-b23e-2b43c22caf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:41.802843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f9ecd1d6-c711-4483-b23e-2b43c22caf79 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:41.804345 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f9ecd1d6-c711-4483-b23e-2b43c22caf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:41.820179 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1055/2118] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:41.821829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecd1d6-c711-4483-b23e-2b43c22caf79 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:41.832399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecd1d6-c711-4483-b23e-2b43c22caf79 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:41.838792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f0c42-a90c-4c50-97ff-fd3ff02ae8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:41.839510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f0c42-a90c-4c50-97ff-fd3ff02ae8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:41.839890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f0c42-a90c-4c50-97ff-fd3ff02ae8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:41.840369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f0c42-a90c-4c50-97ff-fd3ff02ae8e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:41.841156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f0c42-a90c-4c50-97ff-fd3ff02ae8e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:41.841669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f0c42-a90c-4c50-97ff-fd3ff02ae8e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:41.843509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f0c42-a90c-4c50-97ff-fd3ff02ae8e6 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:41.853555 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccef02-654b-4d57-a335-98572cfcae33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:41.855044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccef02-654b-4d57-a335-98572cfcae33 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:41.860722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1056/2119] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:11:41.864855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f0c42-a90c-4c50-97ff-fd3ff02ae8e6 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:41.868268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1064/2120] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:41 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:41.874032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f0c42-a90c-4c50-97ff-fd3ff02ae8e6 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:41.878978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78af4a-4378-4add-b048-04e2c43d765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:41.880258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78af4a-4378-4add-b048-04e2c43d765a admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:41.880918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78af4a-4378-4add-b048-04e2c43d765a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:41.881269 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78af4a-4378-4add-b048-04e2c43d765a admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:41.882187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78af4a-4378-4add-b048-04e2c43d765a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:41.884872 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78af4a-4378-4add-b048-04e2c43d765a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:41.919067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1057/2121] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:41 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:41.923462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccef02-654b-4d57-a335-98572cfcae33 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:41.937744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccef02-654b-4d57-a335-98572cfcae33 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:42.010878 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdca721-af3d-4330-a20d-0cba4be399cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:42.011839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdca721-af3d-4330-a20d-0cba4be399cb admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:42.012120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdca721-af3d-4330-a20d-0cba4be399cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:42.012542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdca721-af3d-4330-a20d-0cba4be399cb admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:42.013218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdca721-af3d-4330-a20d-0cba4be399cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:42.015313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdca721-af3d-4330-a20d-0cba4be399cb admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:42.046782 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1065/2122] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:41 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:42.050909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78af4a-4378-4add-b048-04e2c43d765a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:42.063387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78af4a-4378-4add-b048-04e2c43d765a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:42.068948 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cdd2d-ce44-4a96-b466-643cc3358f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:42.069635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cdd2d-ce44-4a96-b466-643cc3358f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:42.070005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cdd2d-ce44-4a96-b466-643cc3358f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:42.070287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cdd2d-ce44-4a96-b466-643cc3358f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:42.070929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8cdd2d-ce44-4a96-b466-643cc3358f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:42.072705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8cdd2d-ce44-4a96-b466-643cc3358f14 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:42.085688 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1058/2123] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:42.090574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdca721-af3d-4330-a20d-0cba4be399cb admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:42.100674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdca721-af3d-4330-a20d-0cba4be399cb admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:42.105885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e497e96-3b22-42b0-8d8b-baa59dbf806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:42.106491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e497e96-3b22-42b0-8d8b-baa59dbf806d admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:42.106932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e497e96-3b22-42b0-8d8b-baa59dbf806d admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:42.107294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e497e96-3b22-42b0-8d8b-baa59dbf806d admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:42.108055 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e497e96-3b22-42b0-8d8b-baa59dbf806d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:42.109828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e497e96-3b22-42b0-8d8b-baa59dbf806d admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:42.121296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1066/2124] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:42.125484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cdd2d-ce44-4a96-b466-643cc3358f14 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:42.138080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cdd2d-ce44-4a96-b466-643cc3358f14 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:42.143515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fe45b-743f-4a0a-a4f5-7a2d9ca4e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:42.144176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fe45b-743f-4a0a-a4f5-7a2d9ca4e20c admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:42.144453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fe45b-743f-4a0a-a4f5-7a2d9ca4e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:42.144811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fe45b-743f-4a0a-a4f5-7a2d9ca4e20c admin admin] PATH_INFO: `/v3/projects/ec32dc853885457aafd2575f77d8bdd0/users/1beb3cf542bf4cc1802f90ad14a29017/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:42.160858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fe45b-743f-4a0a-a4f5-7a2d9ca4e20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec32dc853885457aafd2575f77d8bdd0, user_id=1beb3cf542bf4cc1802f90ad14a29017, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:42.164437 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fe45b-743f-4a0a-a4f5-7a2d9ca4e20c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:42.191440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1059/2125] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:42 2022] PUT /identity/v3/projects/ec32dc853885457aafd2575f77d8bdd0/users/1beb3cf542bf4cc1802f90ad14a29017/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:42.198084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57d5ee-be6f-48c7-a949-e4c2be92e259 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:42.198380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57d5ee-be6f-48c7-a949-e4c2be92e259 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:42.198712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57d5ee-be6f-48c7-a949-e4c2be92e259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:42.221161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fe45b-743f-4a0a-a4f5-7a2d9ca4e20c admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:42.224534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-530fe45b-743f-4a0a-a4f5-7a2d9ca4e20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:42.225705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8e57d5ee-be6f-48c7-a949-e4c2be92e259 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:42.227336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8e57d5ee-be6f-48c7-a949-e4c2be92e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:42.321970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fe45b-743f-4a0a-a4f5-7a2d9ca4e20c admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:42.330233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aff72-fa21-4879-ab2b-1aa589ec8745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:42.330966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aff72-fa21-4879-ab2b-1aa589ec8745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:42.331249 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aff72-fa21-4879-ab2b-1aa589ec8745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:42.331551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aff72-fa21-4879-ab2b-1aa589ec8745 admin admin] PATH_INFO: `/v3/users/113ac9dab63b4300b1c46505de3b010e` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:42.332737 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aff72-fa21-4879-ab2b-1aa589ec8745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113ac9dab63b4300b1c46505de3b010e)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:42.333599 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1067/2126] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:42.335364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aff72-fa21-4879-ab2b-1aa589ec8745 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:42.343280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57d5ee-be6f-48c7-a949-e4c2be92e259 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:42.344611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8e57d5ee-be6f-48c7-a949-e4c2be92e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:42.360582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:42.370418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:42.389281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-a10aff72-fa21-4879-ab2b-1aa589ec8745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113ac9dab63b4300b1c46505de3b010e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:42.398263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-a10aff72-fa21-4879-ab2b-1aa589ec8745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113ac9dab63b4300b1c46505de3b010e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:42.399105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-a10aff72-fa21-4879-ab2b-1aa589ec8745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113ac9dab63b4300b1c46505de3b010e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:42.399871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-a10aff72-fa21-4879-ab2b-1aa589ec8745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113ac9dab63b4300b1c46505de3b010e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:42.408850 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57d5ee-be6f-48c7-a949-e4c2be92e259 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:42.413393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce2fd2-2b4e-43c1-851d-f0c5b6d18a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:42.413562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-a10aff72-fa21-4879-ab2b-1aa589ec8745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113ac9dab63b4300b1c46505de3b010e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:42.413993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce2fd2-2b4e-43c1-851d-f0c5b6d18a26 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:42.414273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce2fd2-2b4e-43c1-851d-f0c5b6d18a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:42.414549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce2fd2-2b4e-43c1-851d-f0c5b6d18a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:42.416269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d7ce2fd2-2b4e-43c1-851d-f0c5b6d18a26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:42.428212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1060/2127] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:42 2022] DELETE /identity/v3/users/113ac9dab63b4300b1c46505de3b010e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:42.428785 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce2fd2-2b4e-43c1-851d-f0c5b6d18a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:42.430213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce2fd2-2b4e-43c1-851d-f0c5b6d18a26 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:42.432936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd8a29-693f-4775-89b0-fdca2405ba2a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:42.433226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd8a29-693f-4775-89b0-fdca2405ba2a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:42.433616 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd8a29-693f-4775-89b0-fdca2405ba2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:42.440121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1068/2128] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:42.454260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b1bd8a29-693f-4775-89b0-fdca2405ba2a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:42.455630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b1bd8a29-693f-4775-89b0-fdca2405ba2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:42.532442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1061/2129] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:42.543778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce2fd2-2b4e-43c1-851d-f0c5b6d18a26 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:42.545426 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d7ce2fd2-2b4e-43c1-851d-f0c5b6d18a26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:42.560120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce2fd2-2b4e-43c1-851d-f0c5b6d18a26 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:42.616432 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6e05e-48cb-4a58-ae00-d581faf98a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:42.617083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6e05e-48cb-4a58-ae00-d581faf98a45 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:42.617365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6e05e-48cb-4a58-ae00-d581faf98a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:42.617656 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6e05e-48cb-4a58-ae00-d581faf98a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:42.627478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6e05e-48cb-4a58-ae00-d581faf98a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:42.628970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6e05e-48cb-4a58-ae00-d581faf98a45 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:42.641220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1069/2130] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:43.117368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd8a29-693f-4775-89b0-fdca2405ba2a None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:43.119168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b1bd8a29-693f-4775-89b0-fdca2405ba2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:43.147297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd8a29-693f-4775-89b0-fdca2405ba2a None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:43.165346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:43.166244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:43.166605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:43.166949 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] PATH_INFO: `/v3/projects/2b02ad17a8d74b8295a4fe3d11646e58` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:43.168814 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b02ad17a8d74b8295a4fe3d11646e58)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:43.170827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:43.183486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6e05e-48cb-4a58-ae00-d581faf98a45 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:43.185152 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-abf6e05e-48cb-4a58-ae00-d581faf98a45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:43.208462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6e05e-48cb-4a58-ae00-d581faf98a45 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:43.218029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f35687-099e-49a2-b335-bebc8d5f25c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:43.219013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f35687-099e-49a2-b335-bebc8d5f25c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:43.219314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f35687-099e-49a2-b335-bebc8d5f25c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:43.219680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f35687-099e-49a2-b335-bebc8d5f25c1 admin admin] PATH_INFO: `/v3/users/a282e1c4f70b4a60b03cf51500c1fa47` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:43.221478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f35687-099e-49a2-b335-bebc8d5f25c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a282e1c4f70b4a60b03cf51500c1fa47)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:43.224291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f35687-099e-49a2-b335-bebc8d5f25c1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:43.259522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b02ad17a8d74b8295a4fe3d11646e58', 'request_id': 'req-77d4972b-0ba3-42fc-8191-98ca30bcdbde'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.273786 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b02ad17a8d74b8295a4fe3d11646e58', 'request_id': 'req-77d4972b-0ba3-42fc-8191-98ca30bcdbde'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.285035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b02ad17a8d74b8295a4fe3d11646e58', 'request_id': 'req-77d4972b-0ba3-42fc-8191-98ca30bcdbde'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.304993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-34f35687-099e-49a2-b335-bebc8d5f25c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a282e1c4f70b4a60b03cf51500c1fa47'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.307478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] The token cache is being invalidate because project 2b02ad17a8d74b8295a4fe3d11646e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:43.307838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.308505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.313493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1062/2131] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:43 2022] DELETE /identity/v3/projects/2b02ad17a8d74b8295a4fe3d11646e58 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:43.314376 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:43.315995 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:43.340949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-34f35687-099e-49a2-b335-bebc8d5f25c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a282e1c4f70b4a60b03cf51500c1fa47'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.349100 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:43.361081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-34f35687-099e-49a2-b335-bebc8d5f25c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a282e1c4f70b4a60b03cf51500c1fa47'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.362085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-34f35687-099e-49a2-b335-bebc8d5f25c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a282e1c4f70b4a60b03cf51500c1fa47'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.362935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-34f35687-099e-49a2-b335-bebc8d5f25c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a282e1c4f70b4a60b03cf51500c1fa47'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.390086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1070/2132] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:43 2022] DELETE /identity/v3/users/a282e1c4f70b4a60b03cf51500c1fa47 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:43.398132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3629-d738-4f1f-bc3f-70775176935c None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:43.398422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3629-d738-4f1f-bc3f-70775176935c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:43.398695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3629-d738-4f1f-bc3f-70775176935c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:43.411907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4972b-0ba3-42fc-8191-98ca30bcdbde admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:43.437527 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c5dc3629-d738-4f1f-bc3f-70775176935c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:43.440606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c5dc3629-d738-4f1f-bc3f-70775176935c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:43.495694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:43.500039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:43.501044 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:43.501547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:43.502113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] PATH_INFO: `/v3/users/e6f6bb5056704e1aa045b54386d27d9f` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:43.503900 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f6bb5056704e1aa045b54386d27d9f)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:43.510035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:43.544866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1071/2133] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:43.555809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc3629-d738-4f1f-bc3f-70775176935c None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:43.561322 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c5dc3629-d738-4f1f-bc3f-70775176935c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:43.589730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f6bb5056704e1aa045b54386d27d9f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.599426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f6bb5056704e1aa045b54386d27d9f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.600474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f6bb5056704e1aa045b54386d27d9f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.601141 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f6bb5056704e1aa045b54386d27d9f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.621752 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f6bb5056704e1aa045b54386d27d9f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:43.652545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1063/2134] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:43 2022] DELETE /identity/v3/users/e6f6bb5056704e1aa045b54386d27d9f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:43.671522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc3629-d738-4f1f-bc3f-70775176935c None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:43.763081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427780-d22a-4b3a-99f3-edc9f563e096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:43.765119 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427780-d22a-4b3a-99f3-edc9f563e096 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:43.766367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427780-d22a-4b3a-99f3-edc9f563e096 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:43.767776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427780-d22a-4b3a-99f3-edc9f563e096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:43.770612 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-53427780-d22a-4b3a-99f3-edc9f563e096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:43.869192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53427780-d22a-4b3a-99f3-edc9f563e096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:43.870882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53427780-d22a-4b3a-99f3-edc9f563e096 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:43.885706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1072/2135] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:44.220853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:44.221569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:44.242175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2641f87-235e-49ac-b12e-260b8c699320 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:44.250019 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043984aa-9bc3-4349-85d8-6329fb1ea445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:44.250964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043984aa-9bc3-4349-85d8-6329fb1ea445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:44.251426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043984aa-9bc3-4349-85d8-6329fb1ea445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:44.251839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043984aa-9bc3-4349-85d8-6329fb1ea445 admin admin] PATH_INFO: `/v3/projects/bacdcb388b014b5fa6994765565442f0` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:44.253309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043984aa-9bc3-4349-85d8-6329fb1ea445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bacdcb388b014b5fa6994765565442f0)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:44.258121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043984aa-9bc3-4349-85d8-6329fb1ea445 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:44.368010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:44.373505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-043984aa-9bc3-4349-85d8-6329fb1ea445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bacdcb388b014b5fa6994765565442f0', 'request_id': 'req-043984aa-9bc3-4349-85d8-6329fb1ea445'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:44.390446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-043984aa-9bc3-4349-85d8-6329fb1ea445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bacdcb388b014b5fa6994765565442f0', 'request_id': 'req-043984aa-9bc3-4349-85d8-6329fb1ea445'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:44.398965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-043984aa-9bc3-4349-85d8-6329fb1ea445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bacdcb388b014b5fa6994765565442f0', 'request_id': 'req-043984aa-9bc3-4349-85d8-6329fb1ea445'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:44.451397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-043984aa-9bc3-4349-85d8-6329fb1ea445 admin admin] The token cache is being invalidate because project bacdcb388b014b5fa6994765565442f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:44.451697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-043984aa-9bc3-4349-85d8-6329fb1ea445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:44.452365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-043984aa-9bc3-4349-85d8-6329fb1ea445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:44.462861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1064/2136] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:44 2022] DELETE /identity/v3/projects/bacdcb388b014b5fa6994765565442f0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:44.463249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427780-d22a-4b3a-99f3-edc9f563e096 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:44.463249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-53427780-d22a-4b3a-99f3-edc9f563e096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:44.465658 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c854d-9009-4ee8-b038-77a3252a9a3a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:44.465658 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c854d-9009-4ee8-b038-77a3252a9a3a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:44.465658 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c854d-9009-4ee8-b038-77a3252a9a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:44.484413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427780-d22a-4b3a-99f3-edc9f563e096 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:44.511323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-469c854d-9009-4ee8-b038-77a3252a9a3a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:44.512603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-469c854d-9009-4ee8-b038-77a3252a9a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:44.572772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:44.612598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:44.613338 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:44.613725 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:44.615691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1065/2137] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:44.624077 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] PATH_INFO: `/v3/projects/214e95a338be4389ab1d905498e1b9c1` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:44.625257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f40ded-0abb-401b-9b87-ee10f322543f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:44.625550 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f40ded-0abb-401b-9b87-ee10f322543f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:44.625823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f40ded-0abb-401b-9b87-ee10f322543f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:44.626196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=214e95a338be4389ab1d905498e1b9c1)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:44.628214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:44.706891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-e8f40ded-0abb-401b-9b87-ee10f322543f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:44.708857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e8f40ded-0abb-401b-9b87-ee10f322543f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:44.717771 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214e95a338be4389ab1d905498e1b9c1', 'request_id': 'req-a596032b-2c70-46d2-910e-949da3506f32'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:44.728718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214e95a338be4389ab1d905498e1b9c1', 'request_id': 'req-a596032b-2c70-46d2-910e-949da3506f32'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:44.761139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214e95a338be4389ab1d905498e1b9c1', 'request_id': 'req-a596032b-2c70-46d2-910e-949da3506f32'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:44.784333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] The token cache is being invalidate because project 214e95a338be4389ab1d905498e1b9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:44.784645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:44.789242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:44.791307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1073/2138] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:44 2022] DELETE /identity/v3/projects/214e95a338be4389ab1d905498e1b9c1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:44.796333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:44.801080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:44.825794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1066/2139] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:44.839038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f40ded-0abb-401b-9b87-ee10f322543f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:44.854763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f40ded-0abb-401b-9b87-ee10f322543f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:44.866910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ee6d9-0a0f-4fed-b1c8-5f5c7feaa95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:44.867542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ee6d9-0a0f-4fed-b1c8-5f5c7feaa95a admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:44.867821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ee6d9-0a0f-4fed-b1c8-5f5c7feaa95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:44.868098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ee6d9-0a0f-4fed-b1c8-5f5c7feaa95a admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:44.869010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ee6d9-0a0f-4fed-b1c8-5f5c7feaa95a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:44.869317 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ee6d9-0a0f-4fed-b1c8-5f5c7feaa95a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:44.871016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ee6d9-0a0f-4fed-b1c8-5f5c7feaa95a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:44.909652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1067/2140] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:11:44.912423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ee6d9-0a0f-4fed-b1c8-5f5c7feaa95a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:44.945044 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ee6d9-0a0f-4fed-b1c8-5f5c7feaa95a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:44.952947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf73f1c-047a-45ee-93b2-3688f26b7c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:44.953740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf73f1c-047a-45ee-93b2-3688f26b7c55 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:44.954129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf73f1c-047a-45ee-93b2-3688f26b7c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:44.955265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf73f1c-047a-45ee-93b2-3688f26b7c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:44.956370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf73f1c-047a-45ee-93b2-3688f26b7c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:44.960070 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf73f1c-047a-45ee-93b2-3688f26b7c55 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:44.991707 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596032b-2c70-46d2-910e-949da3506f32 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:45.008149 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:45.008593 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1068/2141] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:44 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:45.009257 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:45.009507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:45.011698 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] PATH_INFO: `/v3/users/38a62d97367f411c9dc9bb86c1c008aa` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:45.013342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf73f1c-047a-45ee-93b2-3688f26b7c55 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:45.013936 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a62d97367f411c9dc9bb86c1c008aa)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:45.016332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:45.102558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:45.103366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a62d97367f411c9dc9bb86c1c008aa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:45.122295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a62d97367f411c9dc9bb86c1c008aa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:45.155164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf73f1c-047a-45ee-93b2-3688f26b7c55 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:45.155691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a62d97367f411c9dc9bb86c1c008aa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:45.157294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a62d97367f411c9dc9bb86c1c008aa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:45.158681 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a62d97367f411c9dc9bb86c1c008aa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:45.168721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e64b-b339-42b3-8391-77995666a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:45.168721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e64b-b339-42b3-8391-77995666a843 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:45.168721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e64b-b339-42b3-8391-77995666a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:45.168721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e64b-b339-42b3-8391-77995666a843 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:45.169588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278e64b-b339-42b3-8391-77995666a843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:45.170182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:45.171130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278e64b-b339-42b3-8391-77995666a843 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:45.185225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1074/2142] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:44 2022] DELETE /identity/v3/users/38a62d97367f411c9dc9bb86c1c008aa => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:45.202460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1069/2143] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:45 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:45.206913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:45.209246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:45.319934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48d885-feab-4688-9593-05e6ba952e54 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:45.325849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72bacb-3c40-4a5b-808e-fd66d982a5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:45.326589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72bacb-3c40-4a5b-808e-fd66d982a5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:45.327345 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72bacb-3c40-4a5b-808e-fd66d982a5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:45.327818 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72bacb-3c40-4a5b-808e-fd66d982a5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:45.328982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72bacb-3c40-4a5b-808e-fd66d982a5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:45.331260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72bacb-3c40-4a5b-808e-fd66d982a5d7 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:45.347802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1075/2144] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:45.353053 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e64b-b339-42b3-8391-77995666a843 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:45.363460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e64b-b339-42b3-8391-77995666a843 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:45.371577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e3fd1-beec-414c-97e1-2e20581dd787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:45.372244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e3fd1-beec-414c-97e1-2e20581dd787 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:45.372504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e3fd1-beec-414c-97e1-2e20581dd787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:45.372901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e3fd1-beec-414c-97e1-2e20581dd787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:45.373557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e3fd1-beec-414c-97e1-2e20581dd787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:45.375175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e3fd1-beec-414c-97e1-2e20581dd787 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:45.391104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1070/2145] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:45.394649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72bacb-3c40-4a5b-808e-fd66d982a5d7 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:45.405138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72bacb-3c40-4a5b-808e-fd66d982a5d7 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:45.410175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b77b18-19f0-4144-bdc2-827331d8b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:45.411362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b77b18-19f0-4144-bdc2-827331d8b8a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:45.411647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b77b18-19f0-4144-bdc2-827331d8b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:45.411918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b77b18-19f0-4144-bdc2-827331d8b8a1 admin admin] PATH_INFO: `/v3/projects/d84b4de6c294416ea9a33be347c43b08/users/4ba4edb985ae49288966e8241ae7c50e/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:45.442845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b77b18-19f0-4144-bdc2-827331d8b8a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84b4de6c294416ea9a33be347c43b08, user_id=4ba4edb985ae49288966e8241ae7c50e, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:45.448183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b77b18-19f0-4144-bdc2-827331d8b8a1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:45.470156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1076/2146] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:45 2022] PUT /identity/v3/projects/d84b4de6c294416ea9a33be347c43b08/users/4ba4edb985ae49288966e8241ae7c50e/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:45.481521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67798d-0961-479d-8b56-acf6b6cedc3b None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:45.481819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67798d-0961-479d-8b56-acf6b6cedc3b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:45.482080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67798d-0961-479d-8b56-acf6b6cedc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:45.552380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-cf67798d-0961-479d-8b56-acf6b6cedc3b None None] MFA Rules not processed for user `4ba4edb985ae49288966e8241ae7c50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:45.558237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-cf67798d-0961-479d-8b56-acf6b6cedc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:45.628217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b77b18-19f0-4144-bdc2-827331d8b8a1 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:45.630643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-08b77b18-19f0-4144-bdc2-827331d8b8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:45.679733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1071/2147] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:45.695250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67798d-0961-479d-8b56-acf6b6cedc3b None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:45.696330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-cf67798d-0961-479d-8b56-acf6b6cedc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:45.733789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b77b18-19f0-4144-bdc2-827331d8b8a1 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:45.740772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:45.741704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:45.742162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:45.742485 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] PATH_INFO: `/v3/projects/01bf0a3e799c4b09a5dc8413a5ceb9d6` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:45.743967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bf0a3e799c4b09a5dc8413a5ceb9d6)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:45.746314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:45.789659 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67798d-0961-479d-8b56-acf6b6cedc3b None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:45.813119 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bf0a3e799c4b09a5dc8413a5ceb9d6', 'request_id': 'req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:45.821182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bf0a3e799c4b09a5dc8413a5ceb9d6', 'request_id': 'req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:45.832236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bf0a3e799c4b09a5dc8413a5ceb9d6', 'request_id': 'req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:45.836013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:45.866462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] The token cache is being invalidate because project 01bf0a3e799c4b09a5dc8413a5ceb9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:45.866994 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:45.868902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:45.871394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1077/2148] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:45 2022] DELETE /identity/v3/projects/01bf0a3e799c4b09a5dc8413a5ceb9d6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:45.875140 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:45.876809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:45.879301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b5ddb-3486-45fe-a552-90ac3b519b6c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc71e3a41ac644ff8a908b766495b5f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:45.880710 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b5ddb-3486-45fe-a552-90ac3b519b6c service glance] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:45.880990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b5ddb-3486-45fe-a552-90ac3b519b6c service glance] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:45.881928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b5ddb-3486-45fe-a552-90ac3b519b6c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:45.883993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e79b5ddb-3486-45fe-a552-90ac3b519b6c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:45.904064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:45.999678 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7f698-c9d4-48e5-9fb4-4af4fbe1ddb7 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:46.010065 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71826603-62cc-49cb-917f-842f6d60e5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:46.011094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71826603-62cc-49cb-917f-842f6d60e5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:46.015208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71826603-62cc-49cb-917f-842f6d60e5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:46.015674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71826603-62cc-49cb-917f-842f6d60e5cc admin admin] PATH_INFO: `/v3/users/79a8c67c9d7d4dca9be4d3c527cfbb58` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:46.018187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71826603-62cc-49cb-917f-842f6d60e5cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a8c67c9d7d4dca9be4d3c527cfbb58)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:46.020824 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71826603-62cc-49cb-917f-842f6d60e5cc admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:46.046080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b5ddb-3486-45fe-a552-90ac3b519b6c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:46.048567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b5ddb-3486-45fe-a552-90ac3b519b6c service glance] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:46.073113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1072/2149] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:46.148986 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-71826603-62cc-49cb-917f-842f6d60e5cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a8c67c9d7d4dca9be4d3c527cfbb58'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:46.165828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-71826603-62cc-49cb-917f-842f6d60e5cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a8c67c9d7d4dca9be4d3c527cfbb58'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:46.216266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-71826603-62cc-49cb-917f-842f6d60e5cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a8c67c9d7d4dca9be4d3c527cfbb58'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:46.221617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-71826603-62cc-49cb-917f-842f6d60e5cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a8c67c9d7d4dca9be4d3c527cfbb58'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:46.224442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-71826603-62cc-49cb-917f-842f6d60e5cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a8c67c9d7d4dca9be4d3c527cfbb58'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:46.278067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1078/2150] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:45 2022] DELETE /identity/v3/users/79a8c67c9d7d4dca9be4d3c527cfbb58 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:11:46.951583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b5ddb-3486-45fe-a552-90ac3b519b6c service glance] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:46.967588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b5ddb-3486-45fe-a552-90ac3b519b6c service glance] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:47.074761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23005b7c-f9b4-4038-a13b-667d80f5461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:47.075509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23005b7c-f9b4-4038-a13b-667d80f5461b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:47.075882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23005b7c-f9b4-4038-a13b-667d80f5461b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:47.076225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23005b7c-f9b4-4038-a13b-667d80f5461b admin admin] PATH_INFO: `/v3/projects/95597889911b4dc2a1b381581e251741` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:47.077518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23005b7c-f9b4-4038-a13b-667d80f5461b admin admin] RBAC: Authorizing `identity:delete_project(project_id=95597889911b4dc2a1b381581e251741)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:47.079521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23005b7c-f9b4-4038-a13b-667d80f5461b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:47.137779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-23005b7c-f9b4-4038-a13b-667d80f5461b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95597889911b4dc2a1b381581e251741', 'request_id': 'req-23005b7c-f9b4-4038-a13b-667d80f5461b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:47.150960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-23005b7c-f9b4-4038-a13b-667d80f5461b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95597889911b4dc2a1b381581e251741', 'request_id': 'req-23005b7c-f9b4-4038-a13b-667d80f5461b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:47.162360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-23005b7c-f9b4-4038-a13b-667d80f5461b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95597889911b4dc2a1b381581e251741', 'request_id': 'req-23005b7c-f9b4-4038-a13b-667d80f5461b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:47.180017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-23005b7c-f9b4-4038-a13b-667d80f5461b admin admin] The token cache is being invalidate because project 95597889911b4dc2a1b381581e251741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:47.180422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-23005b7c-f9b4-4038-a13b-667d80f5461b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:47.181652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-23005b7c-f9b4-4038-a13b-667d80f5461b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:47.183156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1073/2151] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:46 2022] DELETE /identity/v3/projects/95597889911b4dc2a1b381581e251741 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:47.189469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde0c3d-d591-4b9a-bb92-400b609cac58 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:47.190344 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde0c3d-d591-4b9a-bb92-400b609cac58 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:47.190783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde0c3d-d591-4b9a-bb92-400b609cac58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:47.223131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-2cde0c3d-d591-4b9a-bb92-400b609cac58 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:47.225059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2cde0c3d-d591-4b9a-bb92-400b609cac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:47.303031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1079/2152] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:47.311075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932fb4-12b5-43ea-998c-ca16318014af None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:47.311648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932fb4-12b5-43ea-998c-ca16318014af None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:47.311940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932fb4-12b5-43ea-998c-ca16318014af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:47.336923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-3c932fb4-12b5-43ea-998c-ca16318014af None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:47.338232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3c932fb4-12b5-43ea-998c-ca16318014af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:47.350917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1074/2153] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:11:47.355872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde0c3d-d591-4b9a-bb92-400b609cac58 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:47.368398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde0c3d-d591-4b9a-bb92-400b609cac58 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:47.374081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344bb2f-64cd-4f4a-9965-6c6c4021b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:47.374796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344bb2f-64cd-4f4a-9965-6c6c4021b1cc admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:47.374984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344bb2f-64cd-4f4a-9965-6c6c4021b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:47.375267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344bb2f-64cd-4f4a-9965-6c6c4021b1cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:47.375941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344bb2f-64cd-4f4a-9965-6c6c4021b1cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:47.376250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344bb2f-64cd-4f4a-9965-6c6c4021b1cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:47.377912 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344bb2f-64cd-4f4a-9965-6c6c4021b1cc admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:47.393231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1080/2154] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:11:47.397377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932fb4-12b5-43ea-998c-ca16318014af None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:47.406767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932fb4-12b5-43ea-998c-ca16318014af None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:47.412011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf24729-faf3-4659-a443-1cd62667327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:47.412618 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24729-faf3-4659-a443-1cd62667327c admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:47.412928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24729-faf3-4659-a443-1cd62667327c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:47.413203 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24729-faf3-4659-a443-1cd62667327c admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:47.413842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf24729-faf3-4659-a443-1cd62667327c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:47.415741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf24729-faf3-4659-a443-1cd62667327c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:47.476602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1075/2155] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:47 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:47.480299 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344bb2f-64cd-4f4a-9965-6c6c4021b1cc admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:47.486025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:47.493804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344bb2f-64cd-4f4a-9965-6c6c4021b1cc admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:47.595851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5830e-01f8-4290-bde4-e27340e67e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:47.596773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5830e-01f8-4290-bde4-e27340e67e31 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:47.597209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5830e-01f8-4290-bde4-e27340e67e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:47.597675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5830e-01f8-4290-bde4-e27340e67e31 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:47.598785 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5830e-01f8-4290-bde4-e27340e67e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:47.601418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5830e-01f8-4290-bde4-e27340e67e31 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:47.660410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1081/2156] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:47 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:47.665619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf24729-faf3-4659-a443-1cd62667327c admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:47.679461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf24729-faf3-4659-a443-1cd62667327c admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:47.685931 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1ed8f-1dff-4e91-8410-ff793a73ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:47.686422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1ed8f-1dff-4e91-8410-ff793a73ff63 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:47.686715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1ed8f-1dff-4e91-8410-ff793a73ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:47.686992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1ed8f-1dff-4e91-8410-ff793a73ff63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:47.687654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1ed8f-1dff-4e91-8410-ff793a73ff63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:47.689514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1ed8f-1dff-4e91-8410-ff793a73ff63 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:47.704399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1076/2157] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:47.708757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5830e-01f8-4290-bde4-e27340e67e31 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:47.724896 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5830e-01f8-4290-bde4-e27340e67e31 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:47.737162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b363024-3ba7-4db9-a7a7-28eac3f404e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:47.738603 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b363024-3ba7-4db9-a7a7-28eac3f404e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:47.742018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b363024-3ba7-4db9-a7a7-28eac3f404e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:47.743474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b363024-3ba7-4db9-a7a7-28eac3f404e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:47.746266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b363024-3ba7-4db9-a7a7-28eac3f404e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:47.749188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b363024-3ba7-4db9-a7a7-28eac3f404e7 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:47.772334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1082/2158] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:11:47.778500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1ed8f-1dff-4e91-8410-ff793a73ff63 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:47.795283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1ed8f-1dff-4e91-8410-ff793a73ff63 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:47.801563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175cd13-5a56-4c84-9854-05ac23fcc899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:47.802546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175cd13-5a56-4c84-9854-05ac23fcc899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:47.802935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175cd13-5a56-4c84-9854-05ac23fcc899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:47.803959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175cd13-5a56-4c84-9854-05ac23fcc899 admin admin] PATH_INFO: `/v3/projects/5d7ce66add1c45f3ae7d23a8197985c4/users/69fdafd81039428aa80d050e5d07f3f4/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:47.807698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:47.835118 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175cd13-5a56-4c84-9854-05ac23fcc899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7ce66add1c45f3ae7d23a8197985c4, user_id=69fdafd81039428aa80d050e5d07f3f4, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:47.838453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175cd13-5a56-4c84-9854-05ac23fcc899 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:47.886335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1077/2159] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:47 2022] PUT /identity/v3/projects/5d7ce66add1c45f3ae7d23a8197985c4/users/69fdafd81039428aa80d050e5d07f3f4/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:47.898472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7b07-a9a1-4708-8e6b-b4bc5b27c093 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:47.898954 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7b07-a9a1-4708-8e6b-b4bc5b27c093 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:47.899532 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7b07-a9a1-4708-8e6b-b4bc5b27c093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:47.936227 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-dcdd7b07-a9a1-4708-8e6b-b4bc5b27c093 None None] MFA Rules not processed for user `69fdafd81039428aa80d050e5d07f3f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:47.937606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-dcdd7b07-a9a1-4708-8e6b-b4bc5b27c093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:48.137053 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1083/2160] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:48.158301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175cd13-5a56-4c84-9854-05ac23fcc899 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:48.160564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b175cd13-5a56-4c84-9854-05ac23fcc899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:48.275258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175cd13-5a56-4c84-9854-05ac23fcc899 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:48.291085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636eb92-14fe-4581-a9dd-b81d688ca928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:48.291808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636eb92-14fe-4581-a9dd-b81d688ca928 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:48.292163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636eb92-14fe-4581-a9dd-b81d688ca928 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:48.292510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636eb92-14fe-4581-a9dd-b81d688ca928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:48.302458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636eb92-14fe-4581-a9dd-b81d688ca928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:48.304157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636eb92-14fe-4581-a9dd-b81d688ca928 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:48.319263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1078/2161] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:49.145261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1dacd-7a07-4825-a510-e1497d162007 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:49.146351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1dacd-7a07-4825-a510-e1497d162007 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:49.147138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1dacd-7a07-4825-a510-e1497d162007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:49.199204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-bfb1dacd-7a07-4825-a510-e1497d162007 None None] MFA Rules not processed for user `1beb3cf542bf4cc1802f90ad14a29017`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:49.200474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-bfb1dacd-7a07-4825-a510-e1497d162007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:49.302657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:49.317963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1084/2162] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:49.325356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636eb92-14fe-4581-a9dd-b81d688ca928 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:49.327092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5636eb92-14fe-4581-a9dd-b81d688ca928 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:49.494754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636eb92-14fe-4581-a9dd-b81d688ca928 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:49.500391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad61ee9-babf-4c2e-8a1a-b07527b9a626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:49.502626 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad61ee9-babf-4c2e-8a1a-b07527b9a626 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:49.502980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad61ee9-babf-4c2e-8a1a-b07527b9a626 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:49.503603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad61ee9-babf-4c2e-8a1a-b07527b9a626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:49.516184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad61ee9-babf-4c2e-8a1a-b07527b9a626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:49.517827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad61ee9-babf-4c2e-8a1a-b07527b9a626 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:49.529128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1079/2163] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:51.552336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cf640-2004-4483-9fea-46d6da19efbb None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:51.552862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cf640-2004-4483-9fea-46d6da19efbb None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:51.553990 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cf640-2004-4483-9fea-46d6da19efbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:51.587524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-cd7cf640-2004-4483-9fea-46d6da19efbb None None] MFA Rules not processed for user `1beb3cf542bf4cc1802f90ad14a29017`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:51.589943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-cd7cf640-2004-4483-9fea-46d6da19efbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:51.601530 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1085/2164] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:52.698245 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad61ee9-babf-4c2e-8a1a-b07527b9a626 service nova] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:52.700728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7ad61ee9-babf-4c2e-8a1a-b07527b9a626 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:52.813484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad61ee9-babf-4c2e-8a1a-b07527b9a626 service nova] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:52.823638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:52.824468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:52.824845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:52.825062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] PATH_INFO: `/v3/users/771c738d923849cf810bfcddb61e43d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:52.827314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771c738d923849cf810bfcddb61e43d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:52.831048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:52.850597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:52.916289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771c738d923849cf810bfcddb61e43d4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:52.928699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771c738d923849cf810bfcddb61e43d4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:52.929378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771c738d923849cf810bfcddb61e43d4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:52.930037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771c738d923849cf810bfcddb61e43d4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:52.952072 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771c738d923849cf810bfcddb61e43d4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:52.978265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1080/2165] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:52 2022] DELETE /identity/v3/users/771c738d923849cf810bfcddb61e43d4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:52.979361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b182db2-69ca-4017-afb6-646a7a97f1a8 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:52.979840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b182db2-69ca-4017-afb6-646a7a97f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:52.979947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b182db2-69ca-4017-afb6-646a7a97f1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:53.003570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-1b182db2-69ca-4017-afb6-646a7a97f1a8 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:53.005055 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1b182db2-69ca-4017-afb6-646a7a97f1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:53.093993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1086/2166] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:53.107638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:53.109717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:53.232707 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17b16c-0d7e-4725-868e-92a5e08ef077 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:53.241147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbf38b-194a-4dc0-a2e5-6286c199d057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:53.241977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbf38b-194a-4dc0-a2e5-6286c199d057 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:53.242373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbf38b-194a-4dc0-a2e5-6286c199d057 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:53.242555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbf38b-194a-4dc0-a2e5-6286c199d057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:53.273601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbf38b-194a-4dc0-a2e5-6286c199d057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:53.275563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbf38b-194a-4dc0-a2e5-6286c199d057 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:53.311127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1081/2167] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:53.722005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b182db2-69ca-4017-afb6-646a7a97f1a8 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:53.723690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1b182db2-69ca-4017-afb6-646a7a97f1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:53.737348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b182db2-69ca-4017-afb6-646a7a97f1a8 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:53.755312 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:53.756544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:53.757164 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:53.757653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd admin admin] PATH_INFO: `/v3/projects/3c43bb4c1f174a88bbc3c4efb9a08d7f` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:53.759930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c43bb4c1f174a88bbc3c4efb9a08d7f)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:53.764522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:53.872726 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c43bb4c1f174a88bbc3c4efb9a08d7f', 'request_id': 'req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:53.894069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c43bb4c1f174a88bbc3c4efb9a08d7f', 'request_id': 'req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:53.905308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbf38b-194a-4dc0-a2e5-6286c199d057 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:53.907753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-32dbf38b-194a-4dc0-a2e5-6286c199d057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:53.910402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c43bb4c1f174a88bbc3c4efb9a08d7f', 'request_id': 'req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:53.928657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd admin admin] The token cache is being invalidate because project 3c43bb4c1f174a88bbc3c4efb9a08d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:53.929004 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:53.929698 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-07d5ab2a-25fa-4f9e-96e8-ca8b672d36dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:53.935318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1087/2168] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:53 2022] DELETE /identity/v3/projects/3c43bb4c1f174a88bbc3c4efb9a08d7f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:53.938187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbf38b-194a-4dc0-a2e5-6286c199d057 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:53.949800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c73e-8892-4362-b729-b9b8999b64cb None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:53.950128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c73e-8892-4362-b729-b9b8999b64cb None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:53.950351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c73e-8892-4362-b729-b9b8999b64cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:53.987340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c575c73e-8892-4362-b729-b9b8999b64cb None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:53.992353 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c575c73e-8892-4362-b729-b9b8999b64cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:54.086025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65180a12-de5d-48f2-a15c-6e33811ebcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:54.086810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65180a12-de5d-48f2-a15c-6e33811ebcac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:54.087101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65180a12-de5d-48f2-a15c-6e33811ebcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:54.087370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65180a12-de5d-48f2-a15c-6e33811ebcac admin admin] PATH_INFO: `/v3/users/f6370a19e6be4f4982129aa4986a4c7a` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:54.088509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65180a12-de5d-48f2-a15c-6e33811ebcac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6370a19e6be4f4982129aa4986a4c7a)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:54.090767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65180a12-de5d-48f2-a15c-6e33811ebcac admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:54.109277 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1088/2169] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:54.119360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc4bb8-2a12-40da-819d-e7d1e9397aa1 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:54.119496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc4bb8-2a12-40da-819d-e7d1e9397aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:54.119699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc4bb8-2a12-40da-819d-e7d1e9397aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:54.142310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:54.147984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-71fc4bb8-2a12-40da-819d-e7d1e9397aa1 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:54.149271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-71fc4bb8-2a12-40da-819d-e7d1e9397aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:54.155334 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-65180a12-de5d-48f2-a15c-6e33811ebcac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6370a19e6be4f4982129aa4986a4c7a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:54.158342 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1089/2170] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:54.164495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc4bb8-2a12-40da-819d-e7d1e9397aa1 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:54.185497 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-65180a12-de5d-48f2-a15c-6e33811ebcac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6370a19e6be4f4982129aa4986a4c7a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:54.188222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-65180a12-de5d-48f2-a15c-6e33811ebcac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6370a19e6be4f4982129aa4986a4c7a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:54.189622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-65180a12-de5d-48f2-a15c-6e33811ebcac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6370a19e6be4f4982129aa4986a4c7a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:54.194439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc4bb8-2a12-40da-819d-e7d1e9397aa1 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:54.201541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bf589-28e1-46ac-938a-de99dd7538bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:54.202544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf589-28e1-46ac-938a-de99dd7538bd admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:54.202836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf589-28e1-46ac-938a-de99dd7538bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:54.203111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf589-28e1-46ac-938a-de99dd7538bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:54.203777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bf589-28e1-46ac-938a-de99dd7538bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:11:54.204080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bf589-28e1-46ac-938a-de99dd7538bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:54.205739 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bf589-28e1-46ac-938a-de99dd7538bd admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:54.220309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-65180a12-de5d-48f2-a15c-6e33811ebcac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6370a19e6be4f4982129aa4986a4c7a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:54.224651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:54.244722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1082/2171] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:11:53 2022] DELETE /identity/v3/users/f6370a19e6be4f4982129aa4986a4c7a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:54.248365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5773a-cb6f-4e0d-b76d-9b43d3c0105c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:54.248365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5773a-cb6f-4e0d-b76d-9b43d3c0105c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:54.248606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5773a-cb6f-4e0d-b76d-9b43d3c0105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:54.263529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1090/2172] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:11:54.267761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bf589-28e1-46ac-938a-de99dd7538bd admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:54.275698 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-997bf589-28e1-46ac-938a-de99dd7538bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:54.281377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f2a5773a-cb6f-4e0d-b76d-9b43d3c0105c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:54.283979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f2a5773a-cb6f-4e0d-b76d-9b43d3c0105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:54.303587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bf589-28e1-46ac-938a-de99dd7538bd admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:54.424738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1083/2173] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:54.439202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5773a-cb6f-4e0d-b76d-9b43d3c0105c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:54.441023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f2a5773a-cb6f-4e0d-b76d-9b43d3c0105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:54.459756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cfbb0-5943-4779-ab5a-637e72816c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:54.461038 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cfbb0-5943-4779-ab5a-637e72816c8f admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:54.461883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cfbb0-5943-4779-ab5a-637e72816c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:54.462313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cfbb0-5943-4779-ab5a-637e72816c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:54.465516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cfbb0-5943-4779-ab5a-637e72816c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:54.470102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cfbb0-5943-4779-ab5a-637e72816c8f admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:54.561289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1091/2174] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:11:54 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:11:54.562388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cfbb0-5943-4779-ab5a-637e72816c8f admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:54.606933 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5773a-cb6f-4e0d-b76d-9b43d3c0105c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:54.744528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cfbb0-5943-4779-ab5a-637e72816c8f admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:54.747390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78284e8d-111b-4b79-b479-5ffbb79061b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:54.749243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78284e8d-111b-4b79-b479-5ffbb79061b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:54.749534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78284e8d-111b-4b79-b479-5ffbb79061b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:54.749811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78284e8d-111b-4b79-b479-5ffbb79061b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:54.760748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f973f1-8f9d-4595-94d1-d823ff25df31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:54.761597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f973f1-8f9d-4595-94d1-d823ff25df31 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:54.762663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f973f1-8f9d-4595-94d1-d823ff25df31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:54.762663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f973f1-8f9d-4595-94d1-d823ff25df31 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:54.763175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f973f1-8f9d-4595-94d1-d823ff25df31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:54.766036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f973f1-8f9d-4595-94d1-d823ff25df31 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:54.766566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78284e8d-111b-4b79-b479-5ffbb79061b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:54.768529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78284e8d-111b-4b79-b479-5ffbb79061b0 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:54.788308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1084/2175] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:11:54.816191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1092/2176] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:11:54 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:11:54.818308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78284e8d-111b-4b79-b479-5ffbb79061b0 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:54.831017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78284e8d-111b-4b79-b479-5ffbb79061b0 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:54.845555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a46f7-cea8-4d3a-9140-fc3b16e1cfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:54.846510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a46f7-cea8-4d3a-9140-fc3b16e1cfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:54.846800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a46f7-cea8-4d3a-9140-fc3b16e1cfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:54.847080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a46f7-cea8-4d3a-9140-fc3b16e1cfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:54.850678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a46f7-cea8-4d3a-9140-fc3b16e1cfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:54.853202 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a46f7-cea8-4d3a-9140-fc3b16e1cfb1 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:54.865510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:54.882547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1085/2177] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:54.886916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f973f1-8f9d-4595-94d1-d823ff25df31 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:54.905757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f973f1-8f9d-4595-94d1-d823ff25df31 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:54.915020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb316a-f20c-4400-a11c-49fdc398ee09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:54.915730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb316a-f20c-4400-a11c-49fdc398ee09 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:54.916017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb316a-f20c-4400-a11c-49fdc398ee09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:54.916803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb316a-f20c-4400-a11c-49fdc398ee09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:54.917693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb316a-f20c-4400-a11c-49fdc398ee09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:54.920504 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb316a-f20c-4400-a11c-49fdc398ee09 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:54.939391 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1093/2178] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:11:54.940648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a46f7-cea8-4d3a-9140-fc3b16e1cfb1 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:54.968977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a46f7-cea8-4d3a-9140-fc3b16e1cfb1 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:54.968977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6135-eda1-40dc-948f-e87213602c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:54.968977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6135-eda1-40dc-948f-e87213602c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:54.968977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6135-eda1-40dc-948f-e87213602c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:54.969406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6135-eda1-40dc-948f-e87213602c11 admin admin] PATH_INFO: `/v3/projects/b0f144385d074e81893102eb5efbd622/users/8d2d05ce8a38478a85028fe15c3e3ecc/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:55.004010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6135-eda1-40dc-948f-e87213602c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f144385d074e81893102eb5efbd622, user_id=8d2d05ce8a38478a85028fe15c3e3ecc, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:55.015279 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6135-eda1-40dc-948f-e87213602c11 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:55.053192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1086/2179] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:11:54 2022] PUT /identity/v3/projects/b0f144385d074e81893102eb5efbd622/users/8d2d05ce8a38478a85028fe15c3e3ecc/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:11:55.063491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b9b25-8fb2-4ea2-9016-0ef6de86e15b None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:55.064001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b9b25-8fb2-4ea2-9016-0ef6de86e15b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:55.064078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b9b25-8fb2-4ea2-9016-0ef6de86e15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:55.112830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-2f5b9b25-8fb2-4ea2-9016-0ef6de86e15b None None] MFA Rules not processed for user `8d2d05ce8a38478a85028fe15c3e3ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:11:55.114934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2f5b9b25-8fb2-4ea2-9016-0ef6de86e15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:55.181662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:55.204635 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1094/2180] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:11:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:11:55.218978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6135-eda1-40dc-948f-e87213602c11 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:55.220887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0f9a6135-eda1-40dc-948f-e87213602c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:55.308926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6135-eda1-40dc-948f-e87213602c11 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:55.315724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24775ba-f656-4e6a-8166-95220a6d3595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:55.316536 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24775ba-f656-4e6a-8166-95220a6d3595 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:55.318993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24775ba-f656-4e6a-8166-95220a6d3595 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:55.318993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24775ba-f656-4e6a-8166-95220a6d3595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:55.329386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24775ba-f656-4e6a-8166-95220a6d3595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:55.331039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24775ba-f656-4e6a-8166-95220a6d3595 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:55.344368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1087/2181] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:11:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:11:55.356757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b9b25-8fb2-4ea2-9016-0ef6de86e15b None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:11:55.357546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2f5b9b25-8fb2-4ea2-9016-0ef6de86e15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:11:55.496197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b9b25-8fb2-4ea2-9016-0ef6de86e15b None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:11:55.504927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:11:55.504927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:11:55.504927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:11:55.504927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] PATH_INFO: `/v3/projects/23c8e5e3fc1643a6b226bbf3ad71d163` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:11:55.507122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c8e5e3fc1643a6b226bbf3ad71d163)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:11:55.509399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:11:55.668123 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c8e5e3fc1643a6b226bbf3ad71d163', 'request_id': 'req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:55.677357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c8e5e3fc1643a6b226bbf3ad71d163', 'request_id': 'req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:55.690065 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c8e5e3fc1643a6b226bbf3ad71d163', 'request_id': 'req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:55.706111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] The token cache is being invalidate because project 23c8e5e3fc1643a6b226bbf3ad71d163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:11:55.706488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:55.707370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:11:55.710905 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1095/2182] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:11:55 2022] DELETE /identity/v3/projects/23c8e5e3fc1643a6b226bbf3ad71d163 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:00.186825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24775ba-f656-4e6a-8166-95220a6d3595 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:00.188664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e24775ba-f656-4e6a-8166-95220a6d3595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:00.204147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24775ba-f656-4e6a-8166-95220a6d3595 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:00.262565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:00.263207 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:00.263484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:00.263758 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] PATH_INFO: `/v3/users/91b99005247f4d1c975676c93e18bbad` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:00.264940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b99005247f4d1c975676c93e18bbad)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:00.266845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:00.321619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b99005247f4d1c975676c93e18bbad'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.331706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b99005247f4d1c975676c93e18bbad'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.332391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b99005247f4d1c975676c93e18bbad'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.333045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b99005247f4d1c975676c93e18bbad'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.348788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b99005247f4d1c975676c93e18bbad'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.357397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:00.364142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1088/2183] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:00 2022] DELETE /identity/v3/users/91b99005247f4d1c975676c93e18bbad => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:00.560597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:00.562216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:00.586561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835af7a-ae93-43e2-a61b-0f2c6e231b7b admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:00.660307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:00.660907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:00.661194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:00.661470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] PATH_INFO: `/v3/projects/4cd9c72d228341c589cb361eb1cb0068` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:00.663184 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd9c72d228341c589cb361eb1cb0068)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:00.665199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:00.695652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:00.721351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd9c72d228341c589cb361eb1cb0068', 'request_id': 'req-58658168-f3b3-47a7-a2b1-c1962ae44fca'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.730351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd9c72d228341c589cb361eb1cb0068', 'request_id': 'req-58658168-f3b3-47a7-a2b1-c1962ae44fca'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.738898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd9c72d228341c589cb361eb1cb0068', 'request_id': 'req-58658168-f3b3-47a7-a2b1-c1962ae44fca'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.751830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] The token cache is being invalidate because project 4cd9c72d228341c589cb361eb1cb0068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:00.752087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.752800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.754357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1096/2184] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:00 2022] DELETE /identity/v3/projects/4cd9c72d228341c589cb361eb1cb0068 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:00.759267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:00.760926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:00.774839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d81e49-4ae4-4629-907d-2e4ff220eb86 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:00.843933 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ea4de-d95d-4eb0-9744-14a05829e0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:00.844600 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ea4de-d95d-4eb0-9744-14a05829e0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:00.844939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ea4de-d95d-4eb0-9744-14a05829e0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:00.845213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ea4de-d95d-4eb0-9744-14a05829e0cb admin admin] PATH_INFO: `/v3/users/7ab1490f0f51486faab10cb1794620f6` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:00.846332 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ea4de-d95d-4eb0-9744-14a05829e0cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab1490f0f51486faab10cb1794620f6)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:00.848257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ea4de-d95d-4eb0-9744-14a05829e0cb admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:00.903724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-4d5ea4de-d95d-4eb0-9744-14a05829e0cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab1490f0f51486faab10cb1794620f6'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.911969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-4d5ea4de-d95d-4eb0-9744-14a05829e0cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab1490f0f51486faab10cb1794620f6'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.912594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-4d5ea4de-d95d-4eb0-9744-14a05829e0cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab1490f0f51486faab10cb1794620f6'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.913247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-4d5ea4de-d95d-4eb0-9744-14a05829e0cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab1490f0f51486faab10cb1794620f6'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.925392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-4d5ea4de-d95d-4eb0-9744-14a05829e0cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab1490f0f51486faab10cb1794620f6'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:00.937825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1089/2185] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:00 2022] DELETE /identity/v3/users/7ab1490f0f51486faab10cb1794620f6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:01.116325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:01.118406 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:01.137544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58658168-f3b3-47a7-a2b1-c1962ae44fca admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:01.211138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:01.211797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.212083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.212359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] PATH_INFO: `/v3/projects/7b9f2edf1d604c6dbf43802f64d81090` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.213553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9f2edf1d604c6dbf43802f64d81090)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:01.215496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:01.299917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9f2edf1d604c6dbf43802f64d81090', 'request_id': 'req-e7e1e761-8b16-4894-ae26-5c2e2d133a74'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:01.305764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9f2edf1d604c6dbf43802f64d81090', 'request_id': 'req-e7e1e761-8b16-4894-ae26-5c2e2d133a74'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:01.314634 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9f2edf1d604c6dbf43802f64d81090', 'request_id': 'req-e7e1e761-8b16-4894-ae26-5c2e2d133a74'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:01.327453 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] The token cache is being invalidate because project 7b9f2edf1d604c6dbf43802f64d81090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:01.327749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:01.328524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:01.330051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1097/2186] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:01 2022] DELETE /identity/v3/projects/7b9f2edf1d604c6dbf43802f64d81090 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:01.338184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5edbf-d4d6-427f-8997-8a14f41108ea None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.338692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5edbf-d4d6-427f-8997-8a14f41108ea None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.338809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5edbf-d4d6-427f-8997-8a14f41108ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.360670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-0da5edbf-d4d6-427f-8997-8a14f41108ea None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:01.361971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0da5edbf-d4d6-427f-8997-8a14f41108ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:01.423612 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:01.425158 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:01.441963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1090/2187] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:01.451168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502f4c3-756c-4a41-a359-033386e91e19 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.451451 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502f4c3-756c-4a41-a359-033386e91e19 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.451716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502f4c3-756c-4a41-a359-033386e91e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.476017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-e502f4c3-756c-4a41-a359-033386e91e19 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:01.477318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e502f4c3-756c-4a41-a359-033386e91e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:01.478351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:01.486346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1091/2188] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:01.490976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502f4c3-756c-4a41-a359-033386e91e19 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:01.500355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1e761-8b16-4894-ae26-5c2e2d133a74 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:01.501171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502f4c3-756c-4a41-a359-033386e91e19 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:01.505157 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8f285-5b67-4da8-983c-32b9db677001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:01.506294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8f285-5b67-4da8-983c-32b9db677001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.506459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f92b58-6f3f-4796-985e-bc82eedeb4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:01.506617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8f285-5b67-4da8-983c-32b9db677001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.506830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8f285-5b67-4da8-983c-32b9db677001 admin admin] PATH_INFO: `/v3/users/8d2d05ce8a38478a85028fe15c3e3ecc` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.507172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f92b58-6f3f-4796-985e-bc82eedeb4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.507453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f92b58-6f3f-4796-985e-bc82eedeb4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.507726 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f92b58-6f3f-4796-985e-bc82eedeb4f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.507993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8f285-5b67-4da8-983c-32b9db677001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d2d05ce8a38478a85028fe15c3e3ecc)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:01.508370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f92b58-6f3f-4796-985e-bc82eedeb4f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:12:01.508670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f92b58-6f3f-4796-985e-bc82eedeb4f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:01.509967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8f285-5b67-4da8-983c-32b9db677001 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:01.510262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f92b58-6f3f-4796-985e-bc82eedeb4f5 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:01.517519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:01.528238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1092/2189] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:12:01.529586 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f92b58-6f3f-4796-985e-bc82eedeb4f5 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:01.541830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f92b58-6f3f-4796-985e-bc82eedeb4f5 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:01.548419 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25144f-e76c-4d47-af29-daa5c49c5d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:01.549170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25144f-e76c-4d47-af29-daa5c49c5d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.549508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25144f-e76c-4d47-af29-daa5c49c5d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.549838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25144f-e76c-4d47-af29-daa5c49c5d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.550708 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25144f-e76c-4d47-af29-daa5c49c5d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:01.553691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25144f-e76c-4d47-af29-daa5c49c5d2b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:01.570168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dcd8f285-5b67-4da8-983c-32b9db677001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d2d05ce8a38478a85028fe15c3e3ecc'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:01.578764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dcd8f285-5b67-4da8-983c-32b9db677001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d2d05ce8a38478a85028fe15c3e3ecc'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:01.587185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1093/2190] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:01 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:01.591382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25144f-e76c-4d47-af29-daa5c49c5d2b admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:01.593475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dcd8f285-5b67-4da8-983c-32b9db677001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d2d05ce8a38478a85028fe15c3e3ecc'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:01.594169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dcd8f285-5b67-4da8-983c-32b9db677001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d2d05ce8a38478a85028fe15c3e3ecc'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:01.594777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dcd8f285-5b67-4da8-983c-32b9db677001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d2d05ce8a38478a85028fe15c3e3ecc'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:01.607952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1098/2191] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:01 2022] DELETE /identity/v3/users/8d2d05ce8a38478a85028fe15c3e3ecc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:12:01.614380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07477a34-1aa2-4006-aa95-7f6f5413c1c9 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.614699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07477a34-1aa2-4006-aa95-7f6f5413c1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.614981 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07477a34-1aa2-4006-aa95-7f6f5413c1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.635198 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-07477a34-1aa2-4006-aa95-7f6f5413c1c9 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:01.636403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-07477a34-1aa2-4006-aa95-7f6f5413c1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:01.664446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25144f-e76c-4d47-af29-daa5c49c5d2b admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:01.715403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1099/2192] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:01.729167 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07477a34-1aa2-4006-aa95-7f6f5413c1c9 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:01.730704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-07477a34-1aa2-4006-aa95-7f6f5413c1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:01.738391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60471b-380a-4b8e-a648-06729a56a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:01.739153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60471b-380a-4b8e-a648-06729a56a5bb admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.740509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60471b-380a-4b8e-a648-06729a56a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.740625 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60471b-380a-4b8e-a648-06729a56a5bb admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.741462 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60471b-380a-4b8e-a648-06729a56a5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:01.743543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60471b-380a-4b8e-a648-06729a56a5bb admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:01.772665 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1094/2193] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:01 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:12:01.776854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60471b-380a-4b8e-a648-06729a56a5bb admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:01.778655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3d60471b-380a-4b8e-a648-06729a56a5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:01.793895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60471b-380a-4b8e-a648-06729a56a5bb admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:01.799299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b6443-b884-4aff-a33c-66f9cbd77442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:01.800110 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b6443-b884-4aff-a33c-66f9cbd77442 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.800477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b6443-b884-4aff-a33c-66f9cbd77442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.800932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b6443-b884-4aff-a33c-66f9cbd77442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.801540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b6443-b884-4aff-a33c-66f9cbd77442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:01.803336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b6443-b884-4aff-a33c-66f9cbd77442 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:01.812304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07477a34-1aa2-4006-aa95-7f6f5413c1c9 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:01.814339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1095/2194] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:12:01.816191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0ea22-1476-4d77-b2e3-026154c698b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:01.816838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ea22-1476-4d77-b2e3-026154c698b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.817258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ea22-1476-4d77-b2e3-026154c698b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.818212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ea22-1476-4d77-b2e3-026154c698b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.818442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b6443-b884-4aff-a33c-66f9cbd77442 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:01.832115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b6443-b884-4aff-a33c-66f9cbd77442 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:01.833040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0ea22-1476-4d77-b2e3-026154c698b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:01.835817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0ea22-1476-4d77-b2e3-026154c698b3 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:01.837627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e93f36-7a5b-43d8-b4a5-b2c784e813be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:01.838238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e93f36-7a5b-43d8-b4a5-b2c784e813be admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.838514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e93f36-7a5b-43d8-b4a5-b2c784e813be admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.838788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e93f36-7a5b-43d8-b4a5-b2c784e813be admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.839573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e93f36-7a5b-43d8-b4a5-b2c784e813be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:01.841200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e93f36-7a5b-43d8-b4a5-b2c784e813be admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:01.847910 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1100/2195] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:01.855904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1096/2196] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:01.860907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0ea22-1476-4d77-b2e3-026154c698b3 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:01.870459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:01.875545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0ea22-1476-4d77-b2e3-026154c698b3 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:01.887113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5e16b-e6b2-4bb1-8372-ea022d45cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:01.888312 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5e16b-e6b2-4bb1-8372-ea022d45cda1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.888643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5e16b-e6b2-4bb1-8372-ea022d45cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.889097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5e16b-e6b2-4bb1-8372-ea022d45cda1 admin admin] PATH_INFO: `/v3/projects/acd6cf0f3d7d4c5fbc4286498eb46b24/users/9e6a21c823b44ea8899ce1da2d1e0494/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.921765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5e16b-e6b2-4bb1-8372-ea022d45cda1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd6cf0f3d7d4c5fbc4286498eb46b24, user_id=9e6a21c823b44ea8899ce1da2d1e0494, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:01.925079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5e16b-e6b2-4bb1-8372-ea022d45cda1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:01.945608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1101/2197] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:01 2022] PUT /identity/v3/projects/acd6cf0f3d7d4c5fbc4286498eb46b24/users/9e6a21c823b44ea8899ce1da2d1e0494/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:01.956388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68778357-0a8b-42c8-bf84-83ef1f025c8a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:01.956709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68778357-0a8b-42c8-bf84-83ef1f025c8a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:01.957010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68778357-0a8b-42c8-bf84-83ef1f025c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:01.992389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-68778357-0a8b-42c8-bf84-83ef1f025c8a None None] MFA Rules not processed for user `9e6a21c823b44ea8899ce1da2d1e0494`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:01.994170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-68778357-0a8b-42c8-bf84-83ef1f025c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:02.073142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:02.112014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1097/2198] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:02.124168 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5e16b-e6b2-4bb1-8372-ea022d45cda1 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:02.139480 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-cdb5e16b-e6b2-4bb1-8372-ea022d45cda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:02.206550 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68778357-0a8b-42c8-bf84-83ef1f025c8a None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:02.209066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5e16b-e6b2-4bb1-8372-ea022d45cda1 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:02.211748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-68778357-0a8b-42c8-bf84-83ef1f025c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:02.212846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db1b6e-1acd-49bb-b2a2-25beee8a811d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:02.213536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db1b6e-1acd-49bb-b2a2-25beee8a811d service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:02.213742 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db1b6e-1acd-49bb-b2a2-25beee8a811d service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:02.214169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db1b6e-1acd-49bb-b2a2-25beee8a811d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:02.225999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db1b6e-1acd-49bb-b2a2-25beee8a811d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:02.227479 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db1b6e-1acd-49bb-b2a2-25beee8a811d service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:02.238906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1102/2199] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:02.265795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db1b6e-1acd-49bb-b2a2-25beee8a811d service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:02.316545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68778357-0a8b-42c8-bf84-83ef1f025c8a None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:02.322787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:02.323434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:02.323827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:02.324155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b admin admin] PATH_INFO: `/v3/projects/b0f144385d074e81893102eb5efbd622` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:02.325308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f144385d074e81893102eb5efbd622)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:02.327601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:02.341699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db1b6e-1acd-49bb-b2a2-25beee8a811d service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:02.346727 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc1e4e-aa4d-455f-873f-303698c15ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:02.347427 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc1e4e-aa4d-455f-873f-303698c15ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:02.347900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc1e4e-aa4d-455f-873f-303698c15ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:02.348243 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc1e4e-aa4d-455f-873f-303698c15ea0 admin admin] PATH_INFO: `/v3/users/9e6a21c823b44ea8899ce1da2d1e0494` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:02.349749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc1e4e-aa4d-455f-873f-303698c15ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6a21c823b44ea8899ce1da2d1e0494)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:02.351770 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc1e4e-aa4d-455f-873f-303698c15ea0 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:02.381264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f144385d074e81893102eb5efbd622', 'request_id': 'req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:02.390591 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f144385d074e81893102eb5efbd622', 'request_id': 'req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:02.399315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f144385d074e81893102eb5efbd622', 'request_id': 'req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:02.411825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b admin admin] The token cache is being invalidate because project b0f144385d074e81893102eb5efbd622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:02.412075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:02.413741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c0a78040-e0d3-4b80-99f7-d49bfa64f65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:02.415656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1098/2200] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:02 2022] DELETE /identity/v3/projects/b0f144385d074e81893102eb5efbd622 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:02.416106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-15cc1e4e-aa4d-455f-873f-303698c15ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6a21c823b44ea8899ce1da2d1e0494'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:02.420908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0717043-d546-4ce3-945b-45a0244ce1bf None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:02.421286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0717043-d546-4ce3-945b-45a0244ce1bf None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:02.421463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0717043-d546-4ce3-945b-45a0244ce1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:02.434936 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-15cc1e4e-aa4d-455f-873f-303698c15ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6a21c823b44ea8899ce1da2d1e0494'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:02.454978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b0717043-d546-4ce3-945b-45a0244ce1bf None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:02.456445 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b0717043-d546-4ce3-945b-45a0244ce1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:02.465579 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-15cc1e4e-aa4d-455f-873f-303698c15ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6a21c823b44ea8899ce1da2d1e0494'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:02.466374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-15cc1e4e-aa4d-455f-873f-303698c15ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6a21c823b44ea8899ce1da2d1e0494'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:02.466997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-15cc1e4e-aa4d-455f-873f-303698c15ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6a21c823b44ea8899ce1da2d1e0494'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:02.488513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1103/2201] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:02 2022] DELETE /identity/v3/users/9e6a21c823b44ea8899ce1da2d1e0494 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:12:02.491616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfb1d1-7729-40ee-a2a2-df899bfb530d None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:02.491911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfb1d1-7729-40ee-a2a2-df899bfb530d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:02.492185 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfb1d1-7729-40ee-a2a2-df899bfb530d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:02.501306 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:02.519479 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-59cfb1d1-7729-40ee-a2a2-df899bfb530d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:02.522112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-59cfb1d1-7729-40ee-a2a2-df899bfb530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:02.545134 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1099/2202] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:02.553136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85933dd-3c1d-40e8-82ae-771a4a179a06 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:02.553554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85933dd-3c1d-40e8-82ae-771a4a179a06 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:02.553831 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85933dd-3c1d-40e8-82ae-771a4a179a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:02.585017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f85933dd-3c1d-40e8-82ae-771a4a179a06 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:02.586247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f85933dd-3c1d-40e8-82ae-771a4a179a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:02.597548 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:02.602127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1104/2203] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:02.611584 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfb1d1-7729-40ee-a2a2-df899bfb530d None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:02.613415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-59cfb1d1-7729-40ee-a2a2-df899bfb530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:02.695688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfb1d1-7729-40ee-a2a2-df899bfb530d None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:02.704216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b17c9-1dac-4410-bf1d-b17f7812a560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:02.705037 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b17c9-1dac-4410-bf1d-b17f7812a560 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:02.705365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b17c9-1dac-4410-bf1d-b17f7812a560 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:02.705644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b17c9-1dac-4410-bf1d-b17f7812a560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:02.718502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b17c9-1dac-4410-bf1d-b17f7812a560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:02.722898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b17c9-1dac-4410-bf1d-b17f7812a560 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:02.731222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1100/2204] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:02.735667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85933dd-3c1d-40e8-82ae-771a4a179a06 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:02.749097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1105/2205] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:12:02.751243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85933dd-3c1d-40e8-82ae-771a4a179a06 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:02.756458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0969ea3-558d-48d9-b312-0f737eee37f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:02.757063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969ea3-558d-48d9-b312-0f737eee37f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:02.757347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969ea3-558d-48d9-b312-0f737eee37f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:02.757623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969ea3-558d-48d9-b312-0f737eee37f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:02.758309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0969ea3-558d-48d9-b312-0f737eee37f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:12:02.758615 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0969ea3-558d-48d9-b312-0f737eee37f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:02.760206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0969ea3-558d-48d9-b312-0f737eee37f2 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:02.772731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1101/2206] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:12:02.777366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b17c9-1dac-4410-bf1d-b17f7812a560 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:02.788971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b17c9-1dac-4410-bf1d-b17f7812a560 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:02.795802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d0a3b-1488-48de-82ce-7902e5376466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:02.796601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d0a3b-1488-48de-82ce-7902e5376466 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:02.796924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d0a3b-1488-48de-82ce-7902e5376466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:02.797207 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d0a3b-1488-48de-82ce-7902e5376466 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:02.797869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d0a3b-1488-48de-82ce-7902e5376466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:02.799825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d0a3b-1488-48de-82ce-7902e5376466 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:02.835395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1106/2207] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:02 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:02.840275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0969ea3-558d-48d9-b312-0f737eee37f2 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:02.853041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0969ea3-558d-48d9-b312-0f737eee37f2 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:02.976437 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6201c-45c7-47b2-9f72-ebe3991c6041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:02.977124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6201c-45c7-47b2-9f72-ebe3991c6041 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:02.977407 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6201c-45c7-47b2-9f72-ebe3991c6041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:02.977680 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6201c-45c7-47b2-9f72-ebe3991c6041 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:02.978349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6201c-45c7-47b2-9f72-ebe3991c6041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:02.980829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6201c-45c7-47b2-9f72-ebe3991c6041 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.012730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1102/2208] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:02 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:12:03.017148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d0a3b-1488-48de-82ce-7902e5376466 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.028751 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d0a3b-1488-48de-82ce-7902e5376466 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.033871 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55281c-3ed1-47e6-b6e6-6d86d425b521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.034585 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55281c-3ed1-47e6-b6e6-6d86d425b521 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.034943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55281c-3ed1-47e6-b6e6-6d86d425b521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.035293 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55281c-3ed1-47e6-b6e6-6d86d425b521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.036018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55281c-3ed1-47e6-b6e6-6d86d425b521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.037799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55281c-3ed1-47e6-b6e6-6d86d425b521 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.050888 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1107/2209] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:03.052899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6201c-45c7-47b2-9f72-ebe3991c6041 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.063332 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6201c-45c7-47b2-9f72-ebe3991c6041 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.069436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e2f9f-e8ac-4de7-ae6d-8be51d15f447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.070051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2f9f-e8ac-4de7-ae6d-8be51d15f447 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.070334 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2f9f-e8ac-4de7-ae6d-8be51d15f447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.070611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2f9f-e8ac-4de7-ae6d-8be51d15f447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.071359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e2f9f-e8ac-4de7-ae6d-8be51d15f447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.073081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e2f9f-e8ac-4de7-ae6d-8be51d15f447 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.085331 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1103/2210] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:12:03.089984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55281c-3ed1-47e6-b6e6-6d86d425b521 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.103918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55281c-3ed1-47e6-b6e6-6d86d425b521 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.109754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e2f9f-e8ac-4de7-ae6d-8be51d15f447 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.114069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-309e2f9f-e8ac-4de7-ae6d-8be51d15f447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:03.122839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc81ab-0140-4f82-b7b9-2f59424a1547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.126883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc81ab-0140-4f82-b7b9-2f59424a1547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.128885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc81ab-0140-4f82-b7b9-2f59424a1547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.129384 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc81ab-0140-4f82-b7b9-2f59424a1547 admin admin] PATH_INFO: `/v3/projects/4afe4302c5134f258dbf824130d75187/users/6b9a03b5b0d84e1ea87ea9acfe37ff2b/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.135530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e2f9f-e8ac-4de7-ae6d-8be51d15f447 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.150499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90628e27-f64e-40fd-b352-90316d3b027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.151313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90628e27-f64e-40fd-b352-90316d3b027b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.151602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90628e27-f64e-40fd-b352-90316d3b027b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.151888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90628e27-f64e-40fd-b352-90316d3b027b admin admin] PATH_INFO: `/v3/projects/acd6cf0f3d7d4c5fbc4286498eb46b24` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.154294 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90628e27-f64e-40fd-b352-90316d3b027b admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd6cf0f3d7d4c5fbc4286498eb46b24)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.154680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc81ab-0140-4f82-b7b9-2f59424a1547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4afe4302c5134f258dbf824130d75187, user_id=6b9a03b5b0d84e1ea87ea9acfe37ff2b, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.156186 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90628e27-f64e-40fd-b352-90316d3b027b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.157685 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc81ab-0140-4f82-b7b9-2f59424a1547 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.172519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1108/2211] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:03 2022] PUT /identity/v3/projects/4afe4302c5134f258dbf824130d75187/users/6b9a03b5b0d84e1ea87ea9acfe37ff2b/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:03.183351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229e58-96a8-4071-8cf4-f3611c1b7256 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.183641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229e58-96a8-4071-8cf4-f3611c1b7256 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.183917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229e58-96a8-4071-8cf4-f3611c1b7256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.227492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-56229e58-96a8-4071-8cf4-f3611c1b7256 None None] MFA Rules not processed for user `6b9a03b5b0d84e1ea87ea9acfe37ff2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:03.231804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-56229e58-96a8-4071-8cf4-f3611c1b7256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:03.235916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-90628e27-f64e-40fd-b352-90316d3b027b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd6cf0f3d7d4c5fbc4286498eb46b24', 'request_id': 'req-90628e27-f64e-40fd-b352-90316d3b027b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:03.257997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-90628e27-f64e-40fd-b352-90316d3b027b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd6cf0f3d7d4c5fbc4286498eb46b24', 'request_id': 'req-90628e27-f64e-40fd-b352-90316d3b027b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:03.270457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-90628e27-f64e-40fd-b352-90316d3b027b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd6cf0f3d7d4c5fbc4286498eb46b24', 'request_id': 'req-90628e27-f64e-40fd-b352-90316d3b027b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:03.284585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:03.292634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-90628e27-f64e-40fd-b352-90316d3b027b admin admin] The token cache is being invalidate because project acd6cf0f3d7d4c5fbc4286498eb46b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:03.293480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-90628e27-f64e-40fd-b352-90316d3b027b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:03.296004 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-90628e27-f64e-40fd-b352-90316d3b027b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:03.299640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1104/2212] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:03 2022] DELETE /identity/v3/projects/acd6cf0f3d7d4c5fbc4286498eb46b24 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:03.305556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd95e1-f063-45c0-a7af-1faf12fe1201 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.306060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd95e1-f063-45c0-a7af-1faf12fe1201 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.306515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd95e1-f063-45c0-a7af-1faf12fe1201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.314488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:03.338767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-2abd95e1-f063-45c0-a7af-1faf12fe1201 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:03.340712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2abd95e1-f063-45c0-a7af-1faf12fe1201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:03.373416 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1109/2213] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:03.374732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56229e58-96a8-4071-8cf4-f3611c1b7256 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.376347 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-56229e58-96a8-4071-8cf4-f3611c1b7256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:03.428233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1105/2214] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:03.430433 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a42ea7-74e4-482a-9aac-94c89ae2b0c4 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.430660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a42ea7-74e4-482a-9aac-94c89ae2b0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.431087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a42ea7-74e4-482a-9aac-94c89ae2b0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.447065 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56229e58-96a8-4071-8cf4-f3611c1b7256 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.451647 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-45a42ea7-74e4-482a-9aac-94c89ae2b0c4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:03.451899 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cac6b-d85c-47be-be4e-941465a5d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.452512 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cac6b-d85c-47be-be4e-941465a5d584 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.452830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cac6b-d85c-47be-be4e-941465a5d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.452927 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-45a42ea7-74e4-482a-9aac-94c89ae2b0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:03.453111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cac6b-d85c-47be-be4e-941465a5d584 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.453751 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cac6b-d85c-47be-be4e-941465a5d584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.455845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cac6b-d85c-47be-be4e-941465a5d584 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.460911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1106/2215] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:03.465159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a42ea7-74e4-482a-9aac-94c89ae2b0c4 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.478098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a42ea7-74e4-482a-9aac-94c89ae2b0c4 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.482746 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdc0f5-5cb9-4e6c-98bf-ff041d3c3d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.483459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdc0f5-5cb9-4e6c-98bf-ff041d3c3d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.486907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1110/2216] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:03 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:12:03.487025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdc0f5-5cb9-4e6c-98bf-ff041d3c3d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.487025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdc0f5-5cb9-4e6c-98bf-ff041d3c3d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.487025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdc0f5-5cb9-4e6c-98bf-ff041d3c3d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:12:03.487025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdc0f5-5cb9-4e6c-98bf-ff041d3c3d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.487025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdc0f5-5cb9-4e6c-98bf-ff041d3c3d2b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.487859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cac6b-d85c-47be-be4e-941465a5d584 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.500178 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1107/2217] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:12:03.504621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdc0f5-5cb9-4e6c-98bf-ff041d3c3d2b admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.517464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdc0f5-5cb9-4e6c-98bf-ff041d3c3d2b admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.563606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cac6b-d85c-47be-be4e-941465a5d584 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.570992 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91c28e-73fa-418e-a6be-3e9d3bcfbb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.571780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91c28e-73fa-418e-a6be-3e9d3bcfbb3f admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.572233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91c28e-73fa-418e-a6be-3e9d3bcfbb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.572676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91c28e-73fa-418e-a6be-3e9d3bcfbb3f admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.573776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91c28e-73fa-418e-a6be-3e9d3bcfbb3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.577282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91c28e-73fa-418e-a6be-3e9d3bcfbb3f admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.602942 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1111/2218] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:03 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:12:03.606127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692bd51-9f9a-48f5-900e-71298503999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.606746 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692bd51-9f9a-48f5-900e-71298503999e admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.606868 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91c28e-73fa-418e-a6be-3e9d3bcfbb3f admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.607032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692bd51-9f9a-48f5-900e-71298503999e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.607310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692bd51-9f9a-48f5-900e-71298503999e admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.607948 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692bd51-9f9a-48f5-900e-71298503999e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.609879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692bd51-9f9a-48f5-900e-71298503999e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.617841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91c28e-73fa-418e-a6be-3e9d3bcfbb3f admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.622402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef890065-2df6-4ded-9614-840c5c4fe808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.623001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef890065-2df6-4ded-9614-840c5c4fe808 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.623284 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef890065-2df6-4ded-9614-840c5c4fe808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.623557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef890065-2df6-4ded-9614-840c5c4fe808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.624201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef890065-2df6-4ded-9614-840c5c4fe808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.625821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef890065-2df6-4ded-9614-840c5c4fe808 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.637636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1112/2219] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:03.640576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1108/2220] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:03 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:12:03.643550 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef890065-2df6-4ded-9614-840c5c4fe808 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.645551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692bd51-9f9a-48f5-900e-71298503999e admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.654383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef890065-2df6-4ded-9614-840c5c4fe808 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.700850 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:03.721867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692bd51-9f9a-48f5-900e-71298503999e admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.724588 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6eed5-41f5-4cd7-a39e-3ad4abbf49e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.725776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6eed5-41f5-4cd7-a39e-3ad4abbf49e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.726058 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6eed5-41f5-4cd7-a39e-3ad4abbf49e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.726330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6eed5-41f5-4cd7-a39e-3ad4abbf49e5 admin admin] PATH_INFO: `/v3/projects/86797aeff27444b582f2d82113911aee/users/4d5dde391c374eb1bfa4bf584dbb3c0a/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.727944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defad66-e3e9-4d3f-89a1-32a1a6bc1466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.728563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defad66-e3e9-4d3f-89a1-32a1a6bc1466 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.728895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defad66-e3e9-4d3f-89a1-32a1a6bc1466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.729172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defad66-e3e9-4d3f-89a1-32a1a6bc1466 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.729807 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defad66-e3e9-4d3f-89a1-32a1a6bc1466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.731730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defad66-e3e9-4d3f-89a1-32a1a6bc1466 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.743018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6eed5-41f5-4cd7-a39e-3ad4abbf49e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86797aeff27444b582f2d82113911aee, user_id=4d5dde391c374eb1bfa4bf584dbb3c0a, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.745917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6eed5-41f5-4cd7-a39e-3ad4abbf49e5 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.747673 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:03.764129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1109/2221] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:03 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:03.765277 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defad66-e3e9-4d3f-89a1-32a1a6bc1466 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.767159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1113/2222] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:03 2022] PUT /identity/v3/projects/86797aeff27444b582f2d82113911aee/users/4d5dde391c374eb1bfa4bf584dbb3c0a/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:12:03.772558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6eed5-41f5-4cd7-a39e-3ad4abbf49e5 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.785357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defad66-e3e9-4d3f-89a1-32a1a6bc1466 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.855885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6eed5-41f5-4cd7-a39e-3ad4abbf49e5 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.863360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1fe49-7efa-4a3e-b466-b0d1925c9283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.864292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1fe49-7efa-4a3e-b466-b0d1925c9283 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.864434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b928cc5-9d80-48f2-8412-2d613bc3717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.864573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1fe49-7efa-4a3e-b466-b0d1925c9283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.865587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1fe49-7efa-4a3e-b466-b0d1925c9283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.866226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b928cc5-9d80-48f2-8412-2d613bc3717c admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.866226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b928cc5-9d80-48f2-8412-2d613bc3717c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.866416 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1fe49-7efa-4a3e-b466-b0d1925c9283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.866504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b928cc5-9d80-48f2-8412-2d613bc3717c admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.867156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b928cc5-9d80-48f2-8412-2d613bc3717c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.868013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1fe49-7efa-4a3e-b466-b0d1925c9283 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.868938 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b928cc5-9d80-48f2-8412-2d613bc3717c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.883477 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1114/2223] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:03.893987 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1fe49-7efa-4a3e-b466-b0d1925c9283 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.896770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1110/2224] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:03.901879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b928cc5-9d80-48f2-8412-2d613bc3717c admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.909505 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1fe49-7efa-4a3e-b466-b0d1925c9283 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.914027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b928cc5-9d80-48f2-8412-2d613bc3717c admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:03.919469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae9cf7-355a-49a2-a580-aaead5466410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.920159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae9cf7-355a-49a2-a580-aaead5466410 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.920443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae9cf7-355a-49a2-a580-aaead5466410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.920732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae9cf7-355a-49a2-a580-aaead5466410 admin admin] PATH_INFO: `/v3/projects/86797aeff27444b582f2d82113911aee/users/4d5dde391c374eb1bfa4bf584dbb3c0a/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.923142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae9cf7-355a-49a2-a580-aaead5466410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86797aeff27444b582f2d82113911aee, user_id=4d5dde391c374eb1bfa4bf584dbb3c0a, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.925488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce1351-9016-4fe8-89c3-95071a1d79f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:03.925935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae9cf7-355a-49a2-a580-aaead5466410 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.926113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce1351-9016-4fe8-89c3-95071a1d79f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.926382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce1351-9016-4fe8-89c3-95071a1d79f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.926654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce1351-9016-4fe8-89c3-95071a1d79f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:03.927866 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce1351-9016-4fe8-89c3-95071a1d79f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:03.929855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce1351-9016-4fe8-89c3-95071a1d79f0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:03.939211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1115/2225] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:03 2022] PUT /identity/v3/projects/86797aeff27444b582f2d82113911aee/users/4d5dde391c374eb1bfa4bf584dbb3c0a/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:12:03.946476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1111/2226] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:12:03.949776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae9cf7-355a-49a2-a580-aaead5466410 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:03.951589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3769bd-d211-4aea-890d-b21ab780efc0 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:03.952148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3769bd-d211-4aea-890d-b21ab780efc0 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:03.952627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3769bd-d211-4aea-890d-b21ab780efc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:04.003732 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-4a3769bd-d211-4aea-890d-b21ab780efc0 None None] MFA Rules not processed for user `4d5dde391c374eb1bfa4bf584dbb3c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:04.006025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4a3769bd-d211-4aea-890d-b21ab780efc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:04.034809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae9cf7-355a-49a2-a580-aaead5466410 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:04.041214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318375c-4ecc-4b07-8596-8bb0afab8c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:04.041963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318375c-4ecc-4b07-8596-8bb0afab8c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:04.042878 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318375c-4ecc-4b07-8596-8bb0afab8c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:04.043160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318375c-4ecc-4b07-8596-8bb0afab8c69 admin admin] PATH_INFO: `/v3/projects/a316c8db3b474c8b96377a0e5bf29c3e/users/806a28b248084ef9accb7795b2ae6166/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:04.058285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318375c-4ecc-4b07-8596-8bb0afab8c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a316c8db3b474c8b96377a0e5bf29c3e, user_id=806a28b248084ef9accb7795b2ae6166, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:04.061027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318375c-4ecc-4b07-8596-8bb0afab8c69 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:04.076143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1116/2227] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:03 2022] PUT /identity/v3/projects/a316c8db3b474c8b96377a0e5bf29c3e/users/806a28b248084ef9accb7795b2ae6166/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:04.084318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1112/2228] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:04.089847 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df430ec-017a-4671-925b-6fecd9daf347 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:04.090101 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df430ec-017a-4671-925b-6fecd9daf347 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:04.090382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df430ec-017a-4671-925b-6fecd9daf347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:04.095176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3769bd-d211-4aea-890d-b21ab780efc0 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:04.096675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4a3769bd-d211-4aea-890d-b21ab780efc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:04.120392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-3df430ec-017a-4671-925b-6fecd9daf347 None None] MFA Rules not processed for user `806a28b248084ef9accb7795b2ae6166`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:04.121778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3df430ec-017a-4671-925b-6fecd9daf347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:04.141825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:04.160934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3769bd-d211-4aea-890d-b21ab780efc0 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:04.184199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:04.215877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1117/2229] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:04.220837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19429f-7150-4e21-a3bb-01281213d9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:04.221445 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19429f-7150-4e21-a3bb-01281213d9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:04.222090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19429f-7150-4e21-a3bb-01281213d9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:04.222375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19429f-7150-4e21-a3bb-01281213d9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:04.222969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df430ec-017a-4671-925b-6fecd9daf347 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:04.225126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3df430ec-017a-4671-925b-6fecd9daf347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:04.237862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df430ec-017a-4671-925b-6fecd9daf347 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:04.242467 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0556a-058b-47a3-af67-6aced1cf4e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:04.243108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0556a-058b-47a3-af67-6aced1cf4e92 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:04.243397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0556a-058b-47a3-af67-6aced1cf4e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:04.243706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0556a-058b-47a3-af67-6aced1cf4e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:04.252900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0556a-058b-47a3-af67-6aced1cf4e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:04.254410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0556a-058b-47a3-af67-6aced1cf4e92 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:04.264982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1118/2230] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:12:04.290759 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19429f-7150-4e21-a3bb-01281213d9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:04.292205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19429f-7150-4e21-a3bb-01281213d9a3 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:04.301326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1113/2231] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:07.249790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0556a-058b-47a3-af67-6aced1cf4e92 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:07.321491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0556a-058b-47a3-af67-6aced1cf4e92 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:07.325945 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:07.326573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:07.326851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:07.327125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] PATH_INFO: `/v3/users/6b9a03b5b0d84e1ea87ea9acfe37ff2b` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:07.328286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9a03b5b0d84e1ea87ea9acfe37ff2b)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:07.330271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:07.394473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9a03b5b0d84e1ea87ea9acfe37ff2b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:07.407957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9a03b5b0d84e1ea87ea9acfe37ff2b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:07.430136 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9a03b5b0d84e1ea87ea9acfe37ff2b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:07.431041 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9a03b5b0d84e1ea87ea9acfe37ff2b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:07.432031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9a03b5b0d84e1ea87ea9acfe37ff2b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:07.454402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1119/2232] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:07 2022] DELETE /identity/v3/users/6b9a03b5b0d84e1ea87ea9acfe37ff2b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:07.459631 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd48c5-98bf-4dd7-b0af-6148178874ba None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:07.460184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd48c5-98bf-4dd7-b0af-6148178874ba None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:07.460367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd48c5-98bf-4dd7-b0af-6148178874ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:07.486385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7ffd48c5-98bf-4dd7-b0af-6148178874ba None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:07.488652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7ffd48c5-98bf-4dd7-b0af-6148178874ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:07.562704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1114/2233] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:07.573772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:07.575407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:07.625630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:07.660740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783d202-6f23-4da0-9adc-060c0f41326e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:07.666882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79957b9e-73d7-4a3b-b9d5-d7ed3f52db3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:07.667800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79957b9e-73d7-4a3b-b9d5-d7ed3f52db3c service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:07.668077 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79957b9e-73d7-4a3b-b9d5-d7ed3f52db3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:07.668351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79957b9e-73d7-4a3b-b9d5-d7ed3f52db3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:07.679744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79957b9e-73d7-4a3b-b9d5-d7ed3f52db3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:07.681403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79957b9e-73d7-4a3b-b9d5-d7ed3f52db3c service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:07.693174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1120/2234] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:08.070369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd48c5-98bf-4dd7-b0af-6148178874ba None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:08.076779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7ffd48c5-98bf-4dd7-b0af-6148178874ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:08.093175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd48c5-98bf-4dd7-b0af-6148178874ba None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:08.098835 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:08.100206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:08.101037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:08.101037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] PATH_INFO: `/v3/projects/4afe4302c5134f258dbf824130d75187` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:08.102057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4afe4302c5134f258dbf824130d75187)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:08.104246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:08.170116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4afe4302c5134f258dbf824130d75187', 'request_id': 'req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:08.181342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4afe4302c5134f258dbf824130d75187', 'request_id': 'req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:08.197991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4afe4302c5134f258dbf824130d75187', 'request_id': 'req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:08.209719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:08.222476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] The token cache is being invalidate because project 4afe4302c5134f258dbf824130d75187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:08.222989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:08.228746 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:08.230863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1115/2235] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:08 2022] DELETE /identity/v3/projects/4afe4302c5134f258dbf824130d75187 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:08.234807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79957b9e-73d7-4a3b-b9d5-d7ed3f52db3c service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:08.249183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79957b9e-73d7-4a3b-b9d5-d7ed3f52db3c service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:08.422162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c0299-f1d5-4cf0-933c-cd9e9444c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:08.422162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c0299-f1d5-4cf0-933c-cd9e9444c47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:08.422162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c0299-f1d5-4cf0-933c-cd9e9444c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:08.423033 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c0299-f1d5-4cf0-933c-cd9e9444c47a admin admin] PATH_INFO: `/v3/users/4d5dde391c374eb1bfa4bf584dbb3c0a` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:08.424656 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c0299-f1d5-4cf0-933c-cd9e9444c47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5dde391c374eb1bfa4bf584dbb3c0a)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:08.426674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c0299-f1d5-4cf0-933c-cd9e9444c47a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:08.511416 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-024c0299-f1d5-4cf0-933c-cd9e9444c47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5dde391c374eb1bfa4bf584dbb3c0a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:08.530356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-024c0299-f1d5-4cf0-933c-cd9e9444c47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5dde391c374eb1bfa4bf584dbb3c0a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:08.551791 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-024c0299-f1d5-4cf0-933c-cd9e9444c47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5dde391c374eb1bfa4bf584dbb3c0a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:08.557174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-024c0299-f1d5-4cf0-933c-cd9e9444c47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5dde391c374eb1bfa4bf584dbb3c0a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:08.558071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-024c0299-f1d5-4cf0-933c-cd9e9444c47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5dde391c374eb1bfa4bf584dbb3c0a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:08.587462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1121/2236] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:08 2022] DELETE /identity/v3/users/4d5dde391c374eb1bfa4bf584dbb3c0a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:09.063478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:09.065313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:09.088709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d26b04-c7e4-4839-99b0-1ed82aca81a6 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:09.165855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319b97-58cd-4ec8-b362-56badd7e6459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:09.166417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319b97-58cd-4ec8-b362-56badd7e6459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:09.166760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319b97-58cd-4ec8-b362-56badd7e6459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:09.167570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319b97-58cd-4ec8-b362-56badd7e6459 admin admin] PATH_INFO: `/v3/projects/86797aeff27444b582f2d82113911aee` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:09.169283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4319b97-58cd-4ec8-b362-56badd7e6459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86797aeff27444b582f2d82113911aee)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:09.172043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4319b97-58cd-4ec8-b362-56badd7e6459 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:09.241873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4319b97-58cd-4ec8-b362-56badd7e6459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86797aeff27444b582f2d82113911aee', 'request_id': 'req-d4319b97-58cd-4ec8-b362-56badd7e6459'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:09.251242 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4319b97-58cd-4ec8-b362-56badd7e6459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86797aeff27444b582f2d82113911aee', 'request_id': 'req-d4319b97-58cd-4ec8-b362-56badd7e6459'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:09.258414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4319b97-58cd-4ec8-b362-56badd7e6459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86797aeff27444b582f2d82113911aee', 'request_id': 'req-d4319b97-58cd-4ec8-b362-56badd7e6459'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:09.278824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4319b97-58cd-4ec8-b362-56badd7e6459 admin admin] The token cache is being invalidate because project 86797aeff27444b582f2d82113911aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:09.279723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4319b97-58cd-4ec8-b362-56badd7e6459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:09.280808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4319b97-58cd-4ec8-b362-56badd7e6459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:09.283176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1116/2237] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:09 2022] DELETE /identity/v3/projects/86797aeff27444b582f2d82113911aee => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:09.287959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf00eb8-826b-44d3-a7cd-ae80eab3b4e6 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:09.288906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf00eb8-826b-44d3-a7cd-ae80eab3b4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:09.288906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf00eb8-826b-44d3-a7cd-ae80eab3b4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:09.316108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-caf00eb8-826b-44d3-a7cd-ae80eab3b4e6 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:09.317443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-caf00eb8-826b-44d3-a7cd-ae80eab3b4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:09.383069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:09.404819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1122/2238] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:09.415251 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bf509-7ee1-43dd-b16e-a7cb7ddf4ee5 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:09.415624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bf509-7ee1-43dd-b16e-a7cb7ddf4ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:09.415888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bf509-7ee1-43dd-b16e-a7cb7ddf4ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:09.438788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-d52bf509-7ee1-43dd-b16e-a7cb7ddf4ee5 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:09.439995 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d52bf509-7ee1-43dd-b16e-a7cb7ddf4ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:09.452763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1117/2239] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:09.454023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf00eb8-826b-44d3-a7cd-ae80eab3b4e6 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:09.465364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf00eb8-826b-44d3-a7cd-ae80eab3b4e6 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:09.470791 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a1f31-de52-4785-a321-774dfcbb1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:09.472160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a1f31-de52-4785-a321-774dfcbb1d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:09.472160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a1f31-de52-4785-a321-774dfcbb1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:09.472160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a1f31-de52-4785-a321-774dfcbb1d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:09.473289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a1f31-de52-4785-a321-774dfcbb1d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:12:09.473667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a1f31-de52-4785-a321-774dfcbb1d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:09.475804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a1f31-de52-4785-a321-774dfcbb1d67 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:09.491877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1123/2240] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:12:09.505406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bf509-7ee1-43dd-b16e-a7cb7ddf4ee5 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:09.518814 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bf509-7ee1-43dd-b16e-a7cb7ddf4ee5 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:09.525277 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbe4ed-9a0a-4d93-a2e4-94de472046d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:09.525951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe4ed-9a0a-4d93-a2e4-94de472046d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:09.526280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe4ed-9a0a-4d93-a2e4-94de472046d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:09.526556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe4ed-9a0a-4d93-a2e4-94de472046d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:09.527162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbe4ed-9a0a-4d93-a2e4-94de472046d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:09.529754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbe4ed-9a0a-4d93-a2e4-94de472046d8 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:09.568944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1118/2241] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:09 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:09.570491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a1f31-de52-4785-a321-774dfcbb1d67 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:09.580547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a1f31-de52-4785-a321-774dfcbb1d67 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:09.645052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4a043-6704-4f62-82ad-42d2a3c4ceff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:09.645678 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4a043-6704-4f62-82ad-42d2a3c4ceff admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:09.645962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4a043-6704-4f62-82ad-42d2a3c4ceff admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:09.646281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4a043-6704-4f62-82ad-42d2a3c4ceff admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:09.646956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4a043-6704-4f62-82ad-42d2a3c4ceff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:09.648982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4a043-6704-4f62-82ad-42d2a3c4ceff admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:09.673058 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1124/2242] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:09 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:09.677071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbe4ed-9a0a-4d93-a2e4-94de472046d8 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:09.688440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbe4ed-9a0a-4d93-a2e4-94de472046d8 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:09.693299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a68de2-d60b-4d5c-bd07-c803739ea134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:09.693868 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a68de2-d60b-4d5c-bd07-c803739ea134 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:09.694146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a68de2-d60b-4d5c-bd07-c803739ea134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:09.694417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a68de2-d60b-4d5c-bd07-c803739ea134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:09.695083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a68de2-d60b-4d5c-bd07-c803739ea134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:09.696638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a68de2-d60b-4d5c-bd07-c803739ea134 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:09.711337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1119/2243] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:12:09.715463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4a043-6704-4f62-82ad-42d2a3c4ceff admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:09.726946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4a043-6704-4f62-82ad-42d2a3c4ceff admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:09.732884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c0907-71ce-4997-bf32-9ac221e817f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:09.733519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c0907-71ce-4997-bf32-9ac221e817f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:09.733799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c0907-71ce-4997-bf32-9ac221e817f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:09.734072 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c0907-71ce-4997-bf32-9ac221e817f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:09.734718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c0907-71ce-4997-bf32-9ac221e817f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:09.736342 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c0907-71ce-4997-bf32-9ac221e817f9 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:09.747957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1125/2244] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:09.752200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a68de2-d60b-4d5c-bd07-c803739ea134 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:09.762954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a68de2-d60b-4d5c-bd07-c803739ea134 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:09.768002 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a14a1b-1e24-4094-a131-a7a9da66396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:09.768808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a14a1b-1e24-4094-a131-a7a9da66396b admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:09.769158 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a14a1b-1e24-4094-a131-a7a9da66396b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:09.769550 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a14a1b-1e24-4094-a131-a7a9da66396b admin admin] PATH_INFO: `/v3/projects/870c59efe48142c5a01c4342158093c5/users/20576edc256f462583d708d819ab0672/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:09.789021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a14a1b-1e24-4094-a131-a7a9da66396b admin admin] RBAC: Authorizing `identity:create_grant(project_id=870c59efe48142c5a01c4342158093c5, user_id=20576edc256f462583d708d819ab0672, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:09.792038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a14a1b-1e24-4094-a131-a7a9da66396b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:09.808774 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1120/2245] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:09 2022] PUT /identity/v3/projects/870c59efe48142c5a01c4342158093c5/users/20576edc256f462583d708d819ab0672/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:09.818870 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415051aa-bd56-40b2-8031-569e1c919b7c None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:09.819155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415051aa-bd56-40b2-8031-569e1c919b7c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:09.819433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415051aa-bd56-40b2-8031-569e1c919b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:09.852777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-415051aa-bd56-40b2-8031-569e1c919b7c None None] MFA Rules not processed for user `20576edc256f462583d708d819ab0672`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:09.854022 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-415051aa-bd56-40b2-8031-569e1c919b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:09.950178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1126/2246] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:10.042988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a14a1b-1e24-4094-a131-a7a9da66396b admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:10.044734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d1a14a1b-1e24-4094-a131-a7a9da66396b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:10.080257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:10.119928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a14a1b-1e24-4094-a131-a7a9da66396b admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:10.124312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a06c50-79f5-41a5-8f3c-639b6dde8249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:10.125097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a06c50-79f5-41a5-8f3c-639b6dde8249 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:10.125448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a06c50-79f5-41a5-8f3c-639b6dde8249 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:10.125779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a06c50-79f5-41a5-8f3c-639b6dde8249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:10.135569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a06c50-79f5-41a5-8f3c-639b6dde8249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:10.137051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a06c50-79f5-41a5-8f3c-639b6dde8249 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:10.146575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1121/2247] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:13.238839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415051aa-bd56-40b2-8031-569e1c919b7c None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:13.296877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:13.314212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415051aa-bd56-40b2-8031-569e1c919b7c None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:13.318816 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:13.319464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:13.319752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:13.320033 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] PATH_INFO: `/v3/users/20576edc256f462583d708d819ab0672` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:13.321365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20576edc256f462583d708d819ab0672)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:13.323324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:13.371470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20576edc256f462583d708d819ab0672'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:13.379166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20576edc256f462583d708d819ab0672'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:13.392283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20576edc256f462583d708d819ab0672'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:13.393023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20576edc256f462583d708d819ab0672'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:13.393622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20576edc256f462583d708d819ab0672'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:13.406458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1127/2248] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:13 2022] DELETE /identity/v3/users/20576edc256f462583d708d819ab0672 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:12:13.412112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644bf0-0609-407f-a0ac-1c4fca4d2c53 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:13.412112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644bf0-0609-407f-a0ac-1c4fca4d2c53 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:13.412830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644bf0-0609-407f-a0ac-1c4fca4d2c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:13.432313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b3644bf0-0609-407f-a0ac-1c4fca4d2c53 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:13.433573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b3644bf0-0609-407f-a0ac-1c4fca4d2c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:13.492798 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1122/2249] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:13.502369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:13.503789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:13.567521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ace39-336c-4ca5-9d72-555bd925b764 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:13.571790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d0799-8d05-41df-8252-8300a1f562ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:13.572410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0799-8d05-41df-8252-8300a1f562ef service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:13.573132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0799-8d05-41df-8252-8300a1f562ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:13.573132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0799-8d05-41df-8252-8300a1f562ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:13.582379 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0799-8d05-41df-8252-8300a1f562ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:13.584465 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0799-8d05-41df-8252-8300a1f562ef service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:13.593756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1128/2250] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:13.892016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3644bf0-0609-407f-a0ac-1c4fca4d2c53 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:13.893786 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b3644bf0-0609-407f-a0ac-1c4fca4d2c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:13.907942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3644bf0-0609-407f-a0ac-1c4fca4d2c53 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:13.914018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719231f-7f34-4546-b6a5-308fe212da81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:13.914808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719231f-7f34-4546-b6a5-308fe212da81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:13.915155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719231f-7f34-4546-b6a5-308fe212da81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:13.915502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719231f-7f34-4546-b6a5-308fe212da81 admin admin] PATH_INFO: `/v3/projects/870c59efe48142c5a01c4342158093c5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:13.916771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719231f-7f34-4546-b6a5-308fe212da81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=870c59efe48142c5a01c4342158093c5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:13.919257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719231f-7f34-4546-b6a5-308fe212da81 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:13.975412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b719231f-7f34-4546-b6a5-308fe212da81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '870c59efe48142c5a01c4342158093c5', 'request_id': 'req-b719231f-7f34-4546-b6a5-308fe212da81'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:13.983528 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b719231f-7f34-4546-b6a5-308fe212da81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '870c59efe48142c5a01c4342158093c5', 'request_id': 'req-b719231f-7f34-4546-b6a5-308fe212da81'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:13.999121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b719231f-7f34-4546-b6a5-308fe212da81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '870c59efe48142c5a01c4342158093c5', 'request_id': 'req-b719231f-7f34-4546-b6a5-308fe212da81'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:14.014768 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b719231f-7f34-4546-b6a5-308fe212da81 admin admin] The token cache is being invalidate because project 870c59efe48142c5a01c4342158093c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:14.015063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b719231f-7f34-4546-b6a5-308fe212da81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:14.015726 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b719231f-7f34-4546-b6a5-308fe212da81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:14.017440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1123/2251] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:13 2022] DELETE /identity/v3/projects/870c59efe48142c5a01c4342158093c5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:14.023304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b9df-b30b-4176-9b56-249a1d982cee None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.023596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b9df-b30b-4176-9b56-249a1d982cee None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.023900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b9df-b30b-4176-9b56-249a1d982cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.045825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9561b9df-b30b-4176-9b56-249a1d982cee None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:14.047082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9561b9df-b30b-4176-9b56-249a1d982cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:14.108535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1129/2252] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:14.117073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9523-69e8-4732-9812-d6dba31867da None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.117364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9523-69e8-4732-9812-d6dba31867da None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.117660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9523-69e8-4732-9812-d6dba31867da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.138129 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-1b0d9523-69e8-4732-9812-d6dba31867da None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:14.139324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1b0d9523-69e8-4732-9812-d6dba31867da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:14.147450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1124/2253] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:14.151859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b9df-b30b-4176-9b56-249a1d982cee None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:14.162089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b9df-b30b-4176-9b56-249a1d982cee None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:14.166720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32cd2f-b416-4dd9-a9c7-f59a3ddf237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:14.167318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32cd2f-b416-4dd9-a9c7-f59a3ddf237c admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.167599 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32cd2f-b416-4dd9-a9c7-f59a3ddf237c admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.167873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32cd2f-b416-4dd9-a9c7-f59a3ddf237c admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.168528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32cd2f-b416-4dd9-a9c7-f59a3ddf237c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:12:14.168873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32cd2f-b416-4dd9-a9c7-f59a3ddf237c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:14.170474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32cd2f-b416-4dd9-a9c7-f59a3ddf237c admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:14.172086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:14.195738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1130/2254] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:12:14.196858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9523-69e8-4732-9812-d6dba31867da None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:14.209673 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9523-69e8-4732-9812-d6dba31867da None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:14.214493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275983f-89b9-4fea-8236-d4a68d82779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:14.215150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275983f-89b9-4fea-8236-d4a68d82779f admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.215427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275983f-89b9-4fea-8236-d4a68d82779f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.215697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275983f-89b9-4fea-8236-d4a68d82779f admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.216342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275983f-89b9-4fea-8236-d4a68d82779f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:14.218430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275983f-89b9-4fea-8236-d4a68d82779f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:14.252132 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1125/2255] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:14 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:14.256801 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32cd2f-b416-4dd9-a9c7-f59a3ddf237c admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:14.275857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32cd2f-b416-4dd9-a9c7-f59a3ddf237c admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:14.341349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea47a-7fb4-4bec-a0eb-e649065181d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:14.342353 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea47a-7fb4-4bec-a0eb-e649065181d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.342647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea47a-7fb4-4bec-a0eb-e649065181d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.342917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea47a-7fb4-4bec-a0eb-e649065181d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.343563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ea47a-7fb4-4bec-a0eb-e649065181d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:14.345591 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ea47a-7fb4-4bec-a0eb-e649065181d4 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:14.375238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1131/2256] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:14 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:12:14.379291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275983f-89b9-4fea-8236-d4a68d82779f admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:14.392955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275983f-89b9-4fea-8236-d4a68d82779f admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:14.400518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43702e34-ac50-4fc2-9654-bccae4795e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:14.401177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43702e34-ac50-4fc2-9654-bccae4795e3a admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.401454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43702e34-ac50-4fc2-9654-bccae4795e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.401724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43702e34-ac50-4fc2-9654-bccae4795e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.402377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43702e34-ac50-4fc2-9654-bccae4795e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:14.403960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43702e34-ac50-4fc2-9654-bccae4795e3a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:14.417394 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1126/2257] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:12:14.421437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea47a-7fb4-4bec-a0eb-e649065181d4 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:14.433518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea47a-7fb4-4bec-a0eb-e649065181d4 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:14.438327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1305b04-2eb9-421f-990e-d4fd1681c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:14.438973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1305b04-2eb9-421f-990e-d4fd1681c93f admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.439252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1305b04-2eb9-421f-990e-d4fd1681c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.439521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1305b04-2eb9-421f-990e-d4fd1681c93f admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.440165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1305b04-2eb9-421f-990e-d4fd1681c93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:14.441848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1305b04-2eb9-421f-990e-d4fd1681c93f admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:14.455824 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1132/2258] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:14.460928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43702e34-ac50-4fc2-9654-bccae4795e3a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:14.475406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43702e34-ac50-4fc2-9654-bccae4795e3a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:14.480797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76168a22-10a7-4518-8d32-37c424259708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:14.481506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76168a22-10a7-4518-8d32-37c424259708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.481793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76168a22-10a7-4518-8d32-37c424259708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.482064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76168a22-10a7-4518-8d32-37c424259708 admin admin] PATH_INFO: `/v3/projects/9f1ecfa6de294966b74a66435f7f9b5d/users/d86b2469346f446fbcd8e7f7771e2a59/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.494421 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:14.499633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76168a22-10a7-4518-8d32-37c424259708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1ecfa6de294966b74a66435f7f9b5d, user_id=d86b2469346f446fbcd8e7f7771e2a59, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:14.502734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76168a22-10a7-4518-8d32-37c424259708 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:14.519089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1127/2259] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:14 2022] PUT /identity/v3/projects/9f1ecfa6de294966b74a66435f7f9b5d/users/d86b2469346f446fbcd8e7f7771e2a59/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:14.533955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b9ba2-a942-49ee-bff0-d26d7ceee905 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.534246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b9ba2-a942-49ee-bff0-d26d7ceee905 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.534567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b9ba2-a942-49ee-bff0-d26d7ceee905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.564709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-d77b9ba2-a942-49ee-bff0-d26d7ceee905 None None] MFA Rules not processed for user `d86b2469346f446fbcd8e7f7771e2a59`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:14.565961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d77b9ba2-a942-49ee-bff0-d26d7ceee905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:14.636718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1133/2260] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:14.641238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76168a22-10a7-4518-8d32-37c424259708 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:14.704862 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76168a22-10a7-4518-8d32-37c424259708 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:14.710619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea396c0-9737-494c-807f-bb753085531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:14.711223 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea396c0-9737-494c-807f-bb753085531b admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.711516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea396c0-9737-494c-807f-bb753085531b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.711789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea396c0-9737-494c-807f-bb753085531b admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.712435 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea396c0-9737-494c-807f-bb753085531b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:14.714437 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea396c0-9737-494c-807f-bb753085531b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:14.742542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1128/2261] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:14 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:14.746626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b9ba2-a942-49ee-bff0-d26d7ceee905 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:14.758337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b9ba2-a942-49ee-bff0-d26d7ceee905 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:14.820298 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c2f50-1064-4518-8b94-43a61dfac47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:14.820978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2f50-1064-4518-8b94-43a61dfac47e admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.821259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2f50-1064-4518-8b94-43a61dfac47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.821534 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2f50-1064-4518-8b94-43a61dfac47e admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.822185 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c2f50-1064-4518-8b94-43a61dfac47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:14.824102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c2f50-1064-4518-8b94-43a61dfac47e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:14.833017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:14.846939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1134/2262] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:14 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:14.853600 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea396c0-9737-494c-807f-bb753085531b admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:14.865787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea396c0-9737-494c-807f-bb753085531b admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:14.870286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53698b-4c12-4e07-a36f-3144cb6076ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:14.870888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53698b-4c12-4e07-a36f-3144cb6076ab admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.871209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53698b-4c12-4e07-a36f-3144cb6076ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.871431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53698b-4c12-4e07-a36f-3144cb6076ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.872046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53698b-4c12-4e07-a36f-3144cb6076ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:14.873652 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53698b-4c12-4e07-a36f-3144cb6076ab admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:14.886105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1129/2263] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:14.890067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c2f50-1064-4518-8b94-43a61dfac47e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:14.902613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c2f50-1064-4518-8b94-43a61dfac47e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:14.907845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030a71c-3999-4680-8d27-5b43eb07e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:14.908456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030a71c-3999-4680-8d27-5b43eb07e774 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.908790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030a71c-3999-4680-8d27-5b43eb07e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.909118 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030a71c-3999-4680-8d27-5b43eb07e774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.909687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030a71c-3999-4680-8d27-5b43eb07e774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:14.911288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030a71c-3999-4680-8d27-5b43eb07e774 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:14.923184 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1135/2264] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:14.927510 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53698b-4c12-4e07-a36f-3144cb6076ab admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:14.937864 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53698b-4c12-4e07-a36f-3144cb6076ab admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:14.942607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce55876-df87-4101-92ec-c4466f42235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:14.943822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce55876-df87-4101-92ec-c4466f42235c admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.944069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce55876-df87-4101-92ec-c4466f42235c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.944332 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce55876-df87-4101-92ec-c4466f42235c admin admin] PATH_INFO: `/v3/projects/06347986052745f3a9e2107065450ed0/users/d11f8171e6bd45049d83c4b129f6bcad/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:14.961936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce55876-df87-4101-92ec-c4466f42235c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06347986052745f3a9e2107065450ed0, user_id=d11f8171e6bd45049d83c4b129f6bcad, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:14.965754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce55876-df87-4101-92ec-c4466f42235c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:14.992659 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1130/2265] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:14 2022] PUT /identity/v3/projects/06347986052745f3a9e2107065450ed0/users/d11f8171e6bd45049d83c4b129f6bcad/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:14.998093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871bd77-9f49-451f-b4e6-48e3a884dcc1 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:14.998380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871bd77-9f49-451f-b4e6-48e3a884dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:14.998653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871bd77-9f49-451f-b4e6-48e3a884dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:15.029291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9871bd77-9f49-451f-b4e6-48e3a884dcc1 None None] MFA Rules not processed for user `d11f8171e6bd45049d83c4b129f6bcad`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:15.030515 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9871bd77-9f49-451f-b4e6-48e3a884dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:15.098282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1136/2266] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:15.103841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce55876-df87-4101-92ec-c4466f42235c admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:15.179107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce55876-df87-4101-92ec-c4466f42235c admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:15.186236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ac274-482b-48e3-ad53-ddb7e0498922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:15.187735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ac274-482b-48e3-ad53-ddb7e0498922 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:15.188388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ac274-482b-48e3-ad53-ddb7e0498922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:15.188924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ac274-482b-48e3-ad53-ddb7e0498922 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:15.189702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ac274-482b-48e3-ad53-ddb7e0498922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:15.192346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ac274-482b-48e3-ad53-ddb7e0498922 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:15.227001 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1131/2267] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:15 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:15.231084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871bd77-9f49-451f-b4e6-48e3a884dcc1 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:15.244615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871bd77-9f49-451f-b4e6-48e3a884dcc1 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:15.309567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a23d7-a136-4983-83f5-332e217aa06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:15.310231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a23d7-a136-4983-83f5-332e217aa06e admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:15.310696 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a23d7-a136-4983-83f5-332e217aa06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:15.311015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a23d7-a136-4983-83f5-332e217aa06e admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:15.311848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a23d7-a136-4983-83f5-332e217aa06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:15.314411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a23d7-a136-4983-83f5-332e217aa06e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:15.339909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1137/2268] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:15 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:12:15.343977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ac274-482b-48e3-ad53-ddb7e0498922 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:15.355009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ac274-482b-48e3-ad53-ddb7e0498922 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:15.359533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af039a5e-8ef2-492a-81d5-46868bf01acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:15.360121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af039a5e-8ef2-492a-81d5-46868bf01acd admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:15.360418 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af039a5e-8ef2-492a-81d5-46868bf01acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:15.360670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af039a5e-8ef2-492a-81d5-46868bf01acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:15.361335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af039a5e-8ef2-492a-81d5-46868bf01acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:15.362911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af039a5e-8ef2-492a-81d5-46868bf01acd admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:15.374036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1132/2269] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:15.378593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a23d7-a136-4983-83f5-332e217aa06e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:15.389831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a23d7-a136-4983-83f5-332e217aa06e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:15.394930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48982a-581b-471a-b7ab-8e3a5a1d6db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:15.396727 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48982a-581b-471a-b7ab-8e3a5a1d6db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:15.396727 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48982a-581b-471a-b7ab-8e3a5a1d6db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:15.397034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48982a-581b-471a-b7ab-8e3a5a1d6db3 admin admin] PATH_INFO: `/v3/projects/9e6fe85d7e684faba396d45389e3fc6d/users/d2b55920c9df42459d9771713adb4250/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:15.416893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48982a-581b-471a-b7ab-8e3a5a1d6db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6fe85d7e684faba396d45389e3fc6d, user_id=d2b55920c9df42459d9771713adb4250, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:15.421857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48982a-581b-471a-b7ab-8e3a5a1d6db3 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:15.438166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1138/2270] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:15 2022] PUT /identity/v3/projects/9e6fe85d7e684faba396d45389e3fc6d/users/d2b55920c9df42459d9771713adb4250/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:15.442228 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af039a5e-8ef2-492a-81d5-46868bf01acd admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:15.454424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af039a5e-8ef2-492a-81d5-46868bf01acd admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:15.473057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:15.539293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a940b7-aa75-4857-8fb2-950a6288a55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:15.540003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a940b7-aa75-4857-8fb2-950a6288a55f admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:15.540297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a940b7-aa75-4857-8fb2-950a6288a55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:15.540572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a940b7-aa75-4857-8fb2-950a6288a55f admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:15.541251 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a940b7-aa75-4857-8fb2-950a6288a55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:15.542890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a940b7-aa75-4857-8fb2-950a6288a55f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:15.554446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1133/2271] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:15.559250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48982a-581b-471a-b7ab-8e3a5a1d6db3 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:15.572860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48982a-581b-471a-b7ab-8e3a5a1d6db3 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:15.577884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f652-0b4f-4eb6-8a53-93c2d2776310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:15.578678 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f652-0b4f-4eb6-8a53-93c2d2776310 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:15.582731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f652-0b4f-4eb6-8a53-93c2d2776310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:15.582731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f652-0b4f-4eb6-8a53-93c2d2776310 admin admin] PATH_INFO: `/v3/projects/9e6fe85d7e684faba396d45389e3fc6d/users/d2b55920c9df42459d9771713adb4250/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:15.585602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527f652-0b4f-4eb6-8a53-93c2d2776310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6fe85d7e684faba396d45389e3fc6d, user_id=d2b55920c9df42459d9771713adb4250, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:15.588279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527f652-0b4f-4eb6-8a53-93c2d2776310 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:15.603343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1139/2272] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:15 2022] PUT /identity/v3/projects/9e6fe85d7e684faba396d45389e3fc6d/users/d2b55920c9df42459d9771713adb4250/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:15.616805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65164313-a2c3-4408-8dfb-b6cbf9b72d8f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:15.617064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65164313-a2c3-4408-8dfb-b6cbf9b72d8f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:15.617504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65164313-a2c3-4408-8dfb-b6cbf9b72d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:15.649862 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-65164313-a2c3-4408-8dfb-b6cbf9b72d8f None None] MFA Rules not processed for user `d2b55920c9df42459d9771713adb4250`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:15.651117 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-65164313-a2c3-4408-8dfb-b6cbf9b72d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:15.741529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1134/2273] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:15.753015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f652-0b4f-4eb6-8a53-93c2d2776310 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:15.754952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e527f652-0b4f-4eb6-8a53-93c2d2776310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:15.784314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:15.819447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f652-0b4f-4eb6-8a53-93c2d2776310 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:15.823144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213715f2-78c5-400d-a938-16bc46fc2b0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:15.823753 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213715f2-78c5-400d-a938-16bc46fc2b0a service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:15.824035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213715f2-78c5-400d-a938-16bc46fc2b0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:15.824309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213715f2-78c5-400d-a938-16bc46fc2b0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:15.880813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213715f2-78c5-400d-a938-16bc46fc2b0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:15.882271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213715f2-78c5-400d-a938-16bc46fc2b0a service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:15.895501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1140/2274] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:16.029153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65164313-a2c3-4408-8dfb-b6cbf9b72d8f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:16.031854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-65164313-a2c3-4408-8dfb-b6cbf9b72d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:16.110505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65164313-a2c3-4408-8dfb-b6cbf9b72d8f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:16.115479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:16.116116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:16.116404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:16.116708 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] PATH_INFO: `/v3/users/4ba4edb985ae49288966e8241ae7c50e` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:16.117934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba4edb985ae49288966e8241ae7c50e)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:16.120087 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:16.173121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:16.184943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba4edb985ae49288966e8241ae7c50e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.205836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba4edb985ae49288966e8241ae7c50e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.206590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba4edb985ae49288966e8241ae7c50e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.207280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba4edb985ae49288966e8241ae7c50e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.222208 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba4edb985ae49288966e8241ae7c50e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.239551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1135/2275] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:16 2022] DELETE /identity/v3/users/4ba4edb985ae49288966e8241ae7c50e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:16.243626 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154b19-4df2-4885-a2ea-6ecee8bdba9e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:16.243925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154b19-4df2-4885-a2ea-6ecee8bdba9e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:16.244235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154b19-4df2-4885-a2ea-6ecee8bdba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:16.266441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-64154b19-4df2-4885-a2ea-6ecee8bdba9e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:16.267764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-64154b19-4df2-4885-a2ea-6ecee8bdba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:16.347778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1141/2276] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:16.357773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:16.359463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:16.364459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64154b19-4df2-4885-a2ea-6ecee8bdba9e None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:16.366722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-64154b19-4df2-4885-a2ea-6ecee8bdba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:16.378875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64154b19-4df2-4885-a2ea-6ecee8bdba9e None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:16.384630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:16.385328 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:16.385610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:16.385886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] PATH_INFO: `/v3/users/806a28b248084ef9accb7795b2ae6166` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:16.387020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806a28b248084ef9accb7795b2ae6166)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:16.388989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:16.424239 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18351a-883c-4923-b1d1-26491e627bec admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:16.428529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07813fdf-53a0-4cab-8ad1-3a6b621dcd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:16.429166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07813fdf-53a0-4cab-8ad1-3a6b621dcd92 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:16.429453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07813fdf-53a0-4cab-8ad1-3a6b621dcd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:16.429734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07813fdf-53a0-4cab-8ad1-3a6b621dcd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:16.440386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07813fdf-53a0-4cab-8ad1-3a6b621dcd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:16.441042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806a28b248084ef9accb7795b2ae6166'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.442086 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07813fdf-53a0-4cab-8ad1-3a6b621dcd92 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:16.448974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806a28b248084ef9accb7795b2ae6166'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.453687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1136/2277] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:16.463375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806a28b248084ef9accb7795b2ae6166'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.464287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806a28b248084ef9accb7795b2ae6166'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.468212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806a28b248084ef9accb7795b2ae6166'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.469743 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:16.484104 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1142/2278] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:16 2022] DELETE /identity/v3/users/806a28b248084ef9accb7795b2ae6166 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:16.488612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af63ef-5d4f-4004-bcd5-ed71c4e9a1e6 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:16.488953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af63ef-5d4f-4004-bcd5-ed71c4e9a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:16.489229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af63ef-5d4f-4004-bcd5-ed71c4e9a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:16.509942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-a2af63ef-5d4f-4004-bcd5-ed71c4e9a1e6 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:16.511526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a2af63ef-5d4f-4004-bcd5-ed71c4e9a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:16.587642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1137/2279] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:16.597582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:16.601407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:16.666183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce21e6-54b5-4446-a6f8-4e304627f562 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:16.669864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e93894-3fc3-48a3-8084-8f92138288d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:16.670581 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e93894-3fc3-48a3-8084-8f92138288d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:16.670878 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e93894-3fc3-48a3-8084-8f92138288d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:16.671139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e93894-3fc3-48a3-8084-8f92138288d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:16.683878 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e93894-3fc3-48a3-8084-8f92138288d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:16.685371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e93894-3fc3-48a3-8084-8f92138288d2 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:16.695637 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1143/2280] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:16.798695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af63ef-5d4f-4004-bcd5-ed71c4e9a1e6 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:16.800340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a2af63ef-5d4f-4004-bcd5-ed71c4e9a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:16.821520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af63ef-5d4f-4004-bcd5-ed71c4e9a1e6 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:16.827213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812ba28-1310-4520-a30d-f28b1b9685f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:16.828377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812ba28-1310-4520-a30d-f28b1b9685f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:16.828976 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812ba28-1310-4520-a30d-f28b1b9685f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:16.829307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812ba28-1310-4520-a30d-f28b1b9685f3 admin admin] PATH_INFO: `/v3/projects/d84b4de6c294416ea9a33be347c43b08` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:16.842570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812ba28-1310-4520-a30d-f28b1b9685f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84b4de6c294416ea9a33be347c43b08)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:16.844674 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812ba28-1310-4520-a30d-f28b1b9685f3 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:16.908885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0812ba28-1310-4520-a30d-f28b1b9685f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84b4de6c294416ea9a33be347c43b08', 'request_id': 'req-0812ba28-1310-4520-a30d-f28b1b9685f3'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.914141 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:16.919720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0812ba28-1310-4520-a30d-f28b1b9685f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84b4de6c294416ea9a33be347c43b08', 'request_id': 'req-0812ba28-1310-4520-a30d-f28b1b9685f3'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.927316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0812ba28-1310-4520-a30d-f28b1b9685f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84b4de6c294416ea9a33be347c43b08', 'request_id': 'req-0812ba28-1310-4520-a30d-f28b1b9685f3'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.941740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0812ba28-1310-4520-a30d-f28b1b9685f3 admin admin] The token cache is being invalidate because project d84b4de6c294416ea9a33be347c43b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:16.942033 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0812ba28-1310-4520-a30d-f28b1b9685f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.942738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-0812ba28-1310-4520-a30d-f28b1b9685f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:16.944518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1138/2281] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:16 2022] DELETE /identity/v3/projects/d84b4de6c294416ea9a33be347c43b08 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:16.948984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fffcd7-87e2-47fa-97d8-cb60ac012b76 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:16.949271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fffcd7-87e2-47fa-97d8-cb60ac012b76 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:16.949534 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fffcd7-87e2-47fa-97d8-cb60ac012b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:16.972094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-a3fffcd7-87e2-47fa-97d8-cb60ac012b76 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:16.973351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-a3fffcd7-87e2-47fa-97d8-cb60ac012b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:17.041533 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1144/2282] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:17.049787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968d996-3520-4fb6-9ada-ba2cfae59d70 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.050069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968d996-3520-4fb6-9ada-ba2cfae59d70 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.050344 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968d996-3520-4fb6-9ada-ba2cfae59d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.074466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-8968d996-3520-4fb6-9ada-ba2cfae59d70 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:17.076367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8968d996-3520-4fb6-9ada-ba2cfae59d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:17.086321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fffcd7-87e2-47fa-97d8-cb60ac012b76 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.086581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1139/2283] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:17.087983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-a3fffcd7-87e2-47fa-97d8-cb60ac012b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:17.090563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968d996-3520-4fb6-9ada-ba2cfae59d70 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.102189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fffcd7-87e2-47fa-97d8-cb60ac012b76 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.105725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968d996-3520-4fb6-9ada-ba2cfae59d70 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.107982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.109199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.109199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.109441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad admin admin] PATH_INFO: `/v3/projects/a316c8db3b474c8b96377a0e5bf29c3e` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.110578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a316c8db3b474c8b96377a0e5bf29c3e)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.119689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.122777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f07661-7685-40e0-a601-66b9d6420ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.123584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f07661-7685-40e0-a601-66b9d6420ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.123962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f07661-7685-40e0-a601-66b9d6420ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.124189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f07661-7685-40e0-a601-66b9d6420ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.125609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f07661-7685-40e0-a601-66b9d6420ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:12:17.125609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f07661-7685-40e0-a601-66b9d6420ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.127038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f07661-7685-40e0-a601-66b9d6420ff7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.140803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1140/2284] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:12:17.145154 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f07661-7685-40e0-a601-66b9d6420ff7 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.158634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f07661-7685-40e0-a601-66b9d6420ff7 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.174703 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a316c8db3b474c8b96377a0e5bf29c3e', 'request_id': 'req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:17.181478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a316c8db3b474c8b96377a0e5bf29c3e', 'request_id': 'req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:17.190801 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a316c8db3b474c8b96377a0e5bf29c3e', 'request_id': 'req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:17.209005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad admin admin] The token cache is being invalidate because project a316c8db3b474c8b96377a0e5bf29c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:17.210010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:17.210837 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd2a2ae7-a8e1-4d46-8f6b-5e8b0f61e9ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:17.212809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1145/2285] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:17 2022] DELETE /identity/v3/projects/a316c8db3b474c8b96377a0e5bf29c3e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:17.218062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb902db-c151-4ce8-a8b6-10f32f32b829 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.218452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb902db-c151-4ce8-a8b6-10f32f32b829 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.218796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb902db-c151-4ce8-a8b6-10f32f32b829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.234514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ff32a-81f2-41b2-9b7b-63670b32fcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.235270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ff32a-81f2-41b2-9b7b-63670b32fcce admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.235622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ff32a-81f2-41b2-9b7b-63670b32fcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.236005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ff32a-81f2-41b2-9b7b-63670b32fcce admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.237403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ff32a-81f2-41b2-9b7b-63670b32fcce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.240364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ff32a-81f2-41b2-9b7b-63670b32fcce admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.242616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-4bb902db-c151-4ce8-a8b6-10f32f32b829 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:17.243918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4bb902db-c151-4ce8-a8b6-10f32f32b829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:17.259264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1146/2286] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:17.261450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c20091-4a89-4bbc-af4f-c1b5971b452c None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.261925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c20091-4a89-4bbc-af4f-c1b5971b452c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.262210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c20091-4a89-4bbc-af4f-c1b5971b452c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.286169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-50c20091-4a89-4bbc-af4f-c1b5971b452c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:17.287312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1141/2287] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:17 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:12:17.289472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-50c20091-4a89-4bbc-af4f-c1b5971b452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:17.291723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ff32a-81f2-41b2-9b7b-63670b32fcce admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.293497 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-033ff32a-81f2-41b2-9b7b-63670b32fcce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:17.298516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:17.392361 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ff32a-81f2-41b2-9b7b-63670b32fcce admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.396862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1147/2288] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:17.402652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c20091-4a89-4bbc-af4f-c1b5971b452c None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.403593 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fdfd0-f11d-4a5a-accb-f47b9fc2dec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.404835 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fdfd0-f11d-4a5a-accb-f47b9fc2dec9 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.405461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fdfd0-f11d-4a5a-accb-f47b9fc2dec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.406201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fdfd0-f11d-4a5a-accb-f47b9fc2dec9 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.407991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fdfd0-f11d-4a5a-accb-f47b9fc2dec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.411580 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fdfd0-f11d-4a5a-accb-f47b9fc2dec9 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.418509 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c20091-4a89-4bbc-af4f-c1b5971b452c None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.426512 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74194c-92f9-4f89-8c1b-bac9d39e9a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.428224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74194c-92f9-4f89-8c1b-bac9d39e9a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.428730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74194c-92f9-4f89-8c1b-bac9d39e9a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.429424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74194c-92f9-4f89-8c1b-bac9d39e9a72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.430522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74194c-92f9-4f89-8c1b-bac9d39e9a72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:12:17.430712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74194c-92f9-4f89-8c1b-bac9d39e9a72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.433221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74194c-92f9-4f89-8c1b-bac9d39e9a72 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.446589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1142/2289] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:17 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:12:17.454701 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fdfd0-f11d-4a5a-accb-f47b9fc2dec9 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.462369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1148/2290] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:12:17.467754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74194c-92f9-4f89-8c1b-bac9d39e9a72 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.468363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fdfd0-f11d-4a5a-accb-f47b9fc2dec9 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.474013 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba9328-6b70-437e-afc7-8496d3403232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.474891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba9328-6b70-437e-afc7-8496d3403232 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.475157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba9328-6b70-437e-afc7-8496d3403232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.475998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba9328-6b70-437e-afc7-8496d3403232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.476662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba9328-6b70-437e-afc7-8496d3403232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.484893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba9328-6b70-437e-afc7-8496d3403232 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.484997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74194c-92f9-4f89-8c1b-bac9d39e9a72 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.484997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baae7f-7048-43a7-bfa8-6f3f5aa9a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.485377 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baae7f-7048-43a7-bfa8-6f3f5aa9a425 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.485736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baae7f-7048-43a7-bfa8-6f3f5aa9a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.486060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baae7f-7048-43a7-bfa8-6f3f5aa9a425 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.486773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63baae7f-7048-43a7-bfa8-6f3f5aa9a425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.488976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63baae7f-7048-43a7-bfa8-6f3f5aa9a425 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.494539 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1143/2291] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:17.496152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba9328-6b70-437e-afc7-8496d3403232 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.498365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-66ba9328-6b70-437e-afc7-8496d3403232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:17.525558 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1149/2292] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:17 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:12:17.527260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baae7f-7048-43a7-bfa8-6f3f5aa9a425 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.532447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:17.570546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba9328-6b70-437e-afc7-8496d3403232 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.609289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baae7f-7048-43a7-bfa8-6f3f5aa9a425 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.613939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d9325-5343-4076-985e-fd0ed386e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.615113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d9325-5343-4076-985e-fd0ed386e148 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.616092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d9325-5343-4076-985e-fd0ed386e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.616379 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d9325-5343-4076-985e-fd0ed386e148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.617075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d9325-5343-4076-985e-fd0ed386e148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.618701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d9325-5343-4076-985e-fd0ed386e148 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.631702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1150/2293] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:17.632779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d9325-5343-4076-985e-fd0ed386e148 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.644020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3569-93b2-497c-b889-53d10e7fd56b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.644637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3569-93b2-497c-b889-53d10e7fd56b service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.644815 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d9325-5343-4076-985e-fd0ed386e148 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.645071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3569-93b2-497c-b889-53d10e7fd56b service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.645440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3569-93b2-497c-b889-53d10e7fd56b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.647350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-efef3569-93b2-497c-b889-53d10e7fd56b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:17.650003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a9347-8fcc-4817-b00a-2198f1b48c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.650594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9347-8fcc-4817-b00a-2198f1b48c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.650873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9347-8fcc-4817-b00a-2198f1b48c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.651145 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9347-8fcc-4817-b00a-2198f1b48c63 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.651772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a9347-8fcc-4817-b00a-2198f1b48c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.653783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a9347-8fcc-4817-b00a-2198f1b48c63 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.677971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1151/2294] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:17 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:17.679089 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a9347-8fcc-4817-b00a-2198f1b48c63 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.689318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a9347-8fcc-4817-b00a-2198f1b48c63 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.695291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15488f-4985-48c3-9586-4fb8bf2de142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.695983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15488f-4985-48c3-9586-4fb8bf2de142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.696266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15488f-4985-48c3-9586-4fb8bf2de142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.696544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15488f-4985-48c3-9586-4fb8bf2de142 admin admin] PATH_INFO: `/v3/projects/b08efd41783f42a98bdc0ce9bed88bbd/users/aeff6e28a10c4af3be36a1a393105e66/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.712642 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15488f-4985-48c3-9586-4fb8bf2de142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b08efd41783f42a98bdc0ce9bed88bbd, user_id=aeff6e28a10c4af3be36a1a393105e66, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.713838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef3569-93b2-497c-b889-53d10e7fd56b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.715431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef3569-93b2-497c-b889-53d10e7fd56b service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.716808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15488f-4985-48c3-9586-4fb8bf2de142 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.727035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1144/2295] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:17.727706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3569-93b2-497c-b889-53d10e7fd56b service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.732932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1152/2296] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:17 2022] PUT /identity/v3/projects/b08efd41783f42a98bdc0ce9bed88bbd/users/aeff6e28a10c4af3be36a1a393105e66/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:17.745005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203a0c6-b254-4e68-8eb0-06f0e7a4a4fc None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.745485 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203a0c6-b254-4e68-8eb0-06f0e7a4a4fc None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.745964 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203a0c6-b254-4e68-8eb0-06f0e7a4a4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.750405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3569-93b2-497c-b889-53d10e7fd56b service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.793798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-4203a0c6-b254-4e68-8eb0-06f0e7a4a4fc None None] MFA Rules not processed for user `aeff6e28a10c4af3be36a1a393105e66`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:17.795166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4203a0c6-b254-4e68-8eb0-06f0e7a4a4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:17.814326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:17.843312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3841d-ba7b-4d37-a656-10462e21e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.843929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3841d-ba7b-4d37-a656-10462e21e3bf admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.844219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3841d-ba7b-4d37-a656-10462e21e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.844497 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3841d-ba7b-4d37-a656-10462e21e3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.845196 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3841d-ba7b-4d37-a656-10462e21e3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.846955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3841d-ba7b-4d37-a656-10462e21e3bf admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.867957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1145/2297] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:17.872050 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3841d-ba7b-4d37-a656-10462e21e3bf admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.884508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3841d-ba7b-4d37-a656-10462e21e3bf admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.889513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf6187-0ffe-40b6-9647-81a78f3acf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.890360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1153/2298] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:17.890561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf6187-0ffe-40b6-9647-81a78f3acf40 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.890561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf6187-0ffe-40b6-9647-81a78f3acf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.890849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf6187-0ffe-40b6-9647-81a78f3acf40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.891440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf6187-0ffe-40b6-9647-81a78f3acf40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.893173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf6187-0ffe-40b6-9647-81a78f3acf40 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.905684 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1146/2299] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:12:17.906867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203a0c6-b254-4e68-8eb0-06f0e7a4a4fc None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.909940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4203a0c6-b254-4e68-8eb0-06f0e7a4a4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:17.910081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf6187-0ffe-40b6-9647-81a78f3acf40 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:17.934485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf6187-0ffe-40b6-9647-81a78f3acf40 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:17.949198 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5eb1f5-86f4-498a-b625-2dfe1b400103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:17.949885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb1f5-86f4-498a-b625-2dfe1b400103 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:17.950260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb1f5-86f4-498a-b625-2dfe1b400103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:17.950571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb1f5-86f4-498a-b625-2dfe1b400103 admin admin] PATH_INFO: `/v3/projects/88024dbee2a543e3b364cb140bf8eefe/users/dcafcf13b70b4cc1b175611186d9ae5e/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:17.978298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5eb1f5-86f4-498a-b625-2dfe1b400103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88024dbee2a543e3b364cb140bf8eefe, user_id=dcafcf13b70b4cc1b175611186d9ae5e, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:17.983058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5eb1f5-86f4-498a-b625-2dfe1b400103 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:17.987939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:18.004784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1147/2300] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:17 2022] PUT /identity/v3/projects/88024dbee2a543e3b364cb140bf8eefe/users/dcafcf13b70b4cc1b175611186d9ae5e/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:18.016856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b89b3-17a5-4293-8f5a-f138616fde1d None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:18.018827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b89b3-17a5-4293-8f5a-f138616fde1d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:18.019414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b89b3-17a5-4293-8f5a-f138616fde1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:18.038579 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203a0c6-b254-4e68-8eb0-06f0e7a4a4fc None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:18.062310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-477b89b3-17a5-4293-8f5a-f138616fde1d None None] MFA Rules not processed for user `dcafcf13b70b4cc1b175611186d9ae5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:18.063666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-477b89b3-17a5-4293-8f5a-f138616fde1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:18.117171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f09106-2ae7-4f41-9bd4-b2410dac5f7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc71e3a41ac644ff8a908b766495b5f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:18.117171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f09106-2ae7-4f41-9bd4-b2410dac5f7a service glance] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:18.117171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f09106-2ae7-4f41-9bd4-b2410dac5f7a service glance] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:18.117569 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f09106-2ae7-4f41-9bd4-b2410dac5f7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:18.174078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1148/2301] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:18.187596 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b89b3-17a5-4293-8f5a-f138616fde1d None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:18.189109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-477b89b3-17a5-4293-8f5a-f138616fde1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:18.192287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f09106-2ae7-4f41-9bd4-b2410dac5f7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:18.193826 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f09106-2ae7-4f41-9bd4-b2410dac5f7a service glance] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:18.204418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1154/2302] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:18.273678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b89b3-17a5-4293-8f5a-f138616fde1d None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:18.278040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693ac80-d07b-4d1a-8fff-fff83be93cce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:18.279226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693ac80-d07b-4d1a-8fff-fff83be93cce service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:18.279513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693ac80-d07b-4d1a-8fff-fff83be93cce service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:18.279785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693ac80-d07b-4d1a-8fff-fff83be93cce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:18.290356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693ac80-d07b-4d1a-8fff-fff83be93cce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:18.291802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693ac80-d07b-4d1a-8fff-fff83be93cce service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:18.302612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1149/2303] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:12:18.827915 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f09106-2ae7-4f41-9bd4-b2410dac5f7a service glance] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:18.837774 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f09106-2ae7-4f41-9bd4-b2410dac5f7a service glance] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:18.841548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a96dc-a65c-4c8c-a7b2-d692f1223234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:18.842144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a96dc-a65c-4c8c-a7b2-d692f1223234 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:18.842424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a96dc-a65c-4c8c-a7b2-d692f1223234 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:18.842696 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a96dc-a65c-4c8c-a7b2-d692f1223234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:18.844418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b98a96dc-a65c-4c8c-a7b2-d692f1223234 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:18.881823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:18.916865 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a96dc-a65c-4c8c-a7b2-d692f1223234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:18.918337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a96dc-a65c-4c8c-a7b2-d692f1223234 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:18.929629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1155/2304] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:21.038947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693ac80-d07b-4d1a-8fff-fff83be93cce service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:21.105478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693ac80-d07b-4d1a-8fff-fff83be93cce service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:21.110568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:21.111237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:21.111541 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:21.111831 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] PATH_INFO: `/v3/users/dcafcf13b70b4cc1b175611186d9ae5e` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:21.113009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcafcf13b70b4cc1b175611186d9ae5e)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:21.115847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:21.162019 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:21.177731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcafcf13b70b4cc1b175611186d9ae5e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:21.185311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcafcf13b70b4cc1b175611186d9ae5e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:21.186040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcafcf13b70b4cc1b175611186d9ae5e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:21.186842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcafcf13b70b4cc1b175611186d9ae5e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:21.200586 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcafcf13b70b4cc1b175611186d9ae5e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:21.217994 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1150/2305] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:21 2022] DELETE /identity/v3/users/dcafcf13b70b4cc1b175611186d9ae5e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:21.222552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457e059-cc95-48a8-9ab4-6859062368a7 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:21.223048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457e059-cc95-48a8-9ab4-6859062368a7 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:21.223601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457e059-cc95-48a8-9ab4-6859062368a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:21.244466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8457e059-cc95-48a8-9ab4-6859062368a7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:21.245737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8457e059-cc95-48a8-9ab4-6859062368a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:21.314187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1156/2306] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:21.325034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:21.326533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:21.394191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345fc5-c640-40ec-a250-3fa637adf5f8 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:21.398120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980af7c-599b-4198-9fdc-93fe719d0b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:21.398802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980af7c-599b-4198-9fdc-93fe719d0b57 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:21.399000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980af7c-599b-4198-9fdc-93fe719d0b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:21.399275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980af7c-599b-4198-9fdc-93fe719d0b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:21.409773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980af7c-599b-4198-9fdc-93fe719d0b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:21.411843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980af7c-599b-4198-9fdc-93fe719d0b57 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:21.422297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1151/2307] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:21.765520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457e059-cc95-48a8-9ab4-6859062368a7 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:21.768306 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8457e059-cc95-48a8-9ab4-6859062368a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:21.798269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457e059-cc95-48a8-9ab4-6859062368a7 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:21.812203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:21.813101 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:21.813556 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:21.813870 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb admin admin] PATH_INFO: `/v3/projects/88024dbee2a543e3b364cb140bf8eefe` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:21.815270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=88024dbee2a543e3b364cb140bf8eefe)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:21.818601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:21.878836 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88024dbee2a543e3b364cb140bf8eefe', 'request_id': 'req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:21.886066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88024dbee2a543e3b364cb140bf8eefe', 'request_id': 'req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:21.894199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88024dbee2a543e3b364cb140bf8eefe', 'request_id': 'req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:21.912225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb admin admin] The token cache is being invalidate because project 88024dbee2a543e3b364cb140bf8eefe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:21.912524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:21.913218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fd7fd249-d36c-4486-8c7e-b42e3a6b7ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:21.915663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1157/2308] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:21 2022] DELETE /identity/v3/projects/88024dbee2a543e3b364cb140bf8eefe => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:21.920663 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304da95-c949-4335-8750-02c2c478ff96 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:21.920883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304da95-c949-4335-8750-02c2c478ff96 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:21.921133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304da95-c949-4335-8750-02c2c478ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:21.942903 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-2304da95-c949-4335-8750-02c2c478ff96 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:21.944195 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2304da95-c949-4335-8750-02c2c478ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:22.044772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1152/2309] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:22.053413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c9fda-d4d4-4441-b057-142017a04fb4 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:22.053939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c9fda-d4d4-4441-b057-142017a04fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:22.054265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c9fda-d4d4-4441-b057-142017a04fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:22.076268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-cf9c9fda-d4d4-4441-b057-142017a04fb4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:22.077790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-cf9c9fda-d4d4-4441-b057-142017a04fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:22.087646 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1158/2310] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:22.092105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304da95-c949-4335-8750-02c2c478ff96 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:22.102699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304da95-c949-4335-8750-02c2c478ff96 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:22.107796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e43e05-d301-44dc-868e-7bcb9aad281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:22.108404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e43e05-d301-44dc-868e-7bcb9aad281d admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:22.108706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e43e05-d301-44dc-868e-7bcb9aad281d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:22.108983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e43e05-d301-44dc-868e-7bcb9aad281d admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:22.109621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e43e05-d301-44dc-868e-7bcb9aad281d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:12:22.109923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e43e05-d301-44dc-868e-7bcb9aad281d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:22.111487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e43e05-d301-44dc-868e-7bcb9aad281d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:22.125985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1153/2311] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:12:22.130440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c9fda-d4d4-4441-b057-142017a04fb4 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:22.139744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c9fda-d4d4-4441-b057-142017a04fb4 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:22.144475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f1ea-5fde-43a2-ab29-577a30e21f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:22.145124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f1ea-5fde-43a2-ab29-577a30e21f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:22.145422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f1ea-5fde-43a2-ab29-577a30e21f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:22.146210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f1ea-5fde-43a2-ab29-577a30e21f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:22.146867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407f1ea-5fde-43a2-ab29-577a30e21f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:22.148882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407f1ea-5fde-43a2-ab29-577a30e21f38 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:22.184618 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1159/2312] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:22 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:22.188815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e43e05-d301-44dc-868e-7bcb9aad281d admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:22.199804 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e43e05-d301-44dc-868e-7bcb9aad281d admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:22.235472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:22.262191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586af72e-e195-4325-8489-4db41881ee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:22.262821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586af72e-e195-4325-8489-4db41881ee0f admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:22.263100 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586af72e-e195-4325-8489-4db41881ee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:22.263422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586af72e-e195-4325-8489-4db41881ee0f admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:22.264177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586af72e-e195-4325-8489-4db41881ee0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:22.267859 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586af72e-e195-4325-8489-4db41881ee0f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:22.294293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1154/2313] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:22 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:22.299034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f1ea-5fde-43a2-ab29-577a30e21f38 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:22.310199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f1ea-5fde-43a2-ab29-577a30e21f38 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:22.315370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67846f56-597f-4663-a34b-c29b7640dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:22.316003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846f56-597f-4663-a34b-c29b7640dde8 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:22.316288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846f56-597f-4663-a34b-c29b7640dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:22.316570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846f56-597f-4663-a34b-c29b7640dde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:22.317243 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67846f56-597f-4663-a34b-c29b7640dde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:22.319278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67846f56-597f-4663-a34b-c29b7640dde8 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:22.331249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1160/2314] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:22.338120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586af72e-e195-4325-8489-4db41881ee0f admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:22.355282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586af72e-e195-4325-8489-4db41881ee0f admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:22.364935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61ce88-98f4-4887-9f7b-8ffa1c409758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:22.364935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61ce88-98f4-4887-9f7b-8ffa1c409758 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:22.367393 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61ce88-98f4-4887-9f7b-8ffa1c409758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:22.367945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61ce88-98f4-4887-9f7b-8ffa1c409758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:22.369350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61ce88-98f4-4887-9f7b-8ffa1c409758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:22.371606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61ce88-98f4-4887-9f7b-8ffa1c409758 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:22.392751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1155/2315] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:12:22.395391 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67846f56-597f-4663-a34b-c29b7640dde8 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:22.408882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67846f56-597f-4663-a34b-c29b7640dde8 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:22.418965 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c818424-3492-4ead-85a4-de2b68a2d748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:22.420661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c818424-3492-4ead-85a4-de2b68a2d748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:22.421064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c818424-3492-4ead-85a4-de2b68a2d748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:22.421350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c818424-3492-4ead-85a4-de2b68a2d748 admin admin] PATH_INFO: `/v3/projects/64fceb79721647f09075f24fda514e19/users/6a72a5894e3948ab90f41be20458c919/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:22.425903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:22.453603 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c818424-3492-4ead-85a4-de2b68a2d748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fceb79721647f09075f24fda514e19, user_id=6a72a5894e3948ab90f41be20458c919, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:22.458172 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c818424-3492-4ead-85a4-de2b68a2d748 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:22.490708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1161/2316] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:22 2022] PUT /identity/v3/projects/64fceb79721647f09075f24fda514e19/users/6a72a5894e3948ab90f41be20458c919/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:22.501348 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b275721-4f83-4a3f-9942-436bc60e0073 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:22.501678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b275721-4f83-4a3f-9942-436bc60e0073 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:22.501963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b275721-4f83-4a3f-9942-436bc60e0073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:22.542311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-4b275721-4f83-4a3f-9942-436bc60e0073 None None] MFA Rules not processed for user `6a72a5894e3948ab90f41be20458c919`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:22.543739 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4b275721-4f83-4a3f-9942-436bc60e0073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:22.626871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1156/2317] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:22.639837 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c818424-3492-4ead-85a4-de2b68a2d748 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:22.641604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9c818424-3492-4ead-85a4-de2b68a2d748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:22.704964 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c818424-3492-4ead-85a4-de2b68a2d748 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:22.710087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81dc9b-f9bf-44b8-9373-fc5124f2b631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:22.710814 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81dc9b-f9bf-44b8-9373-fc5124f2b631 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:22.711435 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81dc9b-f9bf-44b8-9373-fc5124f2b631 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:22.711809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81dc9b-f9bf-44b8-9373-fc5124f2b631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:22.722356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81dc9b-f9bf-44b8-9373-fc5124f2b631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:22.724878 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81dc9b-f9bf-44b8-9373-fc5124f2b631 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:22.735579 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1162/2318] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:22.952995 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b275721-4f83-4a3f-9942-436bc60e0073 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:22.952995 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4b275721-4f83-4a3f-9942-436bc60e0073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:23.078084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b275721-4f83-4a3f-9942-436bc60e0073 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:23.084509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:23.085262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:23.085708 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:23.086043 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] PATH_INFO: `/v3/users/d86b2469346f446fbcd8e7f7771e2a59` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:23.087212 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86b2469346f446fbcd8e7f7771e2a59)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:23.089720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:23.177230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86b2469346f446fbcd8e7f7771e2a59'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:23.180784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:23.195104 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86b2469346f446fbcd8e7f7771e2a59'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:23.196961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86b2469346f446fbcd8e7f7771e2a59'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:23.198823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86b2469346f446fbcd8e7f7771e2a59'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:23.222301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86b2469346f446fbcd8e7f7771e2a59'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:23.240789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1157/2319] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:22 2022] DELETE /identity/v3/users/d86b2469346f446fbcd8e7f7771e2a59 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:23.245346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b3cab-95d9-4410-895e-df7f229435da None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:23.245636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b3cab-95d9-4410-895e-df7f229435da None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:23.245937 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b3cab-95d9-4410-895e-df7f229435da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:23.268738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-1b8b3cab-95d9-4410-895e-df7f229435da None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:23.269972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1b8b3cab-95d9-4410-895e-df7f229435da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:23.344101 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1163/2320] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:23.356633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:23.358355 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:23.456331 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0dcec-a4e2-40a8-92e1-1efc7b7678f5 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:23.463018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08abb99-9b7f-45a4-8048-60b086a3db26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:23.463018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08abb99-9b7f-45a4-8048-60b086a3db26 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:23.463018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08abb99-9b7f-45a4-8048-60b086a3db26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:23.463018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08abb99-9b7f-45a4-8048-60b086a3db26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:23.472527 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08abb99-9b7f-45a4-8048-60b086a3db26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:23.474042 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08abb99-9b7f-45a4-8048-60b086a3db26 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:23.484617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1158/2321] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:23.788906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b3cab-95d9-4410-895e-df7f229435da None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:23.790560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1b8b3cab-95d9-4410-895e-df7f229435da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:23.809033 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b3cab-95d9-4410-895e-df7f229435da None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:23.814453 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:23.815239 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:23.815617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:23.816063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb admin admin] PATH_INFO: `/v3/projects/9f1ecfa6de294966b74a66435f7f9b5d` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:23.818430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1ecfa6de294966b74a66435f7f9b5d)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:23.822409 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:23.877487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1ecfa6de294966b74a66435f7f9b5d', 'request_id': 'req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:23.883348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1ecfa6de294966b74a66435f7f9b5d', 'request_id': 'req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:23.890552 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1ecfa6de294966b74a66435f7f9b5d', 'request_id': 'req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:23.904109 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb admin admin] The token cache is being invalidate because project 9f1ecfa6de294966b74a66435f7f9b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:23.905371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:23.906211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-aa7c87c9-e4c9-4414-b4cc-cd9c514c8cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:23.908218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1164/2322] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:23 2022] DELETE /identity/v3/projects/9f1ecfa6de294966b74a66435f7f9b5d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:12:23.913308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08abb99-9b7f-45a4-8048-60b086a3db26 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:23.922937 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08abb99-9b7f-45a4-8048-60b086a3db26 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:23.985749 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:23.986384 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:23.986664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:23.986938 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] PATH_INFO: `/v3/users/d11f8171e6bd45049d83c4b129f6bcad` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:23.988058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11f8171e6bd45049d83c4b129f6bcad)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:23.991285 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:24.048357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11f8171e6bd45049d83c4b129f6bcad'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.058515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11f8171e6bd45049d83c4b129f6bcad'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.063373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11f8171e6bd45049d83c4b129f6bcad'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.064068 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11f8171e6bd45049d83c4b129f6bcad'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.076821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:24.078067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11f8171e6bd45049d83c4b129f6bcad'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.095153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1159/2323] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:23 2022] DELETE /identity/v3/users/d11f8171e6bd45049d83c4b129f6bcad => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:12:24.298909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029699c-927e-43d8-98ee-d4d003c18d9e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:24.299200 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029699c-927e-43d8-98ee-d4d003c18d9e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:24.299503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029699c-927e-43d8-98ee-d4d003c18d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:24.322297 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b029699c-927e-43d8-98ee-d4d003c18d9e None None] MFA Rules not processed for user `6a72a5894e3948ab90f41be20458c919`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:24.323576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b029699c-927e-43d8-98ee-d4d003c18d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:24.327794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:24.392336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1165/2324] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:24.393621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:24.395253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:24.494448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b48879-7a39-4871-a14e-4a88216ee143 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:24.499850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:24.500715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:24.501000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:24.501276 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] PATH_INFO: `/v3/projects/06347986052745f3a9e2107065450ed0` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:24.502465 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06347986052745f3a9e2107065450ed0)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:24.504355 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:24.567926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06347986052745f3a9e2107065450ed0', 'request_id': 'req-781bcf19-1a13-406e-b132-971109004d41'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.575089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06347986052745f3a9e2107065450ed0', 'request_id': 'req-781bcf19-1a13-406e-b132-971109004d41'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.580993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06347986052745f3a9e2107065450ed0', 'request_id': 'req-781bcf19-1a13-406e-b132-971109004d41'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.594320 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] The token cache is being invalidate because project 06347986052745f3a9e2107065450ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:24.594607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.595256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.596957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1160/2325] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:24 2022] DELETE /identity/v3/projects/06347986052745f3a9e2107065450ed0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:12:24.601734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029699c-927e-43d8-98ee-d4d003c18d9e None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:24.612963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029699c-927e-43d8-98ee-d4d003c18d9e None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:24.681917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17e909-d6f6-49d2-84e9-83ffdd85c1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:24.682476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17e909-d6f6-49d2-84e9-83ffdd85c1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:24.682757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17e909-d6f6-49d2-84e9-83ffdd85c1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:24.683032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17e909-d6f6-49d2-84e9-83ffdd85c1b1 admin admin] PATH_INFO: `/v3/users/d2b55920c9df42459d9771713adb4250` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:24.684169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17e909-d6f6-49d2-84e9-83ffdd85c1b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b55920c9df42459d9771713adb4250)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:24.686189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17e909-d6f6-49d2-84e9-83ffdd85c1b1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:24.739382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0b17e909-d6f6-49d2-84e9-83ffdd85c1b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b55920c9df42459d9771713adb4250'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.750156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0b17e909-d6f6-49d2-84e9-83ffdd85c1b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b55920c9df42459d9771713adb4250'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.776708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0b17e909-d6f6-49d2-84e9-83ffdd85c1b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b55920c9df42459d9771713adb4250'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.777575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0b17e909-d6f6-49d2-84e9-83ffdd85c1b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b55920c9df42459d9771713adb4250'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.778200 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0b17e909-d6f6-49d2-84e9-83ffdd85c1b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b55920c9df42459d9771713adb4250'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:24.796186 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1166/2326] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:24 2022] DELETE /identity/v3/users/d2b55920c9df42459d9771713adb4250 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:25.190808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:25.195153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:25.213631 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bcf19-1a13-406e-b132-971109004d41 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:25.289275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce205a5-33bc-48f8-b009-3ac9c2a03751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:25.289979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce205a5-33bc-48f8-b009-3ac9c2a03751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:25.290263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce205a5-33bc-48f8-b009-3ac9c2a03751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:25.290528 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce205a5-33bc-48f8-b009-3ac9c2a03751 admin admin] PATH_INFO: `/v3/projects/9e6fe85d7e684faba396d45389e3fc6d` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:25.291931 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce205a5-33bc-48f8-b009-3ac9c2a03751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e6fe85d7e684faba396d45389e3fc6d)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:25.294205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce205a5-33bc-48f8-b009-3ac9c2a03751 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:25.330315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:25.383602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3ce205a5-33bc-48f8-b009-3ac9c2a03751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e6fe85d7e684faba396d45389e3fc6d', 'request_id': 'req-3ce205a5-33bc-48f8-b009-3ac9c2a03751'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:25.396487 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3ce205a5-33bc-48f8-b009-3ac9c2a03751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e6fe85d7e684faba396d45389e3fc6d', 'request_id': 'req-3ce205a5-33bc-48f8-b009-3ac9c2a03751'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:25.404772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3ce205a5-33bc-48f8-b009-3ac9c2a03751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e6fe85d7e684faba396d45389e3fc6d', 'request_id': 'req-3ce205a5-33bc-48f8-b009-3ac9c2a03751'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:25.421404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3ce205a5-33bc-48f8-b009-3ac9c2a03751 admin admin] The token cache is being invalidate because project 9e6fe85d7e684faba396d45389e3fc6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:25.423113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3ce205a5-33bc-48f8-b009-3ac9c2a03751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:25.424779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3ce205a5-33bc-48f8-b009-3ac9c2a03751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:25.428076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1161/2327] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:25 2022] DELETE /identity/v3/projects/9e6fe85d7e684faba396d45389e3fc6d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:25.433242 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac99b-cd75-43b0-b0cb-73c94867a662 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:25.435521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac99b-cd75-43b0-b0cb-73c94867a662 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:25.435521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac99b-cd75-43b0-b0cb-73c94867a662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:25.462084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f9dac99b-cd75-43b0-b0cb-73c94867a662 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:25.463684 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f9dac99b-cd75-43b0-b0cb-73c94867a662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:25.516970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:25.576356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1167/2328] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:25.584357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8b77f-9e39-4a31-b023-e03147d5884f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:25.584667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8b77f-9e39-4a31-b023-e03147d5884f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:25.585007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8b77f-9e39-4a31-b023-e03147d5884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:25.611387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-a8a8b77f-9e39-4a31-b023-e03147d5884f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:25.612816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a8a8b77f-9e39-4a31-b023-e03147d5884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:25.621685 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1162/2329] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:25.626214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dac99b-cd75-43b0-b0cb-73c94867a662 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:25.640196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dac99b-cd75-43b0-b0cb-73c94867a662 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:25.646385 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e2338-4431-4a74-a610-896000f7b318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:25.647073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e2338-4431-4a74-a610-896000f7b318 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:25.647553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e2338-4431-4a74-a610-896000f7b318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:25.648000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e2338-4431-4a74-a610-896000f7b318 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:25.649237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e2338-4431-4a74-a610-896000f7b318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:12:25.649739 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e2338-4431-4a74-a610-896000f7b318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:25.652433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e2338-4431-4a74-a610-896000f7b318 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:25.677514 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1168/2330] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:12:25.682160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8b77f-9e39-4a31-b023-e03147d5884f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:25.691706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8b77f-9e39-4a31-b023-e03147d5884f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:25.702256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2877-85b1-4391-9c51-b67b5e847d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:25.703472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2877-85b1-4391-9c51-b67b5e847d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:25.703656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2877-85b1-4391-9c51-b67b5e847d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:25.703958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2877-85b1-4391-9c51-b67b5e847d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:25.704745 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb2877-85b1-4391-9c51-b67b5e847d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:25.707506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb2877-85b1-4391-9c51-b67b5e847d05 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:25.748201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1163/2331] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:25 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:25.752114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e2338-4431-4a74-a610-896000f7b318 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:25.763283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e2338-4431-4a74-a610-896000f7b318 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:25.823251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ba5c-b4fe-4642-9999-0787930de2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:25.823895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ba5c-b4fe-4642-9999-0787930de2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:25.824204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ba5c-b4fe-4642-9999-0787930de2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:25.824502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ba5c-b4fe-4642-9999-0787930de2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:25.825192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877ba5c-b4fe-4642-9999-0787930de2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:25.827151 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877ba5c-b4fe-4642-9999-0787930de2a8 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:25.852254 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1169/2332] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:25 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:12:25.858304 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2877-85b1-4391-9c51-b67b5e847d05 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:25.872850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2877-85b1-4391-9c51-b67b5e847d05 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:25.878306 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87850197-d44d-4c13-9452-898281b82538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:25.879243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87850197-d44d-4c13-9452-898281b82538 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:25.879554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87850197-d44d-4c13-9452-898281b82538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:25.879864 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87850197-d44d-4c13-9452-898281b82538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:25.880564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87850197-d44d-4c13-9452-898281b82538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:25.882317 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87850197-d44d-4c13-9452-898281b82538 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:25.893415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1164/2333] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:25.898105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ba5c-b4fe-4642-9999-0787930de2a8 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:25.908548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ba5c-b4fe-4642-9999-0787930de2a8 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:25.914264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38e29-1d7d-4d8a-8359-d2ac54660c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:25.915100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38e29-1d7d-4d8a-8359-d2ac54660c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:25.915448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38e29-1d7d-4d8a-8359-d2ac54660c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:25.915762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38e29-1d7d-4d8a-8359-d2ac54660c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:25.916829 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f38e29-1d7d-4d8a-8359-d2ac54660c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:25.918093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f38e29-1d7d-4d8a-8359-d2ac54660c6a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:25.938357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1170/2334] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:25.940059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87850197-d44d-4c13-9452-898281b82538 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:25.951683 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87850197-d44d-4c13-9452-898281b82538 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:25.959191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf896d-e0c0-48e2-a257-a060cc16305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:25.959191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf896d-e0c0-48e2-a257-a060cc16305e admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:25.959191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf896d-e0c0-48e2-a257-a060cc16305e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:25.959191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf896d-e0c0-48e2-a257-a060cc16305e admin admin] PATH_INFO: `/v3/projects/42cfcd19a741461ea4e9fe993a3a2396/users/48ad127896904c338c4fa44d61282e2c/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:25.977705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf896d-e0c0-48e2-a257-a060cc16305e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42cfcd19a741461ea4e9fe993a3a2396, user_id=48ad127896904c338c4fa44d61282e2c, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:25.980544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf896d-e0c0-48e2-a257-a060cc16305e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:26.003363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1165/2335] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:25 2022] PUT /identity/v3/projects/42cfcd19a741461ea4e9fe993a3a2396/users/48ad127896904c338c4fa44d61282e2c/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:26.009279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ba404-362f-4f13-9c19-440b60064521 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:26.009590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ba404-362f-4f13-9c19-440b60064521 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:26.009872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ba404-362f-4f13-9c19-440b60064521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:26.034449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-1e7ba404-362f-4f13-9c19-440b60064521 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:26.036017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1e7ba404-362f-4f13-9c19-440b60064521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:26.119250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1171/2336] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:26.129088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf896d-e0c0-48e2-a257-a060cc16305e admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:26.131885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-abdf896d-e0c0-48e2-a257-a060cc16305e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:26.198816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf896d-e0c0-48e2-a257-a060cc16305e admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:26.202483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635dc09-a6c4-4e5b-9371-e746fd629366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:26.203114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635dc09-a6c4-4e5b-9371-e746fd629366 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:26.203393 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635dc09-a6c4-4e5b-9371-e746fd629366 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:26.203668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635dc09-a6c4-4e5b-9371-e746fd629366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:26.213797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635dc09-a6c4-4e5b-9371-e746fd629366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:26.215326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635dc09-a6c4-4e5b-9371-e746fd629366 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:26.228509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1166/2337] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:27.139928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ba404-362f-4f13-9c19-440b60064521 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:27.141299 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1e7ba404-362f-4f13-9c19-440b60064521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:27.156318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ba404-362f-4f13-9c19-440b60064521 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:27.172108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:27.174525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:27.175977 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:27.183897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] PATH_INFO: `/v3/users/69fdafd81039428aa80d050e5d07f3f4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:27.188471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69fdafd81039428aa80d050e5d07f3f4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:27.198063 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:27.289744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:27.308117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69fdafd81039428aa80d050e5d07f3f4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:27.320253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69fdafd81039428aa80d050e5d07f3f4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:27.338184 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69fdafd81039428aa80d050e5d07f3f4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:27.338997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69fdafd81039428aa80d050e5d07f3f4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:27.342309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69fdafd81039428aa80d050e5d07f3f4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:27.358578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1172/2338] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:27 2022] DELETE /identity/v3/users/69fdafd81039428aa80d050e5d07f3f4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:27.363221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b3b7d-bf62-407d-9359-e4dc4c22e422 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:27.363720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b3b7d-bf62-407d-9359-e4dc4c22e422 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:27.363900 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b3b7d-bf62-407d-9359-e4dc4c22e422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:27.387783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-eb6b3b7d-bf62-407d-9359-e4dc4c22e422 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:27.389206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-eb6b3b7d-bf62-407d-9359-e4dc4c22e422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:27.445813 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:27.486728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1167/2339] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:27.487571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:27.490720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9e704-a72e-4af5-a1f6-9aa12946c42b None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:27.490906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9e704-a72e-4af5-a1f6-9aa12946c42b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:27.491238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9e704-a72e-4af5-a1f6-9aa12946c42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:27.493632 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:27.534738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-d6a9e704-a72e-4af5-a1f6-9aa12946c42b None None] MFA Rules not processed for user `48ad127896904c338c4fa44d61282e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:27.536000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d6a9e704-a72e-4af5-a1f6-9aa12946c42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:27.567281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb45a-7abc-4b4a-b980-138bcf738f98 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:27.573537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fee25-2e90-4800-af8a-3a70ff502294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:27.574199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fee25-2e90-4800-af8a-3a70ff502294 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:27.574472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fee25-2e90-4800-af8a-3a70ff502294 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:27.574750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fee25-2e90-4800-af8a-3a70ff502294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:27.589501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fee25-2e90-4800-af8a-3a70ff502294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:27.591073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fee25-2e90-4800-af8a-3a70ff502294 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:27.604486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1173/2340] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:27.618490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1168/2341] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:27.629178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fee25-2e90-4800-af8a-3a70ff502294 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:27.631318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-716fee25-2e90-4800-af8a-3a70ff502294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:27.697413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fee25-2e90-4800-af8a-3a70ff502294 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:27.700997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046d587-69e5-47b1-be74-81a801fc3ada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:27.701601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046d587-69e5-47b1-be74-81a801fc3ada service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:27.701975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046d587-69e5-47b1-be74-81a801fc3ada service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:27.702249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046d587-69e5-47b1-be74-81a801fc3ada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:27.713798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046d587-69e5-47b1-be74-81a801fc3ada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:27.715301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046d587-69e5-47b1-be74-81a801fc3ada service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:27.726129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1174/2342] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:28.449111 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9e704-a72e-4af5-a1f6-9aa12946c42b None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:28.450923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d6a9e704-a72e-4af5-a1f6-9aa12946c42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:28.467940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9e704-a72e-4af5-a1f6-9aa12946c42b None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:28.476218 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d056177-0950-4b51-b2e3-763156334a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:28.477267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d056177-0950-4b51-b2e3-763156334a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:28.477588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d056177-0950-4b51-b2e3-763156334a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:28.477869 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d056177-0950-4b51-b2e3-763156334a9e admin admin] PATH_INFO: `/v3/projects/5d7ce66add1c45f3ae7d23a8197985c4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:28.479169 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d056177-0950-4b51-b2e3-763156334a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7ce66add1c45f3ae7d23a8197985c4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:28.481434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d056177-0950-4b51-b2e3-763156334a9e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:28.578599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3d056177-0950-4b51-b2e3-763156334a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7ce66add1c45f3ae7d23a8197985c4', 'request_id': 'req-3d056177-0950-4b51-b2e3-763156334a9e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:28.592722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3d056177-0950-4b51-b2e3-763156334a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7ce66add1c45f3ae7d23a8197985c4', 'request_id': 'req-3d056177-0950-4b51-b2e3-763156334a9e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:28.602496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3d056177-0950-4b51-b2e3-763156334a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7ce66add1c45f3ae7d23a8197985c4', 'request_id': 'req-3d056177-0950-4b51-b2e3-763156334a9e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:28.616266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3d056177-0950-4b51-b2e3-763156334a9e admin admin] The token cache is being invalidate because project 5d7ce66add1c45f3ae7d23a8197985c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:28.620059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3d056177-0950-4b51-b2e3-763156334a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:28.621561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3d056177-0950-4b51-b2e3-763156334a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:28.622745 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1169/2343] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:28 2022] DELETE /identity/v3/projects/5d7ce66add1c45f3ae7d23a8197985c4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:12:29.273074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d49659-4fa3-4cad-9173-e03bb0a675eb None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:29.273991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d49659-4fa3-4cad-9173-e03bb0a675eb None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:29.274325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d49659-4fa3-4cad-9173-e03bb0a675eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:29.298567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f9d49659-4fa3-4cad-9173-e03bb0a675eb None None] MFA Rules not processed for user `48ad127896904c338c4fa44d61282e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:29.299810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f9d49659-4fa3-4cad-9173-e03bb0a675eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:29.386274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1175/2344] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:38.611774 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=65,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:39.129299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfd631-9b93-49a1-802f-e37d39952616 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:39.130547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfd631-9b93-49a1-802f-e37d39952616 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:39.131073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfd631-9b93-49a1-802f-e37d39952616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:39.153678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-59cfd631-9b93-49a1-802f-e37d39952616 None None] MFA Rules not processed for user `e181e79d294845dd88c91a9dff2831f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:39.154950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-59cfd631-9b93-49a1-802f-e37d39952616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:39.212347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1170/2345] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:39.367506 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:43.753364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d49659-4fa3-4cad-9173-e03bb0a675eb None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:43.755717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f9d49659-4fa3-4cad-9173-e03bb0a675eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:43.833559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d49659-4fa3-4cad-9173-e03bb0a675eb None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:43.838202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:43.838833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:43.839114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:43.839389 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] PATH_INFO: `/v3/users/aeff6e28a10c4af3be36a1a393105e66` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:43.840511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeff6e28a10c4af3be36a1a393105e66)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:43.842643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:43.891872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeff6e28a10c4af3be36a1a393105e66'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:43.901542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeff6e28a10c4af3be36a1a393105e66'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:43.915687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeff6e28a10c4af3be36a1a393105e66'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:43.916412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeff6e28a10c4af3be36a1a393105e66'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:43.917057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeff6e28a10c4af3be36a1a393105e66'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:43.930943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1176/2346] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:43 2022] DELETE /identity/v3/users/aeff6e28a10c4af3be36a1a393105e66 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:43.935380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e89048-8ddd-4dba-af68-ad4502be0a15 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:43.935848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e89048-8ddd-4dba-af68-ad4502be0a15 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:43.935964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e89048-8ddd-4dba-af68-ad4502be0a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:43.956023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-28e89048-8ddd-4dba-af68-ad4502be0a15 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:43.957284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-28e89048-8ddd-4dba-af68-ad4502be0a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:44.032562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1171/2347] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:44.047843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:44.049326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:44.118629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209f34a-dbfd-400b-8760-71a2ad818e89 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:44.123254 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c85fc-a9db-4e4e-946f-23c28504c62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:44.123872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c85fc-a9db-4e4e-946f-23c28504c62f service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:44.124157 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c85fc-a9db-4e4e-946f-23c28504c62f service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:44.124454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c85fc-a9db-4e4e-946f-23c28504c62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:44.135644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c85fc-a9db-4e4e-946f-23c28504c62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:44.137357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c85fc-a9db-4e4e-946f-23c28504c62f service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:44.152856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1177/2348] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:44.679150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e89048-8ddd-4dba-af68-ad4502be0a15 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:44.680958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-28e89048-8ddd-4dba-af68-ad4502be0a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:44.694999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e89048-8ddd-4dba-af68-ad4502be0a15 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:44.699854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:44.700994 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:44.701687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:44.702179 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61 admin admin] PATH_INFO: `/v3/projects/b08efd41783f42a98bdc0ce9bed88bbd` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:44.707054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b08efd41783f42a98bdc0ce9bed88bbd)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:44.709826 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:44.799385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b08efd41783f42a98bdc0ce9bed88bbd', 'request_id': 'req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:44.808586 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b08efd41783f42a98bdc0ce9bed88bbd', 'request_id': 'req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:44.815691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b08efd41783f42a98bdc0ce9bed88bbd', 'request_id': 'req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:44.830966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61 admin admin] The token cache is being invalidate because project b08efd41783f42a98bdc0ce9bed88bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:44.831265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:44.831931 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-1b232970-deb3-41ea-8ad3-b0eef3c4bc61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:44.839642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1172/2349] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:44 2022] DELETE /identity/v3/projects/b08efd41783f42a98bdc0ce9bed88bbd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:44.840921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff623-54a0-40ce-8d27-0eb654d963f9 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:44.841711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff623-54a0-40ce-8d27-0eb654d963f9 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:44.842210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff623-54a0-40ce-8d27-0eb654d963f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:44.872569 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e2eff623-54a0-40ce-8d27-0eb654d963f9 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:44.873869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e2eff623-54a0-40ce-8d27-0eb654d963f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:44.911549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:44.946646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750880dd-e4bd-43f7-827e-c5d27e45846c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:44.947540 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750880dd-e4bd-43f7-827e-c5d27e45846c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:44.947982 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750880dd-e4bd-43f7-827e-c5d27e45846c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:44.976724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1178/2350] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:44.979723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-750880dd-e4bd-43f7-827e-c5d27e45846c None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:44.983095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bad70-a324-4033-bc0e-fa0e64825236 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:44.983381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bad70-a324-4033-bc0e-fa0e64825236 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:44.983659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bad70-a324-4033-bc0e-fa0e64825236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:44.984974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-750880dd-e4bd-43f7-827e-c5d27e45846c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:45.010755 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-137bad70-a324-4033-bc0e-fa0e64825236 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:45.011965 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-137bad70-a324-4033-bc0e-fa0e64825236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:45.022069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:45.023489 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1179/2351] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:45.027470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bad70-a324-4033-bc0e-fa0e64825236 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:45.041761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bad70-a324-4033-bc0e-fa0e64825236 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:45.047183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d7cd5-5990-483c-9e1f-7ed78999cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:45.047799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d7cd5-5990-483c-9e1f-7ed78999cf66 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:45.048103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d7cd5-5990-483c-9e1f-7ed78999cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:45.048387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d7cd5-5990-483c-9e1f-7ed78999cf66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:45.049146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d7cd5-5990-483c-9e1f-7ed78999cf66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:12:45.049462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d7cd5-5990-483c-9e1f-7ed78999cf66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:45.051107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d7cd5-5990-483c-9e1f-7ed78999cf66 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:45.063455 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1173/2352] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:12:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:45.063853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1180/2353] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:12:45.068771 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750880dd-e4bd-43f7-827e-c5d27e45846c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:45.080627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750880dd-e4bd-43f7-827e-c5d27e45846c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:45.085983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7cb49-3a6b-413d-b6a1-4cc1d8077002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:45.086697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7cb49-3a6b-413d-b6a1-4cc1d8077002 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:45.087049 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7cb49-3a6b-413d-b6a1-4cc1d8077002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:45.087329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7cb49-3a6b-413d-b6a1-4cc1d8077002 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:45.088052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7cb49-3a6b-413d-b6a1-4cc1d8077002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:45.090080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7cb49-3a6b-413d-b6a1-4cc1d8077002 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:45.112978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d7cd5-5990-483c-9e1f-7ed78999cf66 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:45.116787 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1f6d7cd5-5990-483c-9e1f-7ed78999cf66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:45.131059 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1174/2354] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:45 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:12:45.132470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7cb49-3a6b-413d-b6a1-4cc1d8077002 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:45.213010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7cb49-3a6b-413d-b6a1-4cc1d8077002 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:45.213399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d7cd5-5990-483c-9e1f-7ed78999cf66 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:45.217875 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26b002-8330-486c-a760-070c2e6d8698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:45.218491 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26b002-8330-486c-a760-070c2e6d8698 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:45.218935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26b002-8330-486c-a760-070c2e6d8698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:45.219215 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26b002-8330-486c-a760-070c2e6d8698 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:45.219858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26b002-8330-486c-a760-070c2e6d8698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:45.221825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26b002-8330-486c-a760-070c2e6d8698 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:45.245871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1175/2355] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:45 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:45.249945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26b002-8330-486c-a760-070c2e6d8698 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:45.262188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26b002-8330-486c-a760-070c2e6d8698 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:45.266911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fc050-427c-4f94-99fd-d5d230003540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:45.267512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fc050-427c-4f94-99fd-d5d230003540 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:45.267792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fc050-427c-4f94-99fd-d5d230003540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:45.268068 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fc050-427c-4f94-99fd-d5d230003540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:45.268805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fc050-427c-4f94-99fd-d5d230003540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:45.271684 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fc050-427c-4f94-99fd-d5d230003540 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:45.283488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6758b-bd65-41b7-a151-cf105e492d72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:45.283750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1176/2356] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:12:45.284354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6758b-bd65-41b7-a151-cf105e492d72 service swift] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:45.284606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6758b-bd65-41b7-a151-cf105e492d72 service swift] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:45.284890 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6758b-bd65-41b7-a151-cf105e492d72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:45.287985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fc050-427c-4f94-99fd-d5d230003540 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:45.298552 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fc050-427c-4f94-99fd-d5d230003540 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:45.308351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87352144-208b-4177-be15-24563dafebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:45.309335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87352144-208b-4177-be15-24563dafebc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:45.309819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87352144-208b-4177-be15-24563dafebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:45.310286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87352144-208b-4177-be15-24563dafebc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:45.311597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87352144-208b-4177-be15-24563dafebc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:45.313847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87352144-208b-4177-be15-24563dafebc0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:45.329173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1177/2357] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:45.332329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87352144-208b-4177-be15-24563dafebc0 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:45.343301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87352144-208b-4177-be15-24563dafebc0 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:45.345208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:45.349031 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff9bf7-57f8-4ffd-a516-c3ebc2b4c000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:45.349867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff9bf7-57f8-4ffd-a516-c3ebc2b4c000 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:45.349867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff9bf7-57f8-4ffd-a516-c3ebc2b4c000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:45.350118 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff9bf7-57f8-4ffd-a516-c3ebc2b4c000 admin admin] PATH_INFO: `/v3/projects/e36f0594f3b44949aa0cc4c187e8d9c0/users/7d8a58270ed34308b1f3f1ced8786292/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:45.358847 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6758b-bd65-41b7-a151-cf105e492d72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:45.360430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6758b-bd65-41b7-a151-cf105e492d72 service swift] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:45.365187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff9bf7-57f8-4ffd-a516-c3ebc2b4c000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36f0594f3b44949aa0cc4c187e8d9c0, user_id=7d8a58270ed34308b1f3f1ced8786292, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:45.367819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff9bf7-57f8-4ffd-a516-c3ebc2b4c000 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:45.369688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1181/2358] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:12:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 16:12:45.385331 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1178/2359] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:45 2022] PUT /identity/v3/projects/e36f0594f3b44949aa0cc4c187e8d9c0/users/7d8a58270ed34308b1f3f1ced8786292/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:12:45.390196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b1eb7-d2ea-4145-b07b-49d24fc81430 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:45.390471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b1eb7-d2ea-4145-b07b-49d24fc81430 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:45.390794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b1eb7-d2ea-4145-b07b-49d24fc81430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:45.412326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-dc6b1eb7-d2ea-4145-b07b-49d24fc81430 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:45.413587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-dc6b1eb7-d2ea-4145-b07b-49d24fc81430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:45.486156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1182/2360] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:45.496660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff9bf7-57f8-4ffd-a516-c3ebc2b4c000 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:45.498378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-87ff9bf7-57f8-4ffd-a516-c3ebc2b4c000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:45.560480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff9bf7-57f8-4ffd-a516-c3ebc2b4c000 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:45.564307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233bd7a-691b-49af-8c38-7aa70b00009d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:45.565598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233bd7a-691b-49af-8c38-7aa70b00009d service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:45.565884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233bd7a-691b-49af-8c38-7aa70b00009d service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:45.566155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233bd7a-691b-49af-8c38-7aa70b00009d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:45.577836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233bd7a-691b-49af-8c38-7aa70b00009d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:45.579368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233bd7a-691b-49af-8c38-7aa70b00009d service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:45.584991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:45.592183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1179/2361] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:46.050704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf5bce-349e-43cd-b68b-cfd4c44b8ded None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:46.051256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf5bce-349e-43cd-b68b-cfd4c44b8ded None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:46.051256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf5bce-349e-43cd-b68b-cfd4c44b8ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:46.094823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-bccf5bce-349e-43cd-b68b-cfd4c44b8ded None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:46.096611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-bccf5bce-349e-43cd-b68b-cfd4c44b8ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:46.315893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1183/2362] 10.222.0.43 () {58 vars in 967 bytes} [Wed Sep 7 16:12:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:46.331844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233bd7a-691b-49af-8c38-7aa70b00009d service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:46.418651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233bd7a-691b-49af-8c38-7aa70b00009d service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:46.424036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b30e3-9409-4fe7-91e3-5cc52b96d1f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:46.424673 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b30e3-9409-4fe7-91e3-5cc52b96d1f0 service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:46.425148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b30e3-9409-4fe7-91e3-5cc52b96d1f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:46.425423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b30e3-9409-4fe7-91e3-5cc52b96d1f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:46.436132 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b30e3-9409-4fe7-91e3-5cc52b96d1f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:46.437799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b30e3-9409-4fe7-91e3-5cc52b96d1f0 service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:46.447896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1180/2363] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:12:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:12:46.790648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a490887-d511-4b7f-9560-3ac19469cc58 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:46.790930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a490887-d511-4b7f-9560-3ac19469cc58 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:46.791206 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a490887-d511-4b7f-9560-3ac19469cc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:46.819705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8a490887-d511-4b7f-9560-3ac19469cc58 None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:46.821214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8a490887-d511-4b7f-9560-3ac19469cc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:46.830198 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1184/2364] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:12:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:46.847289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b30e3-9409-4fe7-91e3-5cc52b96d1f0 service swift] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:46.862789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b30e3-9409-4fe7-91e3-5cc52b96d1f0 service swift] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:46.875587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce42ad-f337-47d4-8e39-5838acbe40d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:46.876237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce42ad-f337-47d4-8e39-5838acbe40d8 service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:46.876516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce42ad-f337-47d4-8e39-5838acbe40d8 service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:46.876822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce42ad-f337-47d4-8e39-5838acbe40d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:46.896756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce42ad-f337-47d4-8e39-5838acbe40d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:46.898346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce42ad-f337-47d4-8e39-5838acbe40d8 service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:46.919617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1181/2365] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:12:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:12:47.296023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3732d29-1a94-4c88-871d-6c970429cdff None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:47.297300 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3732d29-1a94-4c88-871d-6c970429cdff None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:47.297778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3732d29-1a94-4c88-871d-6c970429cdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:47.329293 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e3732d29-1a94-4c88-871d-6c970429cdff None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:47.330513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e3732d29-1a94-4c88-871d-6c970429cdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:47.364238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1185/2366] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:12:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:47.364903 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce42ad-f337-47d4-8e39-5838acbe40d8 service swift] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:47.398905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce42ad-f337-47d4-8e39-5838acbe40d8 service swift] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:47.416597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fcaf1-afad-4a2d-84d6-5d407e883306 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:47.417842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fcaf1-afad-4a2d-84d6-5d407e883306 service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:47.418222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fcaf1-afad-4a2d-84d6-5d407e883306 service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:47.418779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fcaf1-afad-4a2d-84d6-5d407e883306 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:47.438431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fcaf1-afad-4a2d-84d6-5d407e883306 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:47.440457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fcaf1-afad-4a2d-84d6-5d407e883306 service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:47.453572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1182/2367] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:12:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 16:12:47.571694 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0d602-3847-40d5-86d5-5c70f3a6f625 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:47.572261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0d602-3847-40d5-86d5-5c70f3a6f625 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:47.572543 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0d602-3847-40d5-86d5-5c70f3a6f625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:47.608828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-0fa0d602-3847-40d5-86d5-5c70f3a6f625 None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:47.611484 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0fa0d602-3847-40d5-86d5-5c70f3a6f625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:47.634717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1186/2368] 10.222.0.43 () {58 vars in 967 bytes} [Wed Sep 7 16:12:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:47.659744 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fcaf1-afad-4a2d-84d6-5d407e883306 service swift] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:47.699539 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fcaf1-afad-4a2d-84d6-5d407e883306 service swift] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:47.748738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a2c1-123f-4496-9733-9398efc670e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:47.749553 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a2c1-123f-4496-9733-9398efc670e9 service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:47.752733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a2c1-123f-4496-9733-9398efc670e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:47.752733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a2c1-123f-4496-9733-9398efc670e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:47.782246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916a2c1-123f-4496-9733-9398efc670e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:47.789952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916a2c1-123f-4496-9733-9398efc670e9 service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:47.824040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1183/2369] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:12:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:12:50.615346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693344-e3c1-4dff-9649-d913e5565436 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:50.617056 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693344-e3c1-4dff-9649-d913e5565436 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:50.617056 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693344-e3c1-4dff-9649-d913e5565436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:50.659896 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-78693344-e3c1-4dff-9649-d913e5565436 None None] MFA Rules not processed for user `48ad127896904c338c4fa44d61282e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:50.662756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-78693344-e3c1-4dff-9649-d913e5565436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:50.776010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1187/2370] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:51.096118 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a2c1-123f-4496-9733-9398efc670e9 service swift] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:51.100011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c916a2c1-123f-4496-9733-9398efc670e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:51.123446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a2c1-123f-4496-9733-9398efc670e9 service swift] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:51.129705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:51.130669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:51.131188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:51.131698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] PATH_INFO: `/v3/users/6a72a5894e3948ab90f41be20458c919` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:51.133559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a72a5894e3948ab90f41be20458c919)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:51.135889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:51.278281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a72a5894e3948ab90f41be20458c919'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:51.296527 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a72a5894e3948ab90f41be20458c919'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:51.297779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a72a5894e3948ab90f41be20458c919'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:51.299641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a72a5894e3948ab90f41be20458c919'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:51.334096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a72a5894e3948ab90f41be20458c919'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:51.365019 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1184/2371] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:12:51 2022] DELETE /identity/v3/users/6a72a5894e3948ab90f41be20458c919 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:51.367642 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c38717-16ad-4efb-9e6f-8baf99ae6fd7 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:51.369036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c38717-16ad-4efb-9e6f-8baf99ae6fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:51.369562 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c38717-16ad-4efb-9e6f-8baf99ae6fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:51.398299 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-93c38717-16ad-4efb-9e6f-8baf99ae6fd7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:51.400007 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-93c38717-16ad-4efb-9e6f-8baf99ae6fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:51.414904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:51.540454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1188/2372] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:51.553690 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:51.555199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:51.602306 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:51.679827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f67b8-f38b-4d46-97b3-fb65f510906c admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:51.699173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77006d0-2cf8-423d-94df-2792d7dda9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:51.700993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77006d0-2cf8-423d-94df-2792d7dda9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:51.701282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77006d0-2cf8-423d-94df-2792d7dda9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:51.701549 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77006d0-2cf8-423d-94df-2792d7dda9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:51.747776 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77006d0-2cf8-423d-94df-2792d7dda9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:51.761462 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77006d0-2cf8-423d-94df-2792d7dda9a1 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:51.798206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1185/2373] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:12:52.572156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c38717-16ad-4efb-9e6f-8baf99ae6fd7 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:52.574334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-93c38717-16ad-4efb-9e6f-8baf99ae6fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:52.594923 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c38717-16ad-4efb-9e6f-8baf99ae6fd7 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:52.610701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391f6d3-8b54-4187-90d5-2be13045a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:52.611659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391f6d3-8b54-4187-90d5-2be13045a13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:52.613368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391f6d3-8b54-4187-90d5-2be13045a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:52.614884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391f6d3-8b54-4187-90d5-2be13045a13d admin admin] PATH_INFO: `/v3/projects/64fceb79721647f09075f24fda514e19` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:52.616938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391f6d3-8b54-4187-90d5-2be13045a13d admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fceb79721647f09075f24fda514e19)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:52.619545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391f6d3-8b54-4187-90d5-2be13045a13d admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:52.782393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2391f6d3-8b54-4187-90d5-2be13045a13d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fceb79721647f09075f24fda514e19', 'request_id': 'req-2391f6d3-8b54-4187-90d5-2be13045a13d'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:52.796100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2391f6d3-8b54-4187-90d5-2be13045a13d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fceb79721647f09075f24fda514e19', 'request_id': 'req-2391f6d3-8b54-4187-90d5-2be13045a13d'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:52.812926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2391f6d3-8b54-4187-90d5-2be13045a13d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fceb79721647f09075f24fda514e19', 'request_id': 'req-2391f6d3-8b54-4187-90d5-2be13045a13d'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:52.833156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2391f6d3-8b54-4187-90d5-2be13045a13d admin admin] The token cache is being invalidate because project 64fceb79721647f09075f24fda514e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:12:52.833994 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2391f6d3-8b54-4187-90d5-2be13045a13d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:52.834987 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2391f6d3-8b54-4187-90d5-2be13045a13d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:12:52.838197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1189/2374] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:12:52 2022] DELETE /identity/v3/projects/64fceb79721647f09075f24fda514e19 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:52.843692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438487d-8f50-421c-b635-3bc8449071d3 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:52.844250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438487d-8f50-421c-b635-3bc8449071d3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:52.844250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438487d-8f50-421c-b635-3bc8449071d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:52.877097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-4438487d-8f50-421c-b635-3bc8449071d3 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:52.878495 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4438487d-8f50-421c-b635-3bc8449071d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:52.953723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1186/2375] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:52.961471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d909cf0-bf47-4e90-a2fb-075cf9353bc7 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:52.961955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d909cf0-bf47-4e90-a2fb-075cf9353bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:52.962382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d909cf0-bf47-4e90-a2fb-075cf9353bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:53.011917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-6d909cf0-bf47-4e90-a2fb-075cf9353bc7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:53.013401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6d909cf0-bf47-4e90-a2fb-075cf9353bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:53.029026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1190/2376] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:53.033452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438487d-8f50-421c-b635-3bc8449071d3 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:53.045263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438487d-8f50-421c-b635-3bc8449071d3 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:53.052178 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9924a02-cda9-4f75-b073-a9581345b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:53.052882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9924a02-cda9-4f75-b073-a9581345b346 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:53.053164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9924a02-cda9-4f75-b073-a9581345b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:53.053457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9924a02-cda9-4f75-b073-a9581345b346 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:53.054108 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9924a02-cda9-4f75-b073-a9581345b346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:12:53.054406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9924a02-cda9-4f75-b073-a9581345b346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:53.056149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9924a02-cda9-4f75-b073-a9581345b346 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:53.095165 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1187/2377] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:12:53.100270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d909cf0-bf47-4e90-a2fb-075cf9353bc7 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:53.134174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d909cf0-bf47-4e90-a2fb-075cf9353bc7 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:53.152163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842672d2-a809-4d45-9bf3-b7c735370627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:53.152825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842672d2-a809-4d45-9bf3-b7c735370627 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:53.153110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842672d2-a809-4d45-9bf3-b7c735370627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:53.153385 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842672d2-a809-4d45-9bf3-b7c735370627 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:53.154035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842672d2-a809-4d45-9bf3-b7c735370627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:53.155939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842672d2-a809-4d45-9bf3-b7c735370627 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:53.234210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1191/2378] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:53 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:53.237900 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9924a02-cda9-4f75-b073-a9581345b346 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:53.250447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9924a02-cda9-4f75-b073-a9581345b346 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:53.479994 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856db4-e729-4f50-bf14-4d9da5d650e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:53.482935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856db4-e729-4f50-bf14-4d9da5d650e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:53.484211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856db4-e729-4f50-bf14-4d9da5d650e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:53.485023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856db4-e729-4f50-bf14-4d9da5d650e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:53.485921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08856db4-e729-4f50-bf14-4d9da5d650e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:53.488644 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08856db4-e729-4f50-bf14-4d9da5d650e6 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:53.553729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1188/2379] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:53 2022] POST /identity/v3/users => generated 292 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:53.554654 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842672d2-a809-4d45-9bf3-b7c735370627 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:53.575983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842672d2-a809-4d45-9bf3-b7c735370627 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:53.580775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fe901-f0e9-44e2-b0a5-0ee4b1ea1157 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:53.581402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fe901-f0e9-44e2-b0a5-0ee4b1ea1157 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:53.581817 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad67fdc-e214-4b8b-b1b7-b11bac419f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:53.582302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fe901-f0e9-44e2-b0a5-0ee4b1ea1157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:53.583546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad67fdc-e214-4b8b-b1b7-b11bac419f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:53.583951 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad67fdc-e214-4b8b-b1b7-b11bac419f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:53.584506 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad67fdc-e214-4b8b-b1b7-b11bac419f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:53.585367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad67fdc-e214-4b8b-b1b7-b11bac419f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:53.587221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad67fdc-e214-4b8b-b1b7-b11bac419f55 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:53.605503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1192/2380] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:53.609314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad67fdc-e214-4b8b-b1b7-b11bac419f55 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:53.628174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad67fdc-e214-4b8b-b1b7-b11bac419f55 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:53.639385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-8c1fe901-f0e9-44e2-b0a5-0ee4b1ea1157 None None] MFA Rules not processed for user `7d8a58270ed34308b1f3f1ced8786292`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:53.641348 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8c1fe901-f0e9-44e2-b0a5-0ee4b1ea1157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:53.651460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4473b45-5c5c-4138-9bde-bd521bd78c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:53.654357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4473b45-5c5c-4138-9bde-bd521bd78c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:53.655438 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4473b45-5c5c-4138-9bde-bd521bd78c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:53.655943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4473b45-5c5c-4138-9bde-bd521bd78c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:53.657778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4473b45-5c5c-4138-9bde-bd521bd78c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:53.660897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4473b45-5c5c-4138-9bde-bd521bd78c22 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:53.681761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1193/2381] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:12:53.686612 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4473b45-5c5c-4138-9bde-bd521bd78c22 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:53.698962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:53.708828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4473b45-5c5c-4138-9bde-bd521bd78c22 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:53.717295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63fe1d-e665-4851-9169-0ff9b2f9917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:53.717987 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63fe1d-e665-4851-9169-0ff9b2f9917b admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:53.718279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63fe1d-e665-4851-9169-0ff9b2f9917b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:53.718564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63fe1d-e665-4851-9169-0ff9b2f9917b admin admin] PATH_INFO: `/v3/projects/b077df1ed970466da9e6c4e0b2386337/users/2d6bff93b3b7470f9dfb6d02858923da/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:53.815499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63fe1d-e665-4851-9169-0ff9b2f9917b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b077df1ed970466da9e6c4e0b2386337, user_id=2d6bff93b3b7470f9dfb6d02858923da, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:53.825046 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63fe1d-e665-4851-9169-0ff9b2f9917b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:53.869860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1194/2382] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:53 2022] PUT /identity/v3/projects/b077df1ed970466da9e6c4e0b2386337/users/2d6bff93b3b7470f9dfb6d02858923da/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:53.872924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b3030-e209-4529-bc2a-e199f167ecd2 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:53.873387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b3030-e209-4529-bc2a-e199f167ecd2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:53.873874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b3030-e209-4529-bc2a-e199f167ecd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:53.881918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1189/2383] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:53.887074 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fe901-f0e9-44e2-b0a5-0ee4b1ea1157 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:53.891133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8c1fe901-f0e9-44e2-b0a5-0ee4b1ea1157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:53.912447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-615b3030-e209-4529-bc2a-e199f167ecd2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:53.914439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-615b3030-e209-4529-bc2a-e199f167ecd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:53.925968 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fe901-f0e9-44e2-b0a5-0ee4b1ea1157 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:54.002167 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:54.082729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1195/2384] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:12:54.109783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b3030-e209-4529-bc2a-e199f167ecd2 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:54.114754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-615b3030-e209-4529-bc2a-e199f167ecd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:54.133603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c2e65-585e-4a8d-9907-9c6f2597058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:54.134460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c2e65-585e-4a8d-9907-9c6f2597058a admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:54.134460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c2e65-585e-4a8d-9907-9c6f2597058a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:54.134849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c2e65-585e-4a8d-9907-9c6f2597058a admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:54.135933 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c2e65-585e-4a8d-9907-9c6f2597058a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:54.137810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c2e65-585e-4a8d-9907-9c6f2597058a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:54.206490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1190/2385] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:12:53 2022] POST /identity/v3/projects => generated 373 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:54.211275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c2e65-585e-4a8d-9907-9c6f2597058a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:54.344914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b3030-e209-4529-bc2a-e199f167ecd2 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:54.424285 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c2e65-585e-4a8d-9907-9c6f2597058a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:54.429846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca94bb7-e11f-467b-9912-64e2db89de0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:54.430496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca94bb7-e11f-467b-9912-64e2db89de0c service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:54.430780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca94bb7-e11f-467b-9912-64e2db89de0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:54.431109 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca94bb7-e11f-467b-9912-64e2db89de0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:54.455846 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67eae-e3ba-41da-ae26-93f5fff961fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:54.456461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67eae-e3ba-41da-ae26-93f5fff961fc admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:54.456789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67eae-e3ba-41da-ae26-93f5fff961fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:54.457070 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67eae-e3ba-41da-ae26-93f5fff961fc admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:54.458383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd67eae-e3ba-41da-ae26-93f5fff961fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:54.460583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd67eae-e3ba-41da-ae26-93f5fff961fc admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:54.464933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca94bb7-e11f-467b-9912-64e2db89de0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:54.466711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca94bb7-e11f-467b-9912-64e2db89de0c service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:54.510691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1196/2386] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:54.537983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1191/2387] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:12:54 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:12:54.542189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca94bb7-e11f-467b-9912-64e2db89de0c service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:54.571271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca94bb7-e11f-467b-9912-64e2db89de0c service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:54.613112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b5f47-b0c9-4391-92da-1cbeb3581bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:54.614577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b5f47-b0c9-4391-92da-1cbeb3581bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:54.615126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b5f47-b0c9-4391-92da-1cbeb3581bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:54.615390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b5f47-b0c9-4391-92da-1cbeb3581bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:54.616908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b5f47-b0c9-4391-92da-1cbeb3581bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:54.618884 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b5f47-b0c9-4391-92da-1cbeb3581bd2 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:54.632240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1197/2388] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:54.636232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67eae-e3ba-41da-ae26-93f5fff961fc admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:54.650172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67eae-e3ba-41da-ae26-93f5fff961fc admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:54.662503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff232d5-fb23-4341-89df-1cd1d971a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:54.663363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff232d5-fb23-4341-89df-1cd1d971a7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:54.663836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff232d5-fb23-4341-89df-1cd1d971a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:54.664207 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff232d5-fb23-4341-89df-1cd1d971a7f5 admin admin] PATH_INFO: `/v3/projects/3239c6c1ebba4b6a879eed367bbf12ef/users/6b2ecd9020e145f499a0940a8babda43/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:54.713221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff232d5-fb23-4341-89df-1cd1d971a7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3239c6c1ebba4b6a879eed367bbf12ef, user_id=6b2ecd9020e145f499a0940a8babda43, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:54.720710 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff232d5-fb23-4341-89df-1cd1d971a7f5 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:54.767584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1192/2389] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:54 2022] PUT /identity/v3/projects/3239c6c1ebba4b6a879eed367bbf12ef/users/6b2ecd9020e145f499a0940a8babda43/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:54.772094 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b5f47-b0c9-4391-92da-1cbeb3581bd2 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:54.788554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b5f47-b0c9-4391-92da-1cbeb3581bd2 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:54.891795 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694a381-7bdb-473b-a3a0-67aefa98b1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:54.892531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694a381-7bdb-473b-a3a0-67aefa98b1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:54.892848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694a381-7bdb-473b-a3a0-67aefa98b1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:54.893124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694a381-7bdb-473b-a3a0-67aefa98b1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:54.893940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694a381-7bdb-473b-a3a0-67aefa98b1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:54.897442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694a381-7bdb-473b-a3a0-67aefa98b1f9 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:54.920394 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1198/2390] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:12:54.925188 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff232d5-fb23-4341-89df-1cd1d971a7f5 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:54.951612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff232d5-fb23-4341-89df-1cd1d971a7f5 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:54.966533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa707c9d-2e22-480f-abaa-22693310d680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:54.967238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa707c9d-2e22-480f-abaa-22693310d680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:54.967713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa707c9d-2e22-480f-abaa-22693310d680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:54.968191 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa707c9d-2e22-480f-abaa-22693310d680 admin admin] PATH_INFO: `/v3/projects/3239c6c1ebba4b6a879eed367bbf12ef/users/6b2ecd9020e145f499a0940a8babda43/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:54.974757 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa707c9d-2e22-480f-abaa-22693310d680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3239c6c1ebba4b6a879eed367bbf12ef, user_id=6b2ecd9020e145f499a0940a8babda43, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:54.980021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa707c9d-2e22-480f-abaa-22693310d680 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:55.025452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1193/2391] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:12:54 2022] PUT /identity/v3/projects/3239c6c1ebba4b6a879eed367bbf12ef/users/6b2ecd9020e145f499a0940a8babda43/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:12:56.528021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e70cd-6459-44bb-8899-5f5418d97f31 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:56.529092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e70cd-6459-44bb-8899-5f5418d97f31 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:56.529595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e70cd-6459-44bb-8899-5f5418d97f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:56.586395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:56.597773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b42e70cd-6459-44bb-8899-5f5418d97f31 None None] MFA Rules not processed for user `2d6bff93b3b7470f9dfb6d02858923da`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:56.599247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b42e70cd-6459-44bb-8899-5f5418d97f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:56.812971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1199/2392] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:12:56.821738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa707c9d-2e22-480f-abaa-22693310d680 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:12:56.823463 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-fa707c9d-2e22-480f-abaa-22693310d680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:56.842088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:56.976114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa707c9d-2e22-480f-abaa-22693310d680 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:12:56.981707 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0d107-31f5-4b1d-ac5d-6f743f7de805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:12:56.982333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0d107-31f5-4b1d-ac5d-6f743f7de805 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:56.982613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0d107-31f5-4b1d-ac5d-6f743f7de805 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:56.982883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0d107-31f5-4b1d-ac5d-6f743f7de805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:57.012964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0d107-31f5-4b1d-ac5d-6f743f7de805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:12:57.014620 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0d107-31f5-4b1d-ac5d-6f743f7de805 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:12:57.046821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1194/2393] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:12:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:12:59.185386 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e24ee-1bc7-4634-a37e-8de34a302692 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:12:59.186251 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e24ee-1bc7-4634-a37e-8de34a302692 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:12:59.186840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e24ee-1bc7-4634-a37e-8de34a302692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:12:59.234084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-692e24ee-1bc7-4634-a37e-8de34a302692 None None] MFA Rules not processed for user `2d6bff93b3b7470f9dfb6d02858923da`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:12:59.235412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-692e24ee-1bc7-4634-a37e-8de34a302692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:12:59.257843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1200/2394] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:12:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:04.951007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97f692-4b65-4ea7-919b-6cef87ffb367 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:04.951532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97f692-4b65-4ea7-919b-6cef87ffb367 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:04.951716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97f692-4b65-4ea7-919b-6cef87ffb367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:05.006736 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-ce97f692-4b65-4ea7-919b-6cef87ffb367 None None] MFA Rules not processed for user `1beb3cf542bf4cc1802f90ad14a29017`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:05.011981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ce97f692-4b65-4ea7-919b-6cef87ffb367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:05.147534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1195/2395] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:13:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:08.536493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d2e8b-dc31-4ccf-bfeb-a6847e846c71 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:08.549171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d2e8b-dc31-4ccf-bfeb-a6847e846c71 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:08.552274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d2e8b-dc31-4ccf-bfeb-a6847e846c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:08.632045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-a34d2e8b-dc31-4ccf-bfeb-a6847e846c71 None None] MFA Rules not processed for user `6b2ecd9020e145f499a0940a8babda43`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:08.633633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-a34d2e8b-dc31-4ccf-bfeb-a6847e846c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:08.788665 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1201/2396] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:13:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:08.807660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97f692-4b65-4ea7-919b-6cef87ffb367 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:08.809709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ce97f692-4b65-4ea7-919b-6cef87ffb367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:08.941065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97f692-4b65-4ea7-919b-6cef87ffb367 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:08.949570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de21e59-440a-423c-9dfc-c8e6f8e07d77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:08.950303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21e59-440a-423c-9dfc-c8e6f8e07d77 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:08.950654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21e59-440a-423c-9dfc-c8e6f8e07d77 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:08.950998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21e59-440a-423c-9dfc-c8e6f8e07d77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:09.022751 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:13:09.055753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de21e59-440a-423c-9dfc-c8e6f8e07d77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:09.058340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de21e59-440a-423c-9dfc-c8e6f8e07d77 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:09.071530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1196/2397] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:13:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:13:12.722574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90089e17-a639-44b7-ac56-2e9bb0120d90 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:12.723292 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90089e17-a639-44b7-ac56-2e9bb0120d90 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:12.723475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90089e17-a639-44b7-ac56-2e9bb0120d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:12.825814 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-90089e17-a639-44b7-ac56-2e9bb0120d90 None None] MFA Rules not processed for user `7d8a58270ed34308b1f3f1ced8786292`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:12.830648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-90089e17-a639-44b7-ac56-2e9bb0120d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:12.865959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1202/2398] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:13:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:19.076607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:13:22.293847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691882-77d1-48af-8ceb-2e444f638c6f None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:22.294724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691882-77d1-48af-8ceb-2e444f638c6f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:22.294724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691882-77d1-48af-8ceb-2e444f638c6f None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:22.296609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1197/2399] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:13:22.310331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4ac5d-f982-442c-a5c7-bb75b59395ec None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:22.311107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4ac5d-f982-442c-a5c7-bb75b59395ec None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:22.311107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4ac5d-f982-442c-a5c7-bb75b59395ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:22.350798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b6a4ac5d-f982-442c-a5c7-bb75b59395ec None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:22.352373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b6a4ac5d-f982-442c-a5c7-bb75b59395ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:22.364962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1203/2400] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:13:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:13:27.276502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6691882-77d1-48af-8ceb-2e444f638c6f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:27.278282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c6691882-77d1-48af-8ceb-2e444f638c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:27.339351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6691882-77d1-48af-8ceb-2e444f638c6f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:27.343319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad07ecc-fb28-49de-9c65-60a60d369c2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc71e3a41ac644ff8a908b766495b5f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:27.343943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad07ecc-fb28-49de-9c65-60a60d369c2e service glance] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:27.344219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad07ecc-fb28-49de-9c65-60a60d369c2e service glance] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:27.344488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad07ecc-fb28-49de-9c65-60a60d369c2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:27.355662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad07ecc-fb28-49de-9c65-60a60d369c2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:27.357121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad07ecc-fb28-49de-9c65-60a60d369c2e service glance] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:27.367660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1198/2401] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:13:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:13:27.519208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20ae4-19b8-486f-90d7-0a942faeda52 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:27.519725 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20ae4-19b8-486f-90d7-0a942faeda52 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:27.519725 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20ae4-19b8-486f-90d7-0a942faeda52 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:27.522387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1204/2402] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:13:27.529018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16087f9-51f0-42b7-9f0d-a1cb55b8b5a8 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:27.529638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16087f9-51f0-42b7-9f0d-a1cb55b8b5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:27.530225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16087f9-51f0-42b7-9f0d-a1cb55b8b5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:27.554856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-a16087f9-51f0-42b7-9f0d-a1cb55b8b5a8 None None] MFA Rules not processed for user `e91f048f8885448383f4a361b07dac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:27.556107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a16087f9-51f0-42b7-9f0d-a1cb55b8b5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:27.621194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1199/2403] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:27.633680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c20ae4-19b8-486f-90d7-0a942faeda52 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:27.639126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=71 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:13:27.645236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c20ae4-19b8-486f-90d7-0a942faeda52 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:27.648948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3fd8a-0e15-4408-bfc9-ac5480958e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:27.649544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3fd8a-0e15-4408-bfc9-ac5480958e3b service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:27.649819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3fd8a-0e15-4408-bfc9-ac5480958e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:27.650086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3fd8a-0e15-4408-bfc9-ac5480958e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:27.659019 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3fd8a-0e15-4408-bfc9-ac5480958e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:27.660476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3fd8a-0e15-4408-bfc9-ac5480958e3b service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:27.668969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1205/2404] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:13:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:13:27.787389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e8068-8b34-47de-83d3-7dffac5608e2 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:27.787678 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e8068-8b34-47de-83d3-7dffac5608e2 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:27.787957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e8068-8b34-47de-83d3-7dffac5608e2 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:27.789324 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1200/2405] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:13:27.795274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a2d6-990f-4869-a20f-2e7226357919 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:27.795585 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a2d6-990f-4869-a20f-2e7226357919 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:27.795882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a2d6-990f-4869-a20f-2e7226357919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:27.816597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c2e0a2d6-990f-4869-a20f-2e7226357919 None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:27.818889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c2e0a2d6-990f-4869-a20f-2e7226357919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:27.828535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1206/2406] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:27.839374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e8068-8b34-47de-83d3-7dffac5608e2 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:27.841179 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f68e8068-8b34-47de-83d3-7dffac5608e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:27.854962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e8068-8b34-47de-83d3-7dffac5608e2 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:27.858611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c3b82-337f-49af-9ec9-85379def4b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:27.859201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c3b82-337f-49af-9ec9-85379def4b73 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:27.859477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c3b82-337f-49af-9ec9-85379def4b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:27.859746 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c3b82-337f-49af-9ec9-85379def4b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:27.871207 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c3b82-337f-49af-9ec9-85379def4b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:27.872739 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c3b82-337f-49af-9ec9-85379def4b73 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:27.887522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1201/2407] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:13:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:13:28.460197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c770b-22eb-45cc-ac66-651a9232f05e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:28.460514 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c770b-22eb-45cc-ac66-651a9232f05e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:28.460819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c770b-22eb-45cc-ac66-651a9232f05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:28.481736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-d44c770b-22eb-45cc-ac66-651a9232f05e None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:28.483061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d44c770b-22eb-45cc-ac66-651a9232f05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:28.559338 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1207/2408] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:13:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:28.574182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c3b82-337f-49af-9ec9-85379def4b73 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:28.575575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0a1c3b82-337f-49af-9ec9-85379def4b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:28.660892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c3b82-337f-49af-9ec9-85379def4b73 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:28.666033 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b65de-1cc6-4943-841e-079db67f4996 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:28.666637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b65de-1cc6-4943-841e-079db67f4996 service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:28.666918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b65de-1cc6-4943-841e-079db67f4996 service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:28.667194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b65de-1cc6-4943-841e-079db67f4996 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:28.675431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b65de-1cc6-4943-841e-079db67f4996 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:28.677558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b65de-1cc6-4943-841e-079db67f4996 service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:28.686402 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1202/2409] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:13:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:13:30.853080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a6a4f-bb05-4d2d-a830-5d7eaaedf083 None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:30.853576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a6a4f-bb05-4d2d-a830-5d7eaaedf083 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:30.853671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a6a4f-bb05-4d2d-a830-5d7eaaedf083 None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:30.854949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1208/2410] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:13:30.860117 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e693999-83ed-4c71-9fc0-f175b7b3ec11 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:30.861024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e693999-83ed-4c71-9fc0-f175b7b3ec11 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:30.861479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e693999-83ed-4c71-9fc0-f175b7b3ec11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:30.883078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-2e693999-83ed-4c71-9fc0-f175b7b3ec11 None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:30.884560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2e693999-83ed-4c71-9fc0-f175b7b3ec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:30.895718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1203/2411] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:13:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:30.917856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a6a4f-bb05-4d2d-a830-5d7eaaedf083 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:30.920014 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-512a6a4f-bb05-4d2d-a830-5d7eaaedf083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:30.942425 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a6a4f-bb05-4d2d-a830-5d7eaaedf083 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:30.950044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ef1dc-267e-4e25-8cfe-037caa436ab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:30.952330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ef1dc-267e-4e25-8cfe-037caa436ab1 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:30.952977 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ef1dc-267e-4e25-8cfe-037caa436ab1 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:30.953930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ef1dc-267e-4e25-8cfe-037caa436ab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:30.966119 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ef1dc-267e-4e25-8cfe-037caa436ab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:30.967714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ef1dc-267e-4e25-8cfe-037caa436ab1 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:30.985612 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1209/2412] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:13:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:13:35.624040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a70ffc-def6-46de-a352-19d103de4cfe None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:35.624562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a70ffc-def6-46de-a352-19d103de4cfe None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:35.624562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a70ffc-def6-46de-a352-19d103de4cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:35.643677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-62a70ffc-def6-46de-a352-19d103de4cfe None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:35.644977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-62a70ffc-def6-46de-a352-19d103de4cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:35.651997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1204/2413] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:35.664978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ef1dc-267e-4e25-8cfe-037caa436ab1 service nova] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:35.676742 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ef1dc-267e-4e25-8cfe-037caa436ab1 service nova] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:35.683707 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeab65e-f602-4619-9e7c-89e4982e96d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:35.684553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeab65e-f602-4619-9e7c-89e4982e96d4 service swift] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:35.685037 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeab65e-f602-4619-9e7c-89e4982e96d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:35.685401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeab65e-f602-4619-9e7c-89e4982e96d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:35.696301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeab65e-f602-4619-9e7c-89e4982e96d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:35.697925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeab65e-f602-4619-9e7c-89e4982e96d4 service swift] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:35.706210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1210/2414] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:13:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 16:13:41.470575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a70ffc-def6-46de-a352-19d103de4cfe None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:41.473335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-62a70ffc-def6-46de-a352-19d103de4cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:41.533079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:13:41.698078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a70ffc-def6-46de-a352-19d103de4cfe None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:41.705583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a5632-ec0c-4e11-b35c-29d7cbfdf3f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b918da0f83754f3887de1cfa2e4df028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:41.706615 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a5632-ec0c-4e11-b35c-29d7cbfdf3f8 service placement] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:41.708493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a5632-ec0c-4e11-b35c-29d7cbfdf3f8 service placement] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:41.709153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a5632-ec0c-4e11-b35c-29d7cbfdf3f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:41.714818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ae6a5632-ec0c-4e11-b35c-29d7cbfdf3f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:41.742564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a5632-ec0c-4e11-b35c-29d7cbfdf3f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:41.744515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a5632-ec0c-4e11-b35c-29d7cbfdf3f8 service placement] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:41.769285 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1205/2415] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:13:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:13:45.702768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=45 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:13:51.300973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faadb96-8247-4cc4-ae2b-4c0c8329d7e5 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:51.301722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faadb96-8247-4cc4-ae2b-4c0c8329d7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:51.301967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faadb96-8247-4cc4-ae2b-4c0c8329d7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:51.350635 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-5faadb96-8247-4cc4-ae2b-4c0c8329d7e5 None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:51.352819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-5faadb96-8247-4cc4-ae2b-4c0c8329d7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:51.368218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1211/2416] 10.222.0.43 () {58 vars in 967 bytes} [Wed Sep 7 16:13:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:51.383329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a5632-ec0c-4e11-b35c-29d7cbfdf3f8 service placement] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:51.409210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a5632-ec0c-4e11-b35c-29d7cbfdf3f8 service placement] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:51.432298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d06d2-1630-48cd-b8e5-02525104238d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:51.433278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d06d2-1630-48cd-b8e5-02525104238d service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:51.433651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d06d2-1630-48cd-b8e5-02525104238d service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:51.433855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d06d2-1630-48cd-b8e5-02525104238d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:51.445372 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d06d2-1630-48cd-b8e5-02525104238d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:51.447447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d06d2-1630-48cd-b8e5-02525104238d service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:51.460263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1206/2417] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:13:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:13:53.758890 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf3dae-2283-4b2e-ae19-949fb62e91ad None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:53.759350 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf3dae-2283-4b2e-ae19-949fb62e91ad None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:53.759445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf3dae-2283-4b2e-ae19-949fb62e91ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:53.782126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e4bf3dae-2283-4b2e-ae19-949fb62e91ad None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:53.782897 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e4bf3dae-2283-4b2e-ae19-949fb62e91ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:53.863593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1212/2418] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Sep 7 16:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:54.003359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d06d2-1630-48cd-b8e5-02525104238d service swift] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:54.017044 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d06d2-1630-48cd-b8e5-02525104238d service swift] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:54.024310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1374d-3123-4f08-8ce3-0a63991fe25b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:54.025034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1374d-3123-4f08-8ce3-0a63991fe25b service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:54.026266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1374d-3123-4f08-8ce3-0a63991fe25b service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:54.026608 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1374d-3123-4f08-8ce3-0a63991fe25b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:54.039535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1374d-3123-4f08-8ce3-0a63991fe25b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:54.041361 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1374d-3123-4f08-8ce3-0a63991fe25b service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:54.042260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf3dae-2283-4b2e-ae19-949fb62e91ad None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:54.043851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e4bf3dae-2283-4b2e-ae19-949fb62e91ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:54.055992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1207/2419] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:13:54.065798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf3dae-2283-4b2e-ae19-949fb62e91ad None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:54.071885 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df0087-3163-4755-b0b9-dd3b03e67890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:54.072556 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df0087-3163-4755-b0b9-dd3b03e67890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:54.072866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df0087-3163-4755-b0b9-dd3b03e67890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:54.073146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df0087-3163-4755-b0b9-dd3b03e67890 admin admin] PATH_INFO: `/v3/users/48ad127896904c338c4fa44d61282e2c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:54.074434 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df0087-3163-4755-b0b9-dd3b03e67890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ad127896904c338c4fa44d61282e2c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:54.076383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df0087-3163-4755-b0b9-dd3b03e67890 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:54.142362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a6df0087-3163-4755-b0b9-dd3b03e67890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ad127896904c338c4fa44d61282e2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:13:54.151682 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a6df0087-3163-4755-b0b9-dd3b03e67890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ad127896904c338c4fa44d61282e2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:13:54.165810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a6df0087-3163-4755-b0b9-dd3b03e67890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ad127896904c338c4fa44d61282e2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:13:54.166481 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a6df0087-3163-4755-b0b9-dd3b03e67890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ad127896904c338c4fa44d61282e2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:13:54.167083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a6df0087-3163-4755-b0b9-dd3b03e67890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ad127896904c338c4fa44d61282e2c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:13:54.179420 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1213/2420] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:13:54 2022] DELETE /identity/v3/users/48ad127896904c338c4fa44d61282e2c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:13:54.352887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1374d-3123-4f08-8ce3-0a63991fe25b service nova] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:54.362924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1374d-3123-4f08-8ce3-0a63991fe25b service nova] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:54.437522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:54.438162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:54.438445 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:54.438719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4 admin admin] PATH_INFO: `/v3/projects/42cfcd19a741461ea4e9fe993a3a2396` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:54.439852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42cfcd19a741461ea4e9fe993a3a2396)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:54.441987 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:54.493622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42cfcd19a741461ea4e9fe993a3a2396', 'request_id': 'req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:13:54.501465 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42cfcd19a741461ea4e9fe993a3a2396', 'request_id': 'req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:13:54.508281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42cfcd19a741461ea4e9fe993a3a2396', 'request_id': 'req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:13:54.519934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4 admin admin] The token cache is being invalidate because project 42cfcd19a741461ea4e9fe993a3a2396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:13:54.520215 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:13:54.520970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-67afdbaf-8ab0-49f4-a740-d03f48e0dfa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:13:54.522452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1208/2421] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:13:54 2022] DELETE /identity/v3/projects/42cfcd19a741461ea4e9fe993a3a2396 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:13:54.527214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b36e2-5c6d-4a47-adaf-2c4507077b8d None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:54.527500 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b36e2-5c6d-4a47-adaf-2c4507077b8d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:54.527777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b36e2-5c6d-4a47-adaf-2c4507077b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:54.548082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-327b36e2-5c6d-4a47-adaf-2c4507077b8d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:54.549476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-327b36e2-5c6d-4a47-adaf-2c4507077b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:54.610424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1214/2422] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:54.618770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467bef5-af4a-4047-8a6e-c87dff19ffcb None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:54.619061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467bef5-af4a-4047-8a6e-c87dff19ffcb None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:54.619369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467bef5-af4a-4047-8a6e-c87dff19ffcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:54.638898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-4467bef5-af4a-4047-8a6e-c87dff19ffcb None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:54.640111 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4467bef5-af4a-4047-8a6e-c87dff19ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:54.648614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1209/2423] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:54.652779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b36e2-5c6d-4a47-adaf-2c4507077b8d None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:54.663310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b36e2-5c6d-4a47-adaf-2c4507077b8d None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:54.667847 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1678f1-5798-4e1e-a74e-9f53fa4b28ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:54.668469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1678f1-5798-4e1e-a74e-9f53fa4b28ec admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:54.668786 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1678f1-5798-4e1e-a74e-9f53fa4b28ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:54.669062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1678f1-5798-4e1e-a74e-9f53fa4b28ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:54.669704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1678f1-5798-4e1e-a74e-9f53fa4b28ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:13:54.670006 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1678f1-5798-4e1e-a74e-9f53fa4b28ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:54.671602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1678f1-5798-4e1e-a74e-9f53fa4b28ec admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:54.673085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:13:54.686074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1215/2424] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:13:54.690531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467bef5-af4a-4047-8a6e-c87dff19ffcb None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:54.694939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:13:54.701793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467bef5-af4a-4047-8a6e-c87dff19ffcb None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:54.710305 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf3163-fe9d-4fac-90a3-7822a9f81c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:54.711338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf3163-fe9d-4fac-90a3-7822a9f81c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:54.711792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf3163-fe9d-4fac-90a3-7822a9f81c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:54.712160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf3163-fe9d-4fac-90a3-7822a9f81c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:54.712857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf3163-fe9d-4fac-90a3-7822a9f81c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:54.714901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf3163-fe9d-4fac-90a3-7822a9f81c04 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:54.744465 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1210/2425] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:13:54 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:13:54.748501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1678f1-5798-4e1e-a74e-9f53fa4b28ec admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:54.758808 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1678f1-5798-4e1e-a74e-9f53fa4b28ec admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:54.815519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546566a5-b0a4-4be6-8e62-ede1c6e7753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:54.816259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546566a5-b0a4-4be6-8e62-ede1c6e7753e admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:54.816442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546566a5-b0a4-4be6-8e62-ede1c6e7753e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:54.816676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546566a5-b0a4-4be6-8e62-ede1c6e7753e admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:54.817315 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546566a5-b0a4-4be6-8e62-ede1c6e7753e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:54.819240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546566a5-b0a4-4be6-8e62-ede1c6e7753e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:54.841086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1216/2426] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:13:54 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:13:54.845347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf3163-fe9d-4fac-90a3-7822a9f81c04 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:54.856368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf3163-fe9d-4fac-90a3-7822a9f81c04 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:54.861027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad123ab-52a1-45c3-aea5-689581da2bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:54.861621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad123ab-52a1-45c3-aea5-689581da2bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:54.861903 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad123ab-52a1-45c3-aea5-689581da2bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:54.862179 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad123ab-52a1-45c3-aea5-689581da2bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:54.862821 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad123ab-52a1-45c3-aea5-689581da2bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:54.864530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad123ab-52a1-45c3-aea5-689581da2bcc admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:54.874357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1211/2427] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:13:54.878623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546566a5-b0a4-4be6-8e62-ede1c6e7753e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:54.889383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546566a5-b0a4-4be6-8e62-ede1c6e7753e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:54.894103 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d657e-99bc-4b72-a086-c3713d9ef2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:54.895778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d657e-99bc-4b72-a086-c3713d9ef2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:54.896116 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d657e-99bc-4b72-a086-c3713d9ef2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:54.896449 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d657e-99bc-4b72-a086-c3713d9ef2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:54.897221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d657e-99bc-4b72-a086-c3713d9ef2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:54.899003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d657e-99bc-4b72-a086-c3713d9ef2d2 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:54.911356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1217/2428] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:13:54.915541 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad123ab-52a1-45c3-aea5-689581da2bcc admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:54.925471 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad123ab-52a1-45c3-aea5-689581da2bcc admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:54.930719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c703f-3985-4912-9f8f-cb914e33b153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:54.931362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c703f-3985-4912-9f8f-cb914e33b153 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:54.931642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c703f-3985-4912-9f8f-cb914e33b153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:54.931920 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c703f-3985-4912-9f8f-cb914e33b153 admin admin] PATH_INFO: `/v3/projects/4054e6c61d0349a0b7ac61c62c7c0543/users/d69faa8372924bf3adc6bac93db89170/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:54.947049 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c703f-3985-4912-9f8f-cb914e33b153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4054e6c61d0349a0b7ac61c62c7c0543, user_id=d69faa8372924bf3adc6bac93db89170, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:54.949732 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c703f-3985-4912-9f8f-cb914e33b153 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:54.966374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1212/2429] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:13:54 2022] PUT /identity/v3/projects/4054e6c61d0349a0b7ac61c62c7c0543/users/d69faa8372924bf3adc6bac93db89170/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:13:54.977330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac510d2-48e3-43b5-839e-5b53f97d8552 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:54.977554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac510d2-48e3-43b5-839e-5b53f97d8552 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:54.977831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac510d2-48e3-43b5-839e-5b53f97d8552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:55.009747 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-dac510d2-48e3-43b5-839e-5b53f97d8552 None None] MFA Rules not processed for user `d69faa8372924bf3adc6bac93db89170`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:55.010875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-dac510d2-48e3-43b5-839e-5b53f97d8552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:55.088172 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1218/2430] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:13:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:55.099611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c703f-3985-4912-9f8f-cb914e33b153 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:55.101354 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-cc3c703f-3985-4912-9f8f-cb914e33b153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:55.164060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c703f-3985-4912-9f8f-cb914e33b153 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:55.169053 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf83cd-e4c1-4e66-8d5e-589703d88e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:55.169940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf83cd-e4c1-4e66-8d5e-589703d88e6b service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:55.170388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf83cd-e4c1-4e66-8d5e-589703d88e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:55.170668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf83cd-e4c1-4e66-8d5e-589703d88e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:55.180253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf83cd-e4c1-4e66-8d5e-589703d88e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:55.181708 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf83cd-e4c1-4e66-8d5e-589703d88e6b service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:55.192558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1213/2431] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:13:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:13:57.865984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27055be-5bbd-445a-b7ac-1f0c8753d5da None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:57.866807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27055be-5bbd-445a-b7ac-1f0c8753d5da None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:57.867299 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27055be-5bbd-445a-b7ac-1f0c8753d5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:57.897412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b27055be-5bbd-445a-b7ac-1f0c8753d5da None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:57.899206 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b27055be-5bbd-445a-b7ac-1f0c8753d5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:57.978041 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1219/2432] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Sep 7 16:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:57.992723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf83cd-e4c1-4e66-8d5e-589703d88e6b service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:57.994315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7edf83cd-e4c1-4e66-8d5e-589703d88e6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:58.076300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf83cd-e4c1-4e66-8d5e-589703d88e6b service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:58.083238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680e302-b119-4c20-a1c0-7b94d05e0e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:58.084284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680e302-b119-4c20-a1c0-7b94d05e0e50 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:58.084773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680e302-b119-4c20-a1c0-7b94d05e0e50 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:58.085205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680e302-b119-4c20-a1c0-7b94d05e0e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:58.096611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680e302-b119-4c20-a1c0-7b94d05e0e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:58.103342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680e302-b119-4c20-a1c0-7b94d05e0e50 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:58.111553 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1214/2433] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:13:58.171295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d77f1-62d6-4041-acc3-14f7773c6380 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:58.171957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d77f1-62d6-4041-acc3-14f7773c6380 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:58.172428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d77f1-62d6-4041-acc3-14f7773c6380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:58.182154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:13:58.198315 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-ec6d77f1-62d6-4041-acc3-14f7773c6380 None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:13:58.199713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ec6d77f1-62d6-4041-acc3-14f7773c6380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:58.261572 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1220/2434] 10.222.0.43 () {58 vars in 967 bytes} [Wed Sep 7 16:13:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:13:58.276002 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680e302-b119-4c20-a1c0-7b94d05e0e50 service nova] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:13:58.277501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b680e302-b119-4c20-a1c0-7b94d05e0e50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:13:58.319444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:13:58.362409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680e302-b119-4c20-a1c0-7b94d05e0e50 service nova] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:13:58.374333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dc209-bb15-4686-a01d-5c263c8858e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:13:58.376119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dc209-bb15-4686-a01d-5c263c8858e3 service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:13:58.376793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dc209-bb15-4686-a01d-5c263c8858e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:13:58.377160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dc209-bb15-4686-a01d-5c263c8858e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:13:58.393543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dc209-bb15-4686-a01d-5c263c8858e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:13:58.396864 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dc209-bb15-4686-a01d-5c263c8858e3 service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:13:58.412813 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1215/2435] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:13:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:14:01.824366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d77f1-62d6-4041-acc3-14f7773c6380 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:01.825838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ec6d77f1-62d6-4041-acc3-14f7773c6380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:01.891593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d77f1-62d6-4041-acc3-14f7773c6380 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:01.893863 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a43fda-543c-4661-bf2e-de5c5ee289f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:01.894589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a43fda-543c-4661-bf2e-de5c5ee289f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:01.894900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a43fda-543c-4661-bf2e-de5c5ee289f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:01.895133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a43fda-543c-4661-bf2e-de5c5ee289f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:01.897028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f3a43fda-543c-4661-bf2e-de5c5ee289f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:01.986354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a43fda-543c-4661-bf2e-de5c5ee289f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:01.988749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a43fda-543c-4661-bf2e-de5c5ee289f5 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:02.004564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1221/2436] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:14:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:14:03.273551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8268f8-5b43-4e56-9bf4-94289c584e1c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:03.274084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8268f8-5b43-4e56-9bf4-94289c584e1c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:03.274235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8268f8-5b43-4e56-9bf4-94289c584e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:03.296745 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-2f8268f8-5b43-4e56-9bf4-94289c584e1c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:03.298147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2f8268f8-5b43-4e56-9bf4-94289c584e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:03.306941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1216/2437] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Sep 7 16:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:14:03.327307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a43fda-543c-4661-bf2e-de5c5ee289f5 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:03.342648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a43fda-543c-4661-bf2e-de5c5ee289f5 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:03.350114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0a6cc-2fc7-4b2c-b83b-0b15abc3a034 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:03.350114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a6cc-2fc7-4b2c-b83b-0b15abc3a034 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:03.350114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a6cc-2fc7-4b2c-b83b-0b15abc3a034 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:03.350906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a6cc-2fc7-4b2c-b83b-0b15abc3a034 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:03.361869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0a6cc-2fc7-4b2c-b83b-0b15abc3a034 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:03.363764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0a6cc-2fc7-4b2c-b83b-0b15abc3a034 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:03.375488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1222/2438] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:14:05.684838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8268f8-5b43-4e56-9bf4-94289c584e1c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:05.696885 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8268f8-5b43-4e56-9bf4-94289c584e1c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:05.703780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:05.704496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:05.704895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:05.705221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] PATH_INFO: `/v3/users/d69faa8372924bf3adc6bac93db89170` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:05.706490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69faa8372924bf3adc6bac93db89170)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:05.708756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:05.762267 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69faa8372924bf3adc6bac93db89170'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:05.770102 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69faa8372924bf3adc6bac93db89170'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:05.770766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69faa8372924bf3adc6bac93db89170'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:05.771404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69faa8372924bf3adc6bac93db89170'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:05.784374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69faa8372924bf3adc6bac93db89170'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:05.797426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1217/2439] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:14:05 2022] DELETE /identity/v3/users/d69faa8372924bf3adc6bac93db89170 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:14:05.802871 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4364386-4720-4925-8780-9b7421212869 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:05.803364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4364386-4720-4925-8780-9b7421212869 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:05.803459 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4364386-4720-4925-8780-9b7421212869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:05.822549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c4364386-4720-4925-8780-9b7421212869 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:05.823794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c4364386-4720-4925-8780-9b7421212869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:05.868830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:05.890422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1223/2440] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:14:05.901778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:05.903262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:05.965073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07af8a-7b71-463e-b779-caa1e0194ade admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:05.969196 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e0e30-7caa-480e-8d76-e52d3c9569a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:05.969818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e0e30-7caa-480e-8d76-e52d3c9569a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:05.970100 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e0e30-7caa-480e-8d76-e52d3c9569a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:05.970375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e0e30-7caa-480e-8d76-e52d3c9569a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:05.985372 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e0e30-7caa-480e-8d76-e52d3c9569a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:05.986815 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e0e30-7caa-480e-8d76-e52d3c9569a4 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:05.997828 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1218/2441] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:14:06.328310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f785e-80a2-4767-93e7-6d3cc6ebb9fa None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:06.328595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f785e-80a2-4767-93e7-6d3cc6ebb9fa None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:06.328918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f785e-80a2-4767-93e7-6d3cc6ebb9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:06.350067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-0f2f785e-80a2-4767-93e7-6d3cc6ebb9fa None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:06.351307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0f2f785e-80a2-4767-93e7-6d3cc6ebb9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:06.361858 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1224/2442] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Sep 7 16:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:14:06.382593 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e0e30-7caa-480e-8d76-e52d3c9569a4 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:06.383857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f785e-80a2-4767-93e7-6d3cc6ebb9fa None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:06.384230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8e1e0e30-7caa-480e-8d76-e52d3c9569a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:06.385596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0f2f785e-80a2-4767-93e7-6d3cc6ebb9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:06.399035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e0e30-7caa-480e-8d76-e52d3c9569a4 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:06.404342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53ab68-70e8-4e2b-a47e-3de784242f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:06.405038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53ab68-70e8-4e2b-a47e-3de784242f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:06.405314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53ab68-70e8-4e2b-a47e-3de784242f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:06.406167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53ab68-70e8-4e2b-a47e-3de784242f15 admin admin] PATH_INFO: `/v3/projects/4054e6c61d0349a0b7ac61c62c7c0543` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:06.407024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53ab68-70e8-4e2b-a47e-3de784242f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4054e6c61d0349a0b7ac61c62c7c0543)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:06.408972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53ab68-70e8-4e2b-a47e-3de784242f15 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:06.443648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:06.462985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-dd53ab68-70e8-4e2b-a47e-3de784242f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4054e6c61d0349a0b7ac61c62c7c0543', 'request_id': 'req-dd53ab68-70e8-4e2b-a47e-3de784242f15'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:06.471477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-dd53ab68-70e8-4e2b-a47e-3de784242f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4054e6c61d0349a0b7ac61c62c7c0543', 'request_id': 'req-dd53ab68-70e8-4e2b-a47e-3de784242f15'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:06.473441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f785e-80a2-4767-93e7-6d3cc6ebb9fa None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:06.479538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-dd53ab68-70e8-4e2b-a47e-3de784242f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4054e6c61d0349a0b7ac61c62c7c0543', 'request_id': 'req-dd53ab68-70e8-4e2b-a47e-3de784242f15'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:06.492457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-dd53ab68-70e8-4e2b-a47e-3de784242f15 admin admin] The token cache is being invalidate because project 4054e6c61d0349a0b7ac61c62c7c0543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:14:06.492780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-dd53ab68-70e8-4e2b-a47e-3de784242f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:06.493455 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-dd53ab68-70e8-4e2b-a47e-3de784242f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:06.495070 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1219/2443] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:14:06 2022] DELETE /identity/v3/projects/4054e6c61d0349a0b7ac61c62c7c0543 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:14:06.499645 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee783962-ab70-4f7d-a4cc-6afd405ca96a None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:06.499935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee783962-ab70-4f7d-a4cc-6afd405ca96a None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:06.500219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee783962-ab70-4f7d-a4cc-6afd405ca96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:06.519567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-ee783962-ab70-4f7d-a4cc-6afd405ca96a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:06.520818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ee783962-ab70-4f7d-a4cc-6afd405ca96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:06.552311 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52628563-785a-4178-8ff1-dc940741f395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:06.552960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52628563-785a-4178-8ff1-dc940741f395 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:06.553240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52628563-785a-4178-8ff1-dc940741f395 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:06.553514 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52628563-785a-4178-8ff1-dc940741f395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:06.555255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-52628563-785a-4178-8ff1-dc940741f395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:06.585693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1220/2444] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:14:06.641904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52628563-785a-4178-8ff1-dc940741f395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:06.643680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52628563-785a-4178-8ff1-dc940741f395 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:06.653054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d17d1-b00a-4a84-926f-861f22a10bd1 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:06.653342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d17d1-b00a-4a84-926f-861f22a10bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:06.653630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d17d1-b00a-4a84-926f-861f22a10bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:06.655934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1225/2445] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:14:06.675323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-609d17d1-b00a-4a84-926f-861f22a10bd1 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:06.676648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-609d17d1-b00a-4a84-926f-861f22a10bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:06.685162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1221/2446] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:14:06.690209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52628563-785a-4178-8ff1-dc940741f395 service nova] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:06.700913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52628563-785a-4178-8ff1-dc940741f395 service nova] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:06.707069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ae9e4-9040-4887-8980-300257c9f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:06.707069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ae9e4-9040-4887-8980-300257c9f6ee admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:06.707495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ae9e4-9040-4887-8980-300257c9f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:06.707658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ae9e4-9040-4887-8980-300257c9f6ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:06.708205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ae9e4-9040-4887-8980-300257c9f6ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:14:06.708516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ae9e4-9040-4887-8980-300257c9f6ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:06.710202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ae9e4-9040-4887-8980-300257c9f6ee admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:06.713414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:06.732991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1226/2447] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:14:06.737384 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d17d1-b00a-4a84-926f-861f22a10bd1 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:06.752066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d17d1-b00a-4a84-926f-861f22a10bd1 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:06.759336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec83d48-d00d-4ef4-b9d2-d6376658a307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:06.760093 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec83d48-d00d-4ef4-b9d2-d6376658a307 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:06.760373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec83d48-d00d-4ef4-b9d2-d6376658a307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:06.760649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec83d48-d00d-4ef4-b9d2-d6376658a307 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:06.761356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec83d48-d00d-4ef4-b9d2-d6376658a307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:06.763296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec83d48-d00d-4ef4-b9d2-d6376658a307 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:06.801018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1222/2448] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:14:06 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:14:06.807112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ae9e4-9040-4887-8980-300257c9f6ee admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:06.820093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ae9e4-9040-4887-8980-300257c9f6ee admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:06.910493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c28019-3de1-44fc-8f1d-965f6f21ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:06.911294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c28019-3de1-44fc-8f1d-965f6f21ec46 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:06.911575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c28019-3de1-44fc-8f1d-965f6f21ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:06.911850 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c28019-3de1-44fc-8f1d-965f6f21ec46 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:06.912515 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c28019-3de1-44fc-8f1d-965f6f21ec46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:06.914508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c28019-3de1-44fc-8f1d-965f6f21ec46 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:06.942465 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1227/2449] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:14:06 2022] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:14:06.946767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec83d48-d00d-4ef4-b9d2-d6376658a307 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:06.957783 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec83d48-d00d-4ef4-b9d2-d6376658a307 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:06.962696 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5520e-6cbc-49e6-97b9-ce2135baeb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:06.963298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5520e-6cbc-49e6-97b9-ce2135baeb51 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:06.963569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5520e-6cbc-49e6-97b9-ce2135baeb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:06.963839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5520e-6cbc-49e6-97b9-ce2135baeb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:06.964502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5520e-6cbc-49e6-97b9-ce2135baeb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:06.966119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5520e-6cbc-49e6-97b9-ce2135baeb51 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:06.976767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1223/2450] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:14:06.981178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c28019-3de1-44fc-8f1d-965f6f21ec46 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:06.991901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c28019-3de1-44fc-8f1d-965f6f21ec46 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:06.996508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf8d0-cc03-4e09-9ece-45788aef9df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:06.997146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf8d0-cc03-4e09-9ece-45788aef9df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:06.997424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf8d0-cc03-4e09-9ece-45788aef9df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:06.997695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf8d0-cc03-4e09-9ece-45788aef9df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:06.998340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caf8d0-cc03-4e09-9ece-45788aef9df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:06.999951 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caf8d0-cc03-4e09-9ece-45788aef9df5 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:07.011542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1228/2451] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:14:07.016021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5520e-6cbc-49e6-97b9-ce2135baeb51 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:07.027148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5520e-6cbc-49e6-97b9-ce2135baeb51 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:07.032211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3069b-c614-4dc8-a3f3-ac6f03ae4be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:07.032918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3069b-c614-4dc8-a3f3-ac6f03ae4be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:07.033198 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3069b-c614-4dc8-a3f3-ac6f03ae4be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:07.033469 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3069b-c614-4dc8-a3f3-ac6f03ae4be9 admin admin] PATH_INFO: `/v3/projects/17570e024f3448a7925a0f0936552d4a/users/d8ee8bcbe8b147c89204dcd89516ec8f/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:07.049581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3069b-c614-4dc8-a3f3-ac6f03ae4be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17570e024f3448a7925a0f0936552d4a, user_id=d8ee8bcbe8b147c89204dcd89516ec8f, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:07.052378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3069b-c614-4dc8-a3f3-ac6f03ae4be9 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:07.065630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1224/2452] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:14:07 2022] PUT /identity/v3/projects/17570e024f3448a7925a0f0936552d4a/users/d8ee8bcbe8b147c89204dcd89516ec8f/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:14:07.076290 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeee37e-82d8-40cd-81cc-fc08f42d6cb8 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:07.076760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeee37e-82d8-40cd-81cc-fc08f42d6cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:07.077173 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeee37e-82d8-40cd-81cc-fc08f42d6cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:07.107447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-afeee37e-82d8-40cd-81cc-fc08f42d6cb8 None None] MFA Rules not processed for user `d8ee8bcbe8b147c89204dcd89516ec8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:07.108725 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-afeee37e-82d8-40cd-81cc-fc08f42d6cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:07.174056 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1229/2453] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:14:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:14:07.186266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3069b-c614-4dc8-a3f3-ac6f03ae4be9 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:07.187954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-64d3069b-c614-4dc8-a3f3-ac6f03ae4be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:07.246676 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3069b-c614-4dc8-a3f3-ac6f03ae4be9 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:07.250248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaf5fa-b0f7-47eb-8d28-2f87cfa1c2b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:07.250854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaf5fa-b0f7-47eb-8d28-2f87cfa1c2b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:07.251137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaf5fa-b0f7-47eb-8d28-2f87cfa1c2b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:07.251410 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaf5fa-b0f7-47eb-8d28-2f87cfa1c2b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:07.256947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:07.261722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdaf5fa-b0f7-47eb-8d28-2f87cfa1c2b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:07.263994 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdaf5fa-b0f7-47eb-8d28-2f87cfa1c2b7 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:07.273656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1225/2454] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:14:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:14:09.495137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99413ac-9e06-4721-9d14-cd02ec62e37c None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:09.495628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99413ac-9e06-4721-9d14-cd02ec62e37c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:09.495724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99413ac-9e06-4721-9d14-cd02ec62e37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:09.515969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e99413ac-9e06-4721-9d14-cd02ec62e37c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:09.517201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e99413ac-9e06-4721-9d14-cd02ec62e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:09.578714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1230/2455] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Sep 7 16:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:14:09.593925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaf5fa-b0f7-47eb-8d28-2f87cfa1c2b7 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:09.595352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2bdaf5fa-b0f7-47eb-8d28-2f87cfa1c2b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:09.669641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaf5fa-b0f7-47eb-8d28-2f87cfa1c2b7 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:09.675651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dabb9-fbf3-4036-9c6b-681c5ef332c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:09.676259 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dabb9-fbf3-4036-9c6b-681c5ef332c4 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:09.676543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dabb9-fbf3-4036-9c6b-681c5ef332c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:09.676857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dabb9-fbf3-4036-9c6b-681c5ef332c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:09.684968 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dabb9-fbf3-4036-9c6b-681c5ef332c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:09.686551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dabb9-fbf3-4036-9c6b-681c5ef332c4 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:09.696527 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1226/2456] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:14:12.371216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99413ac-9e06-4721-9d14-cd02ec62e37c None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:12.377393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:12.382231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99413ac-9e06-4721-9d14-cd02ec62e37c None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:12.388109 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:12.388794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:12.389075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:12.389354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] PATH_INFO: `/v3/users/d8ee8bcbe8b147c89204dcd89516ec8f` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:12.390519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ee8bcbe8b147c89204dcd89516ec8f)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:12.392464 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:12.443430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ee8bcbe8b147c89204dcd89516ec8f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:12.452098 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ee8bcbe8b147c89204dcd89516ec8f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:12.465536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ee8bcbe8b147c89204dcd89516ec8f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:12.466236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ee8bcbe8b147c89204dcd89516ec8f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:12.466881 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ee8bcbe8b147c89204dcd89516ec8f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:12.482531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1231/2457] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:14:12 2022] DELETE /identity/v3/users/d8ee8bcbe8b147c89204dcd89516ec8f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:14:12.488507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecf63c-4873-466a-8f8d-b8ca3295ab38 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:12.489080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecf63c-4873-466a-8f8d-b8ca3295ab38 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:12.489177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecf63c-4873-466a-8f8d-b8ca3295ab38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:12.509475 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-62ecf63c-4873-466a-8f8d-b8ca3295ab38 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:12.510691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-62ecf63c-4873-466a-8f8d-b8ca3295ab38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:12.577893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1227/2458] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:14:12.588583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:12.590057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:12.658651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be6cc-4a3a-4313-be11-93845e75499e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:12.661609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55ceb-6887-4c62-ad74-60b01eb9043b None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:12.661922 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55ceb-6887-4c62-ad74-60b01eb9043b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:12.662193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55ceb-6887-4c62-ad74-60b01eb9043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:12.662933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb67dd-2ee6-4654-9a0f-b33d9a941cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:12.663533 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb67dd-2ee6-4654-9a0f-b33d9a941cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:12.663813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb67dd-2ee6-4654-9a0f-b33d9a941cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:12.664083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb67dd-2ee6-4654-9a0f-b33d9a941cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:12.673518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb67dd-2ee6-4654-9a0f-b33d9a941cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:12.675469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb67dd-2ee6-4654-9a0f-b33d9a941cb2 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:12.682685 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7aa55ceb-6887-4c62-ad74-60b01eb9043b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:12.683888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7aa55ceb-6887-4c62-ad74-60b01eb9043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:12.685363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1232/2459] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:14:12.693078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1228/2460] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Sep 7 16:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:14:12.710179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb67dd-2ee6-4654-9a0f-b33d9a941cb2 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:12.712312 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-57cb67dd-2ee6-4654-9a0f-b33d9a941cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:12.800733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb67dd-2ee6-4654-9a0f-b33d9a941cb2 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:12.806974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0ed64-06e0-49a8-8236-1dda823ea0e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:12.807587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0ed64-06e0-49a8-8236-1dda823ea0e9 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:12.807905 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0ed64-06e0-49a8-8236-1dda823ea0e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:12.808202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0ed64-06e0-49a8-8236-1dda823ea0e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:12.818018 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0ed64-06e0-49a8-8236-1dda823ea0e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:12.819633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0ed64-06e0-49a8-8236-1dda823ea0e9 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:12.830947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1233/2461] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:14:12.994142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55ceb-6887-4c62-ad74-60b01eb9043b None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:12.994142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7aa55ceb-6887-4c62-ad74-60b01eb9043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:13.010440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55ceb-6887-4c62-ad74-60b01eb9043b None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:13.015764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:13.016588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:13.016922 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:13.017199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2 admin admin] PATH_INFO: `/v3/projects/17570e024f3448a7925a0f0936552d4a` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:13.018420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17570e024f3448a7925a0f0936552d4a)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:13.021330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:13.072140 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17570e024f3448a7925a0f0936552d4a', 'request_id': 'req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:13.080193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17570e024f3448a7925a0f0936552d4a', 'request_id': 'req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:13.087320 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17570e024f3448a7925a0f0936552d4a', 'request_id': 'req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:13.089238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:13.099694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2 admin admin] The token cache is being invalidate because project 17570e024f3448a7925a0f0936552d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:14:13.100466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:13.101334 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-86e461ab-3f35-4628-aed3-6a32f7b4f1d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:14:13.103017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1229/2462] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:14:12 2022] DELETE /identity/v3/projects/17570e024f3448a7925a0f0936552d4a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:14:18.316952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca23c58-b239-43d1-9707-08bbb1a9883e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:18.317658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca23c58-b239-43d1-9707-08bbb1a9883e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:18.318195 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca23c58-b239-43d1-9707-08bbb1a9883e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:18.326663 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:18.347853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-1ca23c58-b239-43d1-9707-08bbb1a9883e None None] MFA Rules not processed for user `e181e79d294845dd88c91a9dff2831f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:18.349839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1ca23c58-b239-43d1-9707-08bbb1a9883e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:18.442095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1234/2463] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:14:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:14:23.104511 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:28.432517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=23 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:33.168161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb28d59-3aca-4cd5-abbb-87aff561405b None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:33.168703 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb28d59-3aca-4cd5-abbb-87aff561405b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:33.168817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb28d59-3aca-4cd5-abbb-87aff561405b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:33.187932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-ddb28d59-3aca-4cd5-abbb-87aff561405b None None] MFA Rules not processed for user `2d6bff93b3b7470f9dfb6d02858923da`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:33.189175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ddb28d59-3aca-4cd5-abbb-87aff561405b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:33.249347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1230/2464] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:14:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:14:39.750438 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119b22a-9789-44f6-8fe6-b250a9df1834 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:39.751326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119b22a-9789-44f6-8fe6-b250a9df1834 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:39.751605 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119b22a-9789-44f6-8fe6-b250a9df1834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:39.771821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-4119b22a-9789-44f6-8fe6-b250a9df1834 None None] MFA Rules not processed for user `1beb3cf542bf4cc1802f90ad14a29017`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:39.773075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4119b22a-9789-44f6-8fe6-b250a9df1834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:39.838002 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1235/2465] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:14:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:14:43.242508 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=25 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:49.830746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=25 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:49.938261 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341485c-b36a-41c0-b62d-1244350e1b02 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:49.939103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341485c-b36a-41c0-b62d-1244350e1b02 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:49.939578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341485c-b36a-41c0-b62d-1244350e1b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:49.982110 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-0341485c-b36a-41c0-b62d-1244350e1b02 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:49.983687 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0341485c-b36a-41c0-b62d-1244350e1b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:50.079361 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1231/2466] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Sep 7 16:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:14:50.094286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119b22a-9789-44f6-8fe6-b250a9df1834 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:50.095988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4119b22a-9789-44f6-8fe6-b250a9df1834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:50.251874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119b22a-9789-44f6-8fe6-b250a9df1834 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:50.259270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78365a4-911d-4f6c-977a-ce53c69706cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:50.260150 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78365a4-911d-4f6c-977a-ce53c69706cc service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:50.260636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78365a4-911d-4f6c-977a-ce53c69706cc service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:50.261106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78365a4-911d-4f6c-977a-ce53c69706cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:50.279712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78365a4-911d-4f6c-977a-ce53c69706cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:50.282798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78365a4-911d-4f6c-977a-ce53c69706cc service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:50.294960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1236/2467] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:14:52.163479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec438e61-76b8-41be-9291-66b08b22d6d8 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:52.164143 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec438e61-76b8-41be-9291-66b08b22d6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:52.164143 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec438e61-76b8-41be-9291-66b08b22d6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:52.184327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-ec438e61-76b8-41be-9291-66b08b22d6d8 None None] MFA Rules not processed for user `6ddf97a836074da89dacb0d8029e2165`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:52.185586 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ec438e61-76b8-41be-9291-66b08b22d6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:52.242664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1232/2468] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:14:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:14:53.264335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edd6c1-03bf-4cbf-b896-9eb5eebe08fa None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:53.265246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edd6c1-03bf-4cbf-b896-9eb5eebe08fa None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:53.265549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edd6c1-03bf-4cbf-b896-9eb5eebe08fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:53.286478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-83edd6c1-03bf-4cbf-b896-9eb5eebe08fa None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:53.288219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-83edd6c1-03bf-4cbf-b896-9eb5eebe08fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:53.296337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1237/2469] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Sep 7 16:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:14:53.315856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec438e61-76b8-41be-9291-66b08b22d6d8 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:53.321799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ec438e61-76b8-41be-9291-66b08b22d6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:53.339921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec438e61-76b8-41be-9291-66b08b22d6d8 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:53.351714 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2099f8-e4e8-496c-a218-0e555288bd0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:53.352477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2099f8-e4e8-496c-a218-0e555288bd0a service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:53.352796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2099f8-e4e8-496c-a218-0e555288bd0a service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:53.353236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2099f8-e4e8-496c-a218-0e555288bd0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:53.362448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2099f8-e4e8-496c-a218-0e555288bd0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:53.364055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2099f8-e4e8-496c-a218-0e555288bd0a service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:53.374617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1233/2470] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:14:56.361918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc5d20-5f47-47cb-8395-63a8e65dde86 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:56.362939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc5d20-5f47-47cb-8395-63a8e65dde86 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:56.363445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc5d20-5f47-47cb-8395-63a8e65dde86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:56.408056 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b0fc5d20-5f47-47cb-8395-63a8e65dde86 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:56.409388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b0fc5d20-5f47-47cb-8395-63a8e65dde86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:56.424792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1238/2471] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Sep 7 16:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:14:56.442413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2099f8-e4e8-496c-a218-0e555288bd0a service nova] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:56.455720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2099f8-e4e8-496c-a218-0e555288bd0a service nova] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:56.462725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca30d3b-4d94-479f-ba97-1f0c163d01a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:56.463577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca30d3b-4d94-479f-ba97-1f0c163d01a3 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:56.463935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca30d3b-4d94-479f-ba97-1f0c163d01a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:56.464285 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca30d3b-4d94-479f-ba97-1f0c163d01a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:56.474884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca30d3b-4d94-479f-ba97-1f0c163d01a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:56.477196 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca30d3b-4d94-479f-ba97-1f0c163d01a3 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:56.492921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1234/2472] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:14:59.592791 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940df2c-3096-49a7-8545-9adc63bbca11 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:59.593369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940df2c-3096-49a7-8545-9adc63bbca11 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:59.593369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940df2c-3096-49a7-8545-9adc63bbca11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:59.613935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9940df2c-3096-49a7-8545-9adc63bbca11 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:14:59.615182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9940df2c-3096-49a7-8545-9adc63bbca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:14:59.623432 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1239/2473] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Sep 7 16:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:14:59.646770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca30d3b-4d94-479f-ba97-1f0c163d01a3 service nova] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:14:59.658331 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca30d3b-4d94-479f-ba97-1f0c163d01a3 service nova] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:14:59.664588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951462ba-22fb-49f5-9c9c-56621519df0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:14:59.665220 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951462ba-22fb-49f5-9c9c-56621519df0a service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:14:59.665504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951462ba-22fb-49f5-9c9c-56621519df0a service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:14:59.665782 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951462ba-22fb-49f5-9c9c-56621519df0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:14:59.674660 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951462ba-22fb-49f5-9c9c-56621519df0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:14:59.676229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951462ba-22fb-49f5-9c9c-56621519df0a service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:14:59.686545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1235/2474] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:15:02.787717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce205c3-4532-4fb4-9ae8-a592eaee6abe None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:02.788285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce205c3-4532-4fb4-9ae8-a592eaee6abe None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:02.788285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce205c3-4532-4fb4-9ae8-a592eaee6abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:02.808275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9ce205c3-4532-4fb4-9ae8-a592eaee6abe None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:15:02.809535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9ce205c3-4532-4fb4-9ae8-a592eaee6abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:02.820646 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1240/2475] 10.222.0.20 () {58 vars in 1016 bytes} [Wed Sep 7 16:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:15:02.836986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951462ba-22fb-49f5-9c9c-56621519df0a service nova] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:02.848409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951462ba-22fb-49f5-9c9c-56621519df0a service nova] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:02.854177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f65492-9f36-4aef-b895-493ffb1711f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:02.854871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f65492-9f36-4aef-b895-493ffb1711f2 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:02.855069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f65492-9f36-4aef-b895-493ffb1711f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:02.855827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f65492-9f36-4aef-b895-493ffb1711f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:02.865097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f65492-9f36-4aef-b895-493ffb1711f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:02.866672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f65492-9f36-4aef-b895-493ffb1711f2 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:02.877026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1236/2476] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:15:12.802956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=46 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:15:12.872345 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=76 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:15:32.501020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce205c3-4532-4fb4-9ae8-a592eaee6abe None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:32.502416 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9ce205c3-4532-4fb4-9ae8-a592eaee6abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:32.559939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce205c3-4532-4fb4-9ae8-a592eaee6abe None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:32.563691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d3e1e-19f0-4b74-8091-0cdbc7248c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:32.564295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d3e1e-19f0-4b74-8091-0cdbc7248c50 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:32.564571 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d3e1e-19f0-4b74-8091-0cdbc7248c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:32.564870 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d3e1e-19f0-4b74-8091-0cdbc7248c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:32.567087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e57d3e1e-19f0-4b74-8091-0cdbc7248c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:32.579491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d3e1e-19f0-4b74-8091-0cdbc7248c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:32.580975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d3e1e-19f0-4b74-8091-0cdbc7248c50 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:32.591405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1241/2477] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:15:35.843850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f65492-9f36-4aef-b895-493ffb1711f2 service nova] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:35.845881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d3f65492-9f36-4aef-b895-493ffb1711f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:35.861667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f65492-9f36-4aef-b895-493ffb1711f2 service nova] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:35.867706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:35.868347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:35.868632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:35.869162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] PATH_INFO: `/v3/users/2d6bff93b3b7470f9dfb6d02858923da` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:35.870604 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6bff93b3b7470f9dfb6d02858923da)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:35.872555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:35.949343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6bff93b3b7470f9dfb6d02858923da'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:35.962916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6bff93b3b7470f9dfb6d02858923da'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:35.963946 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6bff93b3b7470f9dfb6d02858923da'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:35.964799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6bff93b3b7470f9dfb6d02858923da'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:35.979276 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6bff93b3b7470f9dfb6d02858923da'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:35.996533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1237/2478] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:15:35 2022] DELETE /identity/v3/users/2d6bff93b3b7470f9dfb6d02858923da => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:15:36.031388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d3e1e-19f0-4b74-8091-0cdbc7248c50 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:36.033205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e57d3e1e-19f0-4b74-8091-0cdbc7248c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:36.048388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d3e1e-19f0-4b74-8091-0cdbc7248c50 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:36.113370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:36.114017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:36.114304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:36.114577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] PATH_INFO: `/v3/users/e181e79d294845dd88c91a9dff2831f2` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:36.116128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e181e79d294845dd88c91a9dff2831f2)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:36.117937 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:36.169509 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e181e79d294845dd88c91a9dff2831f2'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.180066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e181e79d294845dd88c91a9dff2831f2'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.201374 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e181e79d294845dd88c91a9dff2831f2'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.202554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e181e79d294845dd88c91a9dff2831f2'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.203339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e181e79d294845dd88c91a9dff2831f2'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.215767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:36.218172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:36.225107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1242/2479] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:15:36 2022] DELETE /identity/v3/users/e181e79d294845dd88c91a9dff2831f2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:15:36.240150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e37e2-ae82-49ad-939a-3631fcb84f9d admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:36.319007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2567efb-30aa-44ce-b769-8764a1bc4fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:36.319544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2567efb-30aa-44ce-b769-8764a1bc4fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:36.319825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2567efb-30aa-44ce-b769-8764a1bc4fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:36.320308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2567efb-30aa-44ce-b769-8764a1bc4fa4 admin admin] PATH_INFO: `/v3/projects/b077df1ed970466da9e6c4e0b2386337` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:36.321319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2567efb-30aa-44ce-b769-8764a1bc4fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b077df1ed970466da9e6c4e0b2386337)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:36.323260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2567efb-30aa-44ce-b769-8764a1bc4fa4 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:36.376919 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d2567efb-30aa-44ce-b769-8764a1bc4fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b077df1ed970466da9e6c4e0b2386337', 'request_id': 'req-d2567efb-30aa-44ce-b769-8764a1bc4fa4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.386833 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d2567efb-30aa-44ce-b769-8764a1bc4fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b077df1ed970466da9e6c4e0b2386337', 'request_id': 'req-d2567efb-30aa-44ce-b769-8764a1bc4fa4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.393709 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d2567efb-30aa-44ce-b769-8764a1bc4fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b077df1ed970466da9e6c4e0b2386337', 'request_id': 'req-d2567efb-30aa-44ce-b769-8764a1bc4fa4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.408809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d2567efb-30aa-44ce-b769-8764a1bc4fa4 admin admin] The token cache is being invalidate because project b077df1ed970466da9e6c4e0b2386337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:15:36.409096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d2567efb-30aa-44ce-b769-8764a1bc4fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.409763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d2567efb-30aa-44ce-b769-8764a1bc4fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.412134 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1238/2480] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:15:36 2022] DELETE /identity/v3/projects/b077df1ed970466da9e6c4e0b2386337 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:15:36.685811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:36.687687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:36.707632 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019745c5-149b-4ae3-82f6-e7bfabaa79a8 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:36.727170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:15:36.768950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72c71-c586-4f3c-b2f1-875c57b4f410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:36.770078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72c71-c586-4f3c-b2f1-875c57b4f410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:36.770357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72c71-c586-4f3c-b2f1-875c57b4f410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:36.770623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72c71-c586-4f3c-b2f1-875c57b4f410 admin admin] PATH_INFO: `/v3/projects/2ecff0ddcede49f68a64f0ba57048847` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:36.771835 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec72c71-c586-4f3c-b2f1-875c57b4f410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ecff0ddcede49f68a64f0ba57048847)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:36.773781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec72c71-c586-4f3c-b2f1-875c57b4f410 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:36.826241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2ec72c71-c586-4f3c-b2f1-875c57b4f410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ecff0ddcede49f68a64f0ba57048847', 'request_id': 'req-2ec72c71-c586-4f3c-b2f1-875c57b4f410'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.834806 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2ec72c71-c586-4f3c-b2f1-875c57b4f410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ecff0ddcede49f68a64f0ba57048847', 'request_id': 'req-2ec72c71-c586-4f3c-b2f1-875c57b4f410'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.843671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2ec72c71-c586-4f3c-b2f1-875c57b4f410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ecff0ddcede49f68a64f0ba57048847', 'request_id': 'req-2ec72c71-c586-4f3c-b2f1-875c57b4f410'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.857273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2ec72c71-c586-4f3c-b2f1-875c57b4f410 admin admin] The token cache is being invalidate because project 2ecff0ddcede49f68a64f0ba57048847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:15:36.857570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2ec72c71-c586-4f3c-b2f1-875c57b4f410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.858241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2ec72c71-c586-4f3c-b2f1-875c57b4f410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:15:36.859812 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1243/2481] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:15:36 2022] DELETE /identity/v3/projects/2ecff0ddcede49f68a64f0ba57048847 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:15:36.866717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6bc11-4ee2-4d70-a1e8-8e02729d12d3 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:36.867283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6bc11-4ee2-4d70-a1e8-8e02729d12d3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:36.867283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6bc11-4ee2-4d70-a1e8-8e02729d12d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:36.875186 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:15:36.891430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-84f6bc11-4ee2-4d70-a1e8-8e02729d12d3 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:15:36.892676 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-84f6bc11-4ee2-4d70-a1e8-8e02729d12d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:36.954255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1239/2482] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:15:36.963149 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957999b-cd9d-48ac-9218-6687ffdd70b2 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:36.963436 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957999b-cd9d-48ac-9218-6687ffdd70b2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:36.963736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957999b-cd9d-48ac-9218-6687ffdd70b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:36.984149 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9957999b-cd9d-48ac-9218-6687ffdd70b2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:15:36.985381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9957999b-cd9d-48ac-9218-6687ffdd70b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:36.993624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1244/2483] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:15:36.997995 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6bc11-4ee2-4d70-a1e8-8e02729d12d3 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:37.007934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6bc11-4ee2-4d70-a1e8-8e02729d12d3 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:37.012536 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c4b0-c806-4e86-8000-082be0059825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:37.013244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c4b0-c806-4e86-8000-082be0059825 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:37.013530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c4b0-c806-4e86-8000-082be0059825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:37.013806 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c4b0-c806-4e86-8000-082be0059825 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:37.014484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3c4b0-c806-4e86-8000-082be0059825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:15:37.014784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3c4b0-c806-4e86-8000-082be0059825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:37.016358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3c4b0-c806-4e86-8000-082be0059825 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:37.031948 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1240/2484] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:15:37.033308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957999b-cd9d-48ac-9218-6687ffdd70b2 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:37.044078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957999b-cd9d-48ac-9218-6687ffdd70b2 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:37.048902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fb43b-71cd-472c-936f-ce70251bc4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:37.053032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fb43b-71cd-472c-936f-ce70251bc4ea admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:37.053032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fb43b-71cd-472c-936f-ce70251bc4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:37.053032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fb43b-71cd-472c-936f-ce70251bc4ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:37.053032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fb43b-71cd-472c-936f-ce70251bc4ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:37.053032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fb43b-71cd-472c-936f-ce70251bc4ea admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:37.088371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1245/2485] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:15:37 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:15:37.092375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c4b0-c806-4e86-8000-082be0059825 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:37.105589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c4b0-c806-4e86-8000-082be0059825 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:37.173136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d810f4-5cf3-4fe1-bcc9-33a5c4a5be8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:37.173746 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d810f4-5cf3-4fe1-bcc9-33a5c4a5be8a admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:37.174026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d810f4-5cf3-4fe1-bcc9-33a5c4a5be8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:37.174297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d810f4-5cf3-4fe1-bcc9-33a5c4a5be8a admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:37.174934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d810f4-5cf3-4fe1-bcc9-33a5c4a5be8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:37.176922 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d810f4-5cf3-4fe1-bcc9-33a5c4a5be8a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:37.201220 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1241/2486] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:15:37 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:15:37.205304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fb43b-71cd-472c-936f-ce70251bc4ea admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:37.217964 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fb43b-71cd-472c-936f-ce70251bc4ea admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:37.222365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe25bd0-5ccd-47db-820f-1c9fc9d251ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:37.222994 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe25bd0-5ccd-47db-820f-1c9fc9d251ee admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:37.223269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe25bd0-5ccd-47db-820f-1c9fc9d251ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:37.223541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe25bd0-5ccd-47db-820f-1c9fc9d251ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:37.224209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe25bd0-5ccd-47db-820f-1c9fc9d251ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:37.225844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe25bd0-5ccd-47db-820f-1c9fc9d251ee admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:37.236027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1246/2487] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:15:37.240241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d810f4-5cf3-4fe1-bcc9-33a5c4a5be8a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:37.250926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d810f4-5cf3-4fe1-bcc9-33a5c4a5be8a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:37.256381 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef5705-0e63-40a0-b4e1-039cd92843ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:37.257017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef5705-0e63-40a0-b4e1-039cd92843ed admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:37.257302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef5705-0e63-40a0-b4e1-039cd92843ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:37.257576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef5705-0e63-40a0-b4e1-039cd92843ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:37.258213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef5705-0e63-40a0-b4e1-039cd92843ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:37.259786 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef5705-0e63-40a0-b4e1-039cd92843ed admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:37.271829 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1242/2488] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:15:37.275880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe25bd0-5ccd-47db-820f-1c9fc9d251ee admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:37.286867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe25bd0-5ccd-47db-820f-1c9fc9d251ee admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:37.291439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48b598-d4a8-460e-bf90-e91394f75382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:37.292087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48b598-d4a8-460e-bf90-e91394f75382 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:37.292367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48b598-d4a8-460e-bf90-e91394f75382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:37.292639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48b598-d4a8-460e-bf90-e91394f75382 admin admin] PATH_INFO: `/v3/projects/93d9335c85de4f66807cf738c7f25df8/users/f798985ff3b94ee7ac098697355aecfa/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:37.308598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48b598-d4a8-460e-bf90-e91394f75382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d9335c85de4f66807cf738c7f25df8, user_id=f798985ff3b94ee7ac098697355aecfa, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:37.311330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48b598-d4a8-460e-bf90-e91394f75382 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:37.324617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1247/2489] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:15:37 2022] PUT /identity/v3/projects/93d9335c85de4f66807cf738c7f25df8/users/f798985ff3b94ee7ac098697355aecfa/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:15:37.329734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636d0ae-f041-48cf-aebd-33a18c1160a1 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:37.330078 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636d0ae-f041-48cf-aebd-33a18c1160a1 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:37.330367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636d0ae-f041-48cf-aebd-33a18c1160a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:37.350151 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-2636d0ae-f041-48cf-aebd-33a18c1160a1 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:15:37.351300 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2636d0ae-f041-48cf-aebd-33a18c1160a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:37.412459 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1243/2490] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:15:37.421953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48b598-d4a8-460e-bf90-e91394f75382 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:37.423638 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ae48b598-d4a8-460e-bf90-e91394f75382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:37.476644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:15:37.480435 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48b598-d4a8-460e-bf90-e91394f75382 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:37.485178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a1369-2e0e-4d20-8eec-af7d9e35b438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:37.485807 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a1369-2e0e-4d20-8eec-af7d9e35b438 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:37.486114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a1369-2e0e-4d20-8eec-af7d9e35b438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:37.486492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a1369-2e0e-4d20-8eec-af7d9e35b438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:37.496395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a1369-2e0e-4d20-8eec-af7d9e35b438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:37.497928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a1369-2e0e-4d20-8eec-af7d9e35b438 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:37.507895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1248/2491] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:15:40.573286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636d0ae-f041-48cf-aebd-33a18c1160a1 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:40.575283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2636d0ae-f041-48cf-aebd-33a18c1160a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:40.598380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:15:40.668545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636d0ae-f041-48cf-aebd-33a18c1160a1 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:40.672263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787afa94-b4c4-46fe-986a-6cd8a9d707b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:40.672934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787afa94-b4c4-46fe-986a-6cd8a9d707b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:40.673217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787afa94-b4c4-46fe-986a-6cd8a9d707b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:40.673490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787afa94-b4c4-46fe-986a-6cd8a9d707b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:40.675295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-787afa94-b4c4-46fe-986a-6cd8a9d707b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:40.778775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787afa94-b4c4-46fe-986a-6cd8a9d707b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:40.780424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787afa94-b4c4-46fe-986a-6cd8a9d707b8 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:40.793621 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1244/2492] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:15:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:15:41.633703 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d81b8-49de-4d5b-8075-217f4caf6763 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:41.634218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d81b8-49de-4d5b-8075-217f4caf6763 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:41.634300 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d81b8-49de-4d5b-8075-217f4caf6763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:41.673244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-834d81b8-49de-4d5b-8075-217f4caf6763 None None] MFA Rules not processed for user `f798985ff3b94ee7ac098697355aecfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:15:41.675198 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-834d81b8-49de-4d5b-8075-217f4caf6763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:41.751492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1249/2493] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:15:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:15:41.766655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787afa94-b4c4-46fe-986a-6cd8a9d707b8 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:41.768122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-787afa94-b4c4-46fe-986a-6cd8a9d707b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:41.783784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787afa94-b4c4-46fe-986a-6cd8a9d707b8 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:41.790606 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266358c-3573-4b6f-9c6b-46481e412d2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:41.791657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266358c-3573-4b6f-9c6b-46481e412d2a service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:41.791947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266358c-3573-4b6f-9c6b-46481e412d2a service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:41.795436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266358c-3573-4b6f-9c6b-46481e412d2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:41.820900 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266358c-3573-4b6f-9c6b-46481e412d2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:41.822706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266358c-3573-4b6f-9c6b-46481e412d2a service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:41.834015 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1245/2494] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:15:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:15:43.627213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5645ec-d4fa-4535-8cae-d2da08386d89 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:43.627848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5645ec-d4fa-4535-8cae-d2da08386d89 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:43.628531 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5645ec-d4fa-4535-8cae-d2da08386d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:43.649498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-0d5645ec-d4fa-4535-8cae-d2da08386d89 None None] MFA Rules not processed for user `f798985ff3b94ee7ac098697355aecfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:15:43.650781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-0d5645ec-d4fa-4535-8cae-d2da08386d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:43.664930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1250/2495] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:15:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:15:43.698164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266358c-3573-4b6f-9c6b-46481e412d2a service nova] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:43.699725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0266358c-3573-4b6f-9c6b-46481e412d2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:43.764255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266358c-3573-4b6f-9c6b-46481e412d2a service nova] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:43.769641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24338a-c16a-4b24-914b-03e199c0c3e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc71e3a41ac644ff8a908b766495b5f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:43.770333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24338a-c16a-4b24-914b-03e199c0c3e1 service glance] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:43.770623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24338a-c16a-4b24-914b-03e199c0c3e1 service glance] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:43.770897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24338a-c16a-4b24-914b-03e199c0c3e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:43.772704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6e24338a-c16a-4b24-914b-03e199c0c3e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:43.787204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24338a-c16a-4b24-914b-03e199c0c3e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:43.788637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24338a-c16a-4b24-914b-03e199c0c3e1 service glance] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:43.801290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1246/2496] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:15:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:15:51.636172 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2fb5c-5c55-4309-8c56-9ce2d259b49d None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:51.636830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2fb5c-5c55-4309-8c56-9ce2d259b49d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:51.636830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2fb5c-5c55-4309-8c56-9ce2d259b49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:51.656046 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-40c2fb5c-5c55-4309-8c56-9ce2d259b49d None None] MFA Rules not processed for user `1beb3cf542bf4cc1802f90ad14a29017`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:15:51.657534 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-40c2fb5c-5c55-4309-8c56-9ce2d259b49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:51.711161 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1251/2497] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:15:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:15:52.177648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24338a-c16a-4b24-914b-03e199c0c3e1 service glance] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:52.192755 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24338a-c16a-4b24-914b-03e199c0c3e1 service glance] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:52.198899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7d165-f310-4f17-a2f7-efc7b9d16ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:52.199701 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7d165-f310-4f17-a2f7-efc7b9d16ea7 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:52.199827 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7d165-f310-4f17-a2f7-efc7b9d16ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:52.200254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7d165-f310-4f17-a2f7-efc7b9d16ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:52.202024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-74a7d165-f310-4f17-a2f7-efc7b9d16ea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:52.248040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:15:52.279501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7d165-f310-4f17-a2f7-efc7b9d16ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:52.281367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7d165-f310-4f17-a2f7-efc7b9d16ea7 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:52.292602 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1247/2498] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:15:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:15:52.450671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836c1c5-e1d6-4b65-b81c-15c28910f43f None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:52.450962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836c1c5-e1d6-4b65-b81c-15c28910f43f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:52.451236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836c1c5-e1d6-4b65-b81c-15c28910f43f None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:52.452942 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1252/2499] 10.222.0.43 () {54 vars in 961 bytes} [Wed Sep 7 16:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:15:52.459617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c6e16-4255-4d86-a249-0ccad47f7e51 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:52.460322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c6e16-4255-4d86-a249-0ccad47f7e51 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:52.461354 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c6e16-4255-4d86-a249-0ccad47f7e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:52.493737 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-985c6e16-4255-4d86-a249-0ccad47f7e51 None None] MFA Rules not processed for user `b918da0f83754f3887de1cfa2e4df028`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:15:52.495161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-985c6e16-4255-4d86-a249-0ccad47f7e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:52.593454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1248/2500] 10.222.0.43 () {58 vars in 1058 bytes} [Wed Sep 7 16:15:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:15:52.601943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836c1c5-e1d6-4b65-b81c-15c28910f43f None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:52.616357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836c1c5-e1d6-4b65-b81c-15c28910f43f None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:52.621478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04438b90-554b-456b-b04c-a2bf580b27b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b918da0f83754f3887de1cfa2e4df028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:52.622075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04438b90-554b-456b-b04c-a2bf580b27b7 service placement] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:52.622353 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04438b90-554b-456b-b04c-a2bf580b27b7 service placement] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:52.622623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04438b90-554b-456b-b04c-a2bf580b27b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:52.624495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-04438b90-554b-456b-b04c-a2bf580b27b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:52.638717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04438b90-554b-456b-b04c-a2bf580b27b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:52.640414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04438b90-554b-456b-b04c-a2bf580b27b7 service placement] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:52.652861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1253/2501] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:15:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:15:55.536148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c6e16-4255-4d86-a249-0ccad47f7e51 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:15:55.537628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-985c6e16-4255-4d86-a249-0ccad47f7e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:55.549052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c6e16-4255-4d86-a249-0ccad47f7e51 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:15:55.552872 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d4e42-814c-4ee6-be12-0b6c6e19a152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:15:55.553476 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d4e42-814c-4ee6-be12-0b6c6e19a152 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:15:55.553756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d4e42-814c-4ee6-be12-0b6c6e19a152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:15:55.554030 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d4e42-814c-4ee6-be12-0b6c6e19a152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:15:55.555681 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d48d4e42-814c-4ee6-be12-0b6c6e19a152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:15:55.565926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d4e42-814c-4ee6-be12-0b6c6e19a152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:15:55.567689 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d4e42-814c-4ee6-be12-0b6c6e19a152 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:15:55.576309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1249/2502] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:15:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:16:02.647282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=70 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:16:05.572160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=45 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:16:07.797081 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be44c89-bb34-41b3-a9cf-0174653bb9d6 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:07.797574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be44c89-bb34-41b3-a9cf-0174653bb9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:07.797684 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be44c89-bb34-41b3-a9cf-0174653bb9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:07.818563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8be44c89-bb34-41b3-a9cf-0174653bb9d6 None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:16:07.819752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8be44c89-bb34-41b3-a9cf-0174653bb9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:16:07.874714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1254/2503] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:16:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:16:07.922941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d4e42-814c-4ee6-be12-0b6c6e19a152 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:16:07.924455 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d48d4e42-814c-4ee6-be12-0b6c6e19a152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:16:07.997150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d4e42-814c-4ee6-be12-0b6c6e19a152 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:16:08.002066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceffb8-2d9b-4c3b-991d-45e4ef69c208 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:16:08.002665 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceffb8-2d9b-4c3b-991d-45e4ef69c208 service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:08.002943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceffb8-2d9b-4c3b-991d-45e4ef69c208 service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:08.003215 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceffb8-2d9b-4c3b-991d-45e4ef69c208 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:08.016654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceffb8-2d9b-4c3b-991d-45e4ef69c208 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:16:08.018269 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceffb8-2d9b-4c3b-991d-45e4ef69c208 service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:16:08.026872 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1250/2504] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:16:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:16:17.868032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=25 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:16:18.023613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=32 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:16:20.359047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be44c89-bb34-41b3-a9cf-0174653bb9d6 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:16:20.360478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8be44c89-bb34-41b3-a9cf-0174653bb9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:16:20.380201 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be44c89-bb34-41b3-a9cf-0174653bb9d6 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:16:20.387306 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966969d7-0b59-4f3d-8f2b-cdbfd2fc8ad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:16:20.387917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966969d7-0b59-4f3d-8f2b-cdbfd2fc8ad0 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:20.388189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966969d7-0b59-4f3d-8f2b-cdbfd2fc8ad0 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:20.388636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966969d7-0b59-4f3d-8f2b-cdbfd2fc8ad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:20.390886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-966969d7-0b59-4f3d-8f2b-cdbfd2fc8ad0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:16:20.407209 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966969d7-0b59-4f3d-8f2b-cdbfd2fc8ad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:16:20.409144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966969d7-0b59-4f3d-8f2b-cdbfd2fc8ad0 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:16:20.421342 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1255/2505] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:16:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:16:21.324040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79152e-7dc4-4cb7-a316-3616e60b7bf5 None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:21.324975 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79152e-7dc4-4cb7-a316-3616e60b7bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:21.325283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79152e-7dc4-4cb7-a316-3616e60b7bf5 None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:21.326866 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1251/2506] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:16:21.333831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a54f92-4991-4335-bb62-f5f5be00c020 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:21.334095 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a54f92-4991-4335-bb62-f5f5be00c020 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:21.334367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a54f92-4991-4335-bb62-f5f5be00c020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:21.355358 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-d4a54f92-4991-4335-bb62-f5f5be00c020 None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:16:21.356621 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d4a54f92-4991-4335-bb62-f5f5be00c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:16:21.367455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1256/2507] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:16:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:16:21.379622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79152e-7dc4-4cb7-a316-3616e60b7bf5 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:16:21.393192 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79152e-7dc4-4cb7-a316-3616e60b7bf5 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:16:21.397759 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b08cf1-c527-4509-83c5-28c2aee44b18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc71e3a41ac644ff8a908b766495b5f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:16:21.398474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b08cf1-c527-4509-83c5-28c2aee44b18 service glance] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:21.398832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b08cf1-c527-4509-83c5-28c2aee44b18 service glance] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:21.399695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b08cf1-c527-4509-83c5-28c2aee44b18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:21.411526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b08cf1-c527-4509-83c5-28c2aee44b18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:16:21.412998 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b08cf1-c527-4509-83c5-28c2aee44b18 service glance] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:16:21.424118 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1252/2508] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:16:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:16:21.495271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d57f-f8dc-4485-bf87-d3288a83552c None None] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:21.495553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d57f-f8dc-4485-bf87-d3288a83552c None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:21.495811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d57f-f8dc-4485-bf87-d3288a83552c None None] PATH_INFO: `/` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:21.497194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1257/2509] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:16:21.501902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49346bb2-5d8c-4cec-8269-1d5e537680d1 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:21.502247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49346bb2-5d8c-4cec-8269-1d5e537680d1 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:21.502524 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49346bb2-5d8c-4cec-8269-1d5e537680d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:21.524107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-49346bb2-5d8c-4cec-8269-1d5e537680d1 None None] MFA Rules not processed for user `e91f048f8885448383f4a361b07dac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:16:21.525274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-49346bb2-5d8c-4cec-8269-1d5e537680d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:16:21.532004 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1253/2510] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:16:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:16:21.543751 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d57f-f8dc-4485-bf87-d3288a83552c None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:16:21.556320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d57f-f8dc-4485-bf87-d3288a83552c None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:16:21.559940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54529cae-ca9a-49d5-9059-8ffba9d7b4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:16:21.560533 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54529cae-ca9a-49d5-9059-8ffba9d7b4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:21.560881 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54529cae-ca9a-49d5-9059-8ffba9d7b4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:21.561138 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54529cae-ca9a-49d5-9059-8ffba9d7b4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:21.569731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54529cae-ca9a-49d5-9059-8ffba9d7b4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:16:21.571247 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54529cae-ca9a-49d5-9059-8ffba9d7b4a7 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:16:21.579233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1258/2511] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:16:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:16:21.664187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece668f3-bd83-459f-a10b-7c77e1339ebc None None] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:21.664460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece668f3-bd83-459f-a10b-7c77e1339ebc None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:21.664816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece668f3-bd83-459f-a10b-7c77e1339ebc None None] PATH_INFO: `/` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:21.666146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1254/2512] 10.222.0.43 () {54 vars in 921 bytes} [Wed Sep 7 16:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:16:21.671422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf428b-0d8a-4f70-9714-b8e5eb4eb6df None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:21.671711 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf428b-0d8a-4f70-9714-b8e5eb4eb6df None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:21.671988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf428b-0d8a-4f70-9714-b8e5eb4eb6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:21.692734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-badf428b-0d8a-4f70-9714-b8e5eb4eb6df None None] MFA Rules not processed for user `9d71c0688ea84c05af925f3fb08f35ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:16:21.693942 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-badf428b-0d8a-4f70-9714-b8e5eb4eb6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:16:21.703039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1259/2513] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Sep 7 16:16:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:16:21.714179 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece668f3-bd83-459f-a10b-7c77e1339ebc None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:16:21.725760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece668f3-bd83-459f-a10b-7c77e1339ebc None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:16:21.736793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41735310-e981-4f75-9379-88b06c85f17b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:16:21.737400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41735310-e981-4f75-9379-88b06c85f17b service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:21.737686 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41735310-e981-4f75-9379-88b06c85f17b service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:21.737961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41735310-e981-4f75-9379-88b06c85f17b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:21.749634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41735310-e981-4f75-9379-88b06c85f17b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:16:21.751054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41735310-e981-4f75-9379-88b06c85f17b service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:16:21.762614 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1255/2514] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:16:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:16:24.954799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319da3-21a1-4e30-a53a-97c0b6bec73f None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:24.955343 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319da3-21a1-4e30-a53a-97c0b6bec73f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:24.955824 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319da3-21a1-4e30-a53a-97c0b6bec73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:24.979008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-56319da3-21a1-4e30-a53a-97c0b6bec73f None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:16:24.980282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-56319da3-21a1-4e30-a53a-97c0b6bec73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:16:24.994368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1260/2515] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:16:25.001184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41735310-e981-4f75-9379-88b06c85f17b service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:16:25.014519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41735310-e981-4f75-9379-88b06c85f17b service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:16:25.020905 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e8ff9-4601-471b-9a3f-0e009155afa7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:16:25.021515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e8ff9-4601-471b-9a3f-0e009155afa7 service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:25.021792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e8ff9-4601-471b-9a3f-0e009155afa7 service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:25.022163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e8ff9-4601-471b-9a3f-0e009155afa7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:25.034200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e8ff9-4601-471b-9a3f-0e009155afa7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:16:25.036146 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e8ff9-4601-471b-9a3f-0e009155afa7 service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:16:25.045482 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1256/2516] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:16:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 16:16:25.843017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56319da3-21a1-4e30-a53a-97c0b6bec73f None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:16:25.856023 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56319da3-21a1-4e30-a53a-97c0b6bec73f None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:16:25.860561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39eba5-d77f-4219-b125-372483d93e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:16:25.861221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39eba5-d77f-4219-b125-372483d93e3b service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:25.861624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39eba5-d77f-4219-b125-372483d93e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:25.862139 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39eba5-d77f-4219-b125-372483d93e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:25.866785 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ca39eba5-d77f-4219-b125-372483d93e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:16:25.878070 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39eba5-d77f-4219-b125-372483d93e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:16:25.880405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39eba5-d77f-4219-b125-372483d93e3b service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:16:25.890407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1261/2517] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:16:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:16:35.042225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=21 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:16:35.886378 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=27 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:16:40.349350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c07df-1c1c-4caf-97bf-92c76a8d1d7d None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:40.349857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c07df-1c1c-4caf-97bf-92c76a8d1d7d None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:40.349965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c07df-1c1c-4caf-97bf-92c76a8d1d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:40.370023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f91c07df-1c1c-4caf-97bf-92c76a8d1d7d None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:16:40.371415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f91c07df-1c1c-4caf-97bf-92c76a8d1d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:16:40.378661 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1257/2518] 10.222.0.43 () {58 vars in 967 bytes} [Wed Sep 7 16:16:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:16:40.392239 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39eba5-d77f-4219-b125-372483d93e3b service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:16:40.405146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39eba5-d77f-4219-b125-372483d93e3b service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:16:40.410390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f56ec-4820-446f-8bbf-ba9c0ca4f6b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:16:40.411129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f56ec-4820-446f-8bbf-ba9c0ca4f6b4 service swift] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:40.411411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f56ec-4820-446f-8bbf-ba9c0ca4f6b4 service swift] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:40.411777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f56ec-4820-446f-8bbf-ba9c0ca4f6b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:40.420116 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f56ec-4820-446f-8bbf-ba9c0ca4f6b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:16:40.421736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f56ec-4820-446f-8bbf-ba9c0ca4f6b4 service swift] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:16:40.431101 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1262/2519] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:16:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:16:50.221471 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c07df-1c1c-4caf-97bf-92c76a8d1d7d None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:16:50.236008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c07df-1c1c-4caf-97bf-92c76a8d1d7d None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:16:50.241794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294d644-58c6-41af-acb4-73029d6904c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:16:50.242411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294d644-58c6-41af-acb4-73029d6904c4 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:16:50.242694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294d644-58c6-41af-acb4-73029d6904c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:16:50.242969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294d644-58c6-41af-acb4-73029d6904c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:16:50.244750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f294d644-58c6-41af-acb4-73029d6904c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:16:50.257116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294d644-58c6-41af-acb4-73029d6904c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:16:50.258731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294d644-58c6-41af-acb4-73029d6904c4 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:16:50.269557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1258/2520] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:16:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:16:50.428012 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=6 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:00.263992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=9 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:05.332833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f56ec-4820-446f-8bbf-ba9c0ca4f6b4 service swift] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:05.342575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f56ec-4820-446f-8bbf-ba9c0ca4f6b4 service swift] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:05.346250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1474a2-8c8e-41a5-bb23-caba9971f120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:05.346852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1474a2-8c8e-41a5-bb23-caba9971f120 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:05.347136 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1474a2-8c8e-41a5-bb23-caba9971f120 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:05.347889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1474a2-8c8e-41a5-bb23-caba9971f120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:05.349935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8a1474a2-8c8e-41a5-bb23-caba9971f120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:05.362517 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1474a2-8c8e-41a5-bb23-caba9971f120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:05.364576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1474a2-8c8e-41a5-bb23-caba9971f120 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:05.375363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1263/2521] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:08.893923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294d644-58c6-41af-acb4-73029d6904c4 service nova] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:08.895833 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f294d644-58c6-41af-acb4-73029d6904c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:08.912365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294d644-58c6-41af-acb4-73029d6904c4 service nova] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:08.919347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c321387-031c-46dc-9b8d-1675d16e88e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b918da0f83754f3887de1cfa2e4df028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:08.919942 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c321387-031c-46dc-9b8d-1675d16e88e3 service placement] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:08.920223 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c321387-031c-46dc-9b8d-1675d16e88e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:08.920523 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c321387-031c-46dc-9b8d-1675d16e88e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:08.922809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3c321387-031c-46dc-9b8d-1675d16e88e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:08.937221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c321387-031c-46dc-9b8d-1675d16e88e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:08.938808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c321387-031c-46dc-9b8d-1675d16e88e3 service placement] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:08.950890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1259/2522] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:08.976022 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1474a2-8c8e-41a5-bb23-caba9971f120 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:08.977568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8a1474a2-8c8e-41a5-bb23-caba9971f120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:08.991414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1474a2-8c8e-41a5-bb23-caba9971f120 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:08.996285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514508b-5e22-48ce-95d6-e1ce957dcd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:08.996978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514508b-5e22-48ce-95d6-e1ce957dcd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:08.997476 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514508b-5e22-48ce-95d6-e1ce957dcd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:08.997753 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514508b-5e22-48ce-95d6-e1ce957dcd3e admin admin] PATH_INFO: `/v3/users/1beb3cf542bf4cc1802f90ad14a29017` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:08.998995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514508b-5e22-48ce-95d6-e1ce957dcd3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1beb3cf542bf4cc1802f90ad14a29017)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:09.000986 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514508b-5e22-48ce-95d6-e1ce957dcd3e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:09.054704 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0514508b-5e22-48ce-95d6-e1ce957dcd3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1beb3cf542bf4cc1802f90ad14a29017'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:09.063879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0514508b-5e22-48ce-95d6-e1ce957dcd3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1beb3cf542bf4cc1802f90ad14a29017'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:09.081321 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0514508b-5e22-48ce-95d6-e1ce957dcd3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1beb3cf542bf4cc1802f90ad14a29017'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:09.082170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0514508b-5e22-48ce-95d6-e1ce957dcd3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1beb3cf542bf4cc1802f90ad14a29017'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:09.082825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0514508b-5e22-48ce-95d6-e1ce957dcd3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1beb3cf542bf4cc1802f90ad14a29017'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:09.098255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1264/2523] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:08 2022] DELETE /identity/v3/users/1beb3cf542bf4cc1802f90ad14a29017 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:09.305436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c321387-031c-46dc-9b8d-1675d16e88e3 service placement] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:09.327253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c321387-031c-46dc-9b8d-1675d16e88e3 service placement] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:09.404802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:09.405441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:09.405720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:09.405981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37 admin admin] PATH_INFO: `/v3/projects/ec32dc853885457aafd2575f77d8bdd0` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:09.407365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec32dc853885457aafd2575f77d8bdd0)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:09.409310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:09.464579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec32dc853885457aafd2575f77d8bdd0', 'request_id': 'req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:09.473959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec32dc853885457aafd2575f77d8bdd0', 'request_id': 'req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:09.480039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec32dc853885457aafd2575f77d8bdd0', 'request_id': 'req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:09.492674 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37 admin admin] The token cache is being invalidate because project ec32dc853885457aafd2575f77d8bdd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:09.493069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:09.493729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-88ddcb9d-21df-4a35-8fa5-8ea87625fd37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:09.495231 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1260/2524] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:09 2022] DELETE /identity/v3/projects/ec32dc853885457aafd2575f77d8bdd0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:09.500405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065d7d7-28cd-4c6e-890a-db11092318e2 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:09.500703 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065d7d7-28cd-4c6e-890a-db11092318e2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:09.501000 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065d7d7-28cd-4c6e-890a-db11092318e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:09.532729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b065d7d7-28cd-4c6e-890a-db11092318e2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:09.533943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b065d7d7-28cd-4c6e-890a-db11092318e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:09.596015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1265/2525] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:09.604040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a495a5-6e2f-435e-a940-2872ef23acf9 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:09.605311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a495a5-6e2f-435e-a940-2872ef23acf9 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:09.605311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a495a5-6e2f-435e-a940-2872ef23acf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:09.625896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-91a495a5-6e2f-435e-a940-2872ef23acf9 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:09.627133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-91a495a5-6e2f-435e-a940-2872ef23acf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:09.635798 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1261/2526] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:09.641097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065d7d7-28cd-4c6e-890a-db11092318e2 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:09.657443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065d7d7-28cd-4c6e-890a-db11092318e2 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:09.665145 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae0dcc-f6c9-4053-b841-953a34c2b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:09.666067 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae0dcc-f6c9-4053-b841-953a34c2b5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:09.666490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae0dcc-f6c9-4053-b841-953a34c2b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:09.666919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae0dcc-f6c9-4053-b841-953a34c2b5e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:09.667961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae0dcc-f6c9-4053-b841-953a34c2b5e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:17:09.668417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae0dcc-f6c9-4053-b841-953a34c2b5e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:09.671072 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae0dcc-f6c9-4053-b841-953a34c2b5e2 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:09.689210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1266/2527] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:17:09.694673 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a495a5-6e2f-435e-a940-2872ef23acf9 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:09.704415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a495a5-6e2f-435e-a940-2872ef23acf9 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:09.709299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a11ec-d127-42b5-a583-918a7f2502f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:09.709911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a11ec-d127-42b5-a583-918a7f2502f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:09.710194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a11ec-d127-42b5-a583-918a7f2502f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:09.710470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a11ec-d127-42b5-a583-918a7f2502f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:09.711124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a11ec-d127-42b5-a583-918a7f2502f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:09.713073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a11ec-d127-42b5-a583-918a7f2502f7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:09.743291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1262/2528] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:09 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:09.747725 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae0dcc-f6c9-4053-b841-953a34c2b5e2 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:09.758687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae0dcc-f6c9-4053-b841-953a34c2b5e2 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:09.806268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:09.820825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb484f93-7c45-4ddf-811b-a001edf5660e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:09.821439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb484f93-7c45-4ddf-811b-a001edf5660e admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:09.821718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb484f93-7c45-4ddf-811b-a001edf5660e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:09.821990 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb484f93-7c45-4ddf-811b-a001edf5660e admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:09.822640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb484f93-7c45-4ddf-811b-a001edf5660e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:09.824617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb484f93-7c45-4ddf-811b-a001edf5660e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:09.846764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1267/2529] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:09 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:09.851567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a11ec-d127-42b5-a583-918a7f2502f7 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:09.862030 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a11ec-d127-42b5-a583-918a7f2502f7 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:09.867404 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025048ff-7252-4e0f-8b05-95fb365e69ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:09.868016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025048ff-7252-4e0f-8b05-95fb365e69ce admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:09.868299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025048ff-7252-4e0f-8b05-95fb365e69ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:09.868572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025048ff-7252-4e0f-8b05-95fb365e69ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:09.869254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025048ff-7252-4e0f-8b05-95fb365e69ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:09.870845 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025048ff-7252-4e0f-8b05-95fb365e69ce admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:09.881725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1263/2530] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:09.886066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb484f93-7c45-4ddf-811b-a001edf5660e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:09.897218 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb484f93-7c45-4ddf-811b-a001edf5660e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:09.902036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb27e7-3ece-454b-a111-4cc672eb900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:09.902647 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb27e7-3ece-454b-a111-4cc672eb900f admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:09.902924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb27e7-3ece-454b-a111-4cc672eb900f admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:09.903194 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb27e7-3ece-454b-a111-4cc672eb900f admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:09.903839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb27e7-3ece-454b-a111-4cc672eb900f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:09.905510 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb27e7-3ece-454b-a111-4cc672eb900f admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:09.918155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1268/2531] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:09.923127 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025048ff-7252-4e0f-8b05-95fb365e69ce admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:09.935516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025048ff-7252-4e0f-8b05-95fb365e69ce admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:09.940385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d97c74-316d-4ffb-8293-860d8bd040e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:09.941572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d97c74-316d-4ffb-8293-860d8bd040e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:09.941856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d97c74-316d-4ffb-8293-860d8bd040e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:09.942136 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d97c74-316d-4ffb-8293-860d8bd040e4 admin admin] PATH_INFO: `/v3/projects/d27fcac3aae14a54a73f76d62284caee/users/8b9ea5c0f33143d0bb186363eec0da3e/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:09.958639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d97c74-316d-4ffb-8293-860d8bd040e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27fcac3aae14a54a73f76d62284caee, user_id=8b9ea5c0f33143d0bb186363eec0da3e, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:09.961440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d97c74-316d-4ffb-8293-860d8bd040e4 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:09.978756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1264/2532] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:09 2022] PUT /identity/v3/projects/d27fcac3aae14a54a73f76d62284caee/users/8b9ea5c0f33143d0bb186363eec0da3e/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:09.990229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a55c4-e02f-4a47-aa4d-f6d6a093574a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:09.990767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a55c4-e02f-4a47-aa4d-f6d6a093574a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:09.990767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a55c4-e02f-4a47-aa4d-f6d6a093574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:10.024146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-7f2a55c4-e02f-4a47-aa4d-f6d6a093574a None None] MFA Rules not processed for user `8b9ea5c0f33143d0bb186363eec0da3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:10.025426 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7f2a55c4-e02f-4a47-aa4d-f6d6a093574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:10.100553 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1269/2533] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:17:10.112522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d97c74-316d-4ffb-8293-860d8bd040e4 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:10.114871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a9d97c74-316d-4ffb-8293-860d8bd040e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:10.133712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:10.200888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d97c74-316d-4ffb-8293-860d8bd040e4 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:10.206392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9c376-af4b-4ce0-85eb-cb2f06beb338 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:10.208164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9c376-af4b-4ce0-85eb-cb2f06beb338 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:10.208436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9c376-af4b-4ce0-85eb-cb2f06beb338 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:10.208765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9c376-af4b-4ce0-85eb-cb2f06beb338 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:10.218813 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9c376-af4b-4ce0-85eb-cb2f06beb338 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:10.220962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9c376-af4b-4ce0-85eb-cb2f06beb338 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:10.232237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1265/2534] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:10.464301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a55c4-e02f-4a47-aa4d-f6d6a093574a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:10.530026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a55c4-e02f-4a47-aa4d-f6d6a093574a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:10.534889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:10.535560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:10.535908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:10.536187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] PATH_INFO: `/v3/users/8b9ea5c0f33143d0bb186363eec0da3e` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:10.537360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9ea5c0f33143d0bb186363eec0da3e)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:10.539309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:10.594920 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9ea5c0f33143d0bb186363eec0da3e'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:10.603460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9ea5c0f33143d0bb186363eec0da3e'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:10.605501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:10.619119 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9ea5c0f33143d0bb186363eec0da3e'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:10.620191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9ea5c0f33143d0bb186363eec0da3e'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:10.621169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9ea5c0f33143d0bb186363eec0da3e'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:10.637198 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1270/2535] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:10 2022] DELETE /identity/v3/users/8b9ea5c0f33143d0bb186363eec0da3e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:10.641961 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471cfcf-1e6b-4eb5-b7f9-1c91c0b3cb01 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:10.642249 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471cfcf-1e6b-4eb5-b7f9-1c91c0b3cb01 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:10.642524 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471cfcf-1e6b-4eb5-b7f9-1c91c0b3cb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:10.663787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f471cfcf-1e6b-4eb5-b7f9-1c91c0b3cb01 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:10.665062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f471cfcf-1e6b-4eb5-b7f9-1c91c0b3cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:10.735502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1266/2536] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:17:10.745166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:10.746567 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:10.807780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a246-4d93-4bb5-92b7-6074b7e3c0da admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:10.811628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bf9bd-06bd-4eaa-a94a-17486911ced2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:10.812229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf9bd-06bd-4eaa-a94a-17486911ced2 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:10.812506 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf9bd-06bd-4eaa-a94a-17486911ced2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:10.812812 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf9bd-06bd-4eaa-a94a-17486911ced2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:10.822811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bf9bd-06bd-4eaa-a94a-17486911ced2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:10.824250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bf9bd-06bd-4eaa-a94a-17486911ced2 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:10.834390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1271/2537] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:11.128113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471cfcf-1e6b-4eb5-b7f9-1c91c0b3cb01 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:11.130915 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f471cfcf-1e6b-4eb5-b7f9-1c91c0b3cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:11.143502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471cfcf-1e6b-4eb5-b7f9-1c91c0b3cb01 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:11.148236 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:11.148934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:11.149214 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:11.149488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a admin admin] PATH_INFO: `/v3/projects/d27fcac3aae14a54a73f76d62284caee` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:11.150638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27fcac3aae14a54a73f76d62284caee)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:11.152558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:11.209661 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27fcac3aae14a54a73f76d62284caee', 'request_id': 'req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:11.219997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27fcac3aae14a54a73f76d62284caee', 'request_id': 'req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:11.228597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27fcac3aae14a54a73f76d62284caee', 'request_id': 'req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:11.246577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a admin admin] The token cache is being invalidate because project d27fcac3aae14a54a73f76d62284caee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:11.246773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:11.247430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-a8413ef0-c805-4fc7-90cb-c0e1990c2f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:11.248954 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1267/2538] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:11 2022] DELETE /identity/v3/projects/d27fcac3aae14a54a73f76d62284caee => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:11.253903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450f21a-a887-49e0-a5c0-ec50f58b2962 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:11.254497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450f21a-a887-49e0-a5c0-ec50f58b2962 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:11.254497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450f21a-a887-49e0-a5c0-ec50f58b2962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:11.274895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-4450f21a-a887-49e0-a5c0-ec50f58b2962 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:11.276125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4450f21a-a887-49e0-a5c0-ec50f58b2962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:11.339683 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1272/2539] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:11.348452 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c444b47-d8e1-4a1f-8942-3150f9ae6317 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:11.348795 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c444b47-d8e1-4a1f-8942-3150f9ae6317 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:11.349052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c444b47-d8e1-4a1f-8942-3150f9ae6317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:11.371166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-6c444b47-d8e1-4a1f-8942-3150f9ae6317 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:11.372541 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6c444b47-d8e1-4a1f-8942-3150f9ae6317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:11.381099 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1268/2540] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:17:11.385554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450f21a-a887-49e0-a5c0-ec50f58b2962 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:11.396868 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450f21a-a887-49e0-a5c0-ec50f58b2962 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:11.401523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960e029-8180-432d-9a56-bf8db97c1651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:11.402122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960e029-8180-432d-9a56-bf8db97c1651 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:11.402398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960e029-8180-432d-9a56-bf8db97c1651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:11.402665 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960e029-8180-432d-9a56-bf8db97c1651 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:11.403471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960e029-8180-432d-9a56-bf8db97c1651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:17:11.403770 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960e029-8180-432d-9a56-bf8db97c1651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:11.405409 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960e029-8180-432d-9a56-bf8db97c1651 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:11.418981 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1273/2541] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:17:11.427424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c444b47-d8e1-4a1f-8942-3150f9ae6317 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:11.438566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c444b47-d8e1-4a1f-8942-3150f9ae6317 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:11.444227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41943557-4749-4bfc-9334-aad2c8b6998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:11.444876 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41943557-4749-4bfc-9334-aad2c8b6998b admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:11.445160 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41943557-4749-4bfc-9334-aad2c8b6998b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:11.445433 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41943557-4749-4bfc-9334-aad2c8b6998b admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:11.446071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41943557-4749-4bfc-9334-aad2c8b6998b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:11.448648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41943557-4749-4bfc-9334-aad2c8b6998b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:11.464754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:11.480531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1269/2542] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:11 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:11.485267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960e029-8180-432d-9a56-bf8db97c1651 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:11.496249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960e029-8180-432d-9a56-bf8db97c1651 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:11.554691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5102ce-5927-42f9-bff8-6009697bd6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:11.555191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5102ce-5927-42f9-bff8-6009697bd6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:11.555472 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5102ce-5927-42f9-bff8-6009697bd6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:11.555746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5102ce-5927-42f9-bff8-6009697bd6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:11.556403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5102ce-5927-42f9-bff8-6009697bd6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:11.558402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5102ce-5927-42f9-bff8-6009697bd6d5 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:11.569793 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:11.584355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1274/2543] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:11 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:11.588797 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41943557-4749-4bfc-9334-aad2c8b6998b admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:11.601219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41943557-4749-4bfc-9334-aad2c8b6998b admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:11.605924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e2b8-6042-44e2-b385-7a8655dce9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:11.606536 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e2b8-6042-44e2-b385-7a8655dce9ab admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:11.606817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e2b8-6042-44e2-b385-7a8655dce9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:11.607091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e2b8-6042-44e2-b385-7a8655dce9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:11.607743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5e2b8-6042-44e2-b385-7a8655dce9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:11.609413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5e2b8-6042-44e2-b385-7a8655dce9ab admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:11.625288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1270/2544] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:11.627128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5102ce-5927-42f9-bff8-6009697bd6d5 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:11.638025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5102ce-5927-42f9-bff8-6009697bd6d5 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:11.642967 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1cbca-1425-4f71-a23b-068174209651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:11.643579 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1cbca-1425-4f71-a23b-068174209651 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:11.643864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1cbca-1425-4f71-a23b-068174209651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:11.644882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1cbca-1425-4f71-a23b-068174209651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:11.645307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1cbca-1425-4f71-a23b-068174209651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:11.646940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1cbca-1425-4f71-a23b-068174209651 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:11.658702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1275/2545] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:17:11.663651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e2b8-6042-44e2-b385-7a8655dce9ab admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:11.674118 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e2b8-6042-44e2-b385-7a8655dce9ab admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:11.680262 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b87dd-8612-49f9-9b31-5ddf7297c759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:11.680974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b87dd-8612-49f9-9b31-5ddf7297c759 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:11.681250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b87dd-8612-49f9-9b31-5ddf7297c759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:11.681533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b87dd-8612-49f9-9b31-5ddf7297c759 admin admin] PATH_INFO: `/v3/projects/29b7fa06ad024c6e91b7922c05f40773/users/38eefee5c7dc43e39fcb8ab1c619e0b4/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:11.697668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b87dd-8612-49f9-9b31-5ddf7297c759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b7fa06ad024c6e91b7922c05f40773, user_id=38eefee5c7dc43e39fcb8ab1c619e0b4, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:11.700358 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b87dd-8612-49f9-9b31-5ddf7297c759 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:11.715816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1271/2546] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:11 2022] PUT /identity/v3/projects/29b7fa06ad024c6e91b7922c05f40773/users/38eefee5c7dc43e39fcb8ab1c619e0b4/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:11.727633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d128e-02c3-4bf2-bab0-3615d04bd7e4 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:11.727921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d128e-02c3-4bf2-bab0-3615d04bd7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:11.728248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d128e-02c3-4bf2-bab0-3615d04bd7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:11.757995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-547d128e-02c3-4bf2-bab0-3615d04bd7e4 None None] MFA Rules not processed for user `38eefee5c7dc43e39fcb8ab1c619e0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:11.759231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-547d128e-02c3-4bf2-bab0-3615d04bd7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:11.840843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1276/2547] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:11.845433 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b87dd-8612-49f9-9b31-5ddf7297c759 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:11.914770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b87dd-8612-49f9-9b31-5ddf7297c759 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:11.919898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf8dfd-0cb2-45b6-b205-8e0708fa3c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:11.920514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf8dfd-0cb2-45b6-b205-8e0708fa3c2a admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:11.920830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf8dfd-0cb2-45b6-b205-8e0708fa3c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:11.921128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf8dfd-0cb2-45b6-b205-8e0708fa3c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:11.921761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf8dfd-0cb2-45b6-b205-8e0708fa3c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:11.923662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf8dfd-0cb2-45b6-b205-8e0708fa3c2a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:11.955390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1272/2548] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:11 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:17:11.957530 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d128e-02c3-4bf2-bab0-3615d04bd7e4 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:11.969015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d128e-02c3-4bf2-bab0-3615d04bd7e4 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:12.039891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88827c-389e-45b1-9b75-43b613796970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:12.040518 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88827c-389e-45b1-9b75-43b613796970 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:12.040832 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88827c-389e-45b1-9b75-43b613796970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:12.041110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88827c-389e-45b1-9b75-43b613796970 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:12.041755 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88827c-389e-45b1-9b75-43b613796970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:12.043707 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88827c-389e-45b1-9b75-43b613796970 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:12.069369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1277/2549] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:11 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:12.073780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf8dfd-0cb2-45b6-b205-8e0708fa3c2a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:12.086975 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf8dfd-0cb2-45b6-b205-8e0708fa3c2a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:12.092138 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea2e12-89df-4ccb-8df8-ff5fe5bbe480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:12.092712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea2e12-89df-4ccb-8df8-ff5fe5bbe480 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:12.093012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea2e12-89df-4ccb-8df8-ff5fe5bbe480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:12.093293 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea2e12-89df-4ccb-8df8-ff5fe5bbe480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:12.093944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea2e12-89df-4ccb-8df8-ff5fe5bbe480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:12.095625 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea2e12-89df-4ccb-8df8-ff5fe5bbe480 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:12.106913 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1273/2550] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:12.111253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88827c-389e-45b1-9b75-43b613796970 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:12.122639 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88827c-389e-45b1-9b75-43b613796970 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:12.127301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbe4bd-6262-4703-83ec-7fcc41200ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:12.127975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbe4bd-6262-4703-83ec-7fcc41200ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:12.128256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbe4bd-6262-4703-83ec-7fcc41200ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:12.129072 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbe4bd-6262-4703-83ec-7fcc41200ac9 admin admin] PATH_INFO: `/v3/projects/6dc6ceacb26149a5b1bf40f498d90178/users/e20a32a7a55c42009340d7b16482696e/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:12.146301 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbe4bd-6262-4703-83ec-7fcc41200ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc6ceacb26149a5b1bf40f498d90178, user_id=e20a32a7a55c42009340d7b16482696e, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:12.149068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbe4bd-6262-4703-83ec-7fcc41200ac9 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:12.165341 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1278/2551] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:12 2022] PUT /identity/v3/projects/6dc6ceacb26149a5b1bf40f498d90178/users/e20a32a7a55c42009340d7b16482696e/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:12.169564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea2e12-89df-4ccb-8df8-ff5fe5bbe480 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:12.180027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea2e12-89df-4ccb-8df8-ff5fe5bbe480 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:12.238522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efe057-8e8c-4109-a4e0-f93d1f45ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:12.239138 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efe057-8e8c-4109-a4e0-f93d1f45ca6f admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:12.239420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efe057-8e8c-4109-a4e0-f93d1f45ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:12.239691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efe057-8e8c-4109-a4e0-f93d1f45ca6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:12.240323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efe057-8e8c-4109-a4e0-f93d1f45ca6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:12.241950 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efe057-8e8c-4109-a4e0-f93d1f45ca6f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:12.252301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1274/2552] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:12.258009 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbe4bd-6262-4703-83ec-7fcc41200ac9 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:12.268583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbe4bd-6262-4703-83ec-7fcc41200ac9 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:12.274465 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd4692-ed70-41cc-96de-d07f746a282c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:12.275125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd4692-ed70-41cc-96de-d07f746a282c admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:12.275403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd4692-ed70-41cc-96de-d07f746a282c admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:12.275674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd4692-ed70-41cc-96de-d07f746a282c admin admin] PATH_INFO: `/v3/projects/6dc6ceacb26149a5b1bf40f498d90178/users/e20a32a7a55c42009340d7b16482696e/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:12.277604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd4692-ed70-41cc-96de-d07f746a282c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc6ceacb26149a5b1bf40f498d90178, user_id=e20a32a7a55c42009340d7b16482696e, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:12.280231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd4692-ed70-41cc-96de-d07f746a282c admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:12.292017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1279/2553] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:12 2022] PUT /identity/v3/projects/6dc6ceacb26149a5b1bf40f498d90178/users/e20a32a7a55c42009340d7b16482696e/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:17:12.304238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061159ae-59a7-4c9f-a166-c61fd7050a1b None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:12.304523 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061159ae-59a7-4c9f-a166-c61fd7050a1b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:12.304839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061159ae-59a7-4c9f-a166-c61fd7050a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:12.334071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-061159ae-59a7-4c9f-a166-c61fd7050a1b None None] MFA Rules not processed for user `e20a32a7a55c42009340d7b16482696e`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:12.335291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-061159ae-59a7-4c9f-a166-c61fd7050a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:12.352303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:12.408109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1275/2554] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:12.421760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd4692-ed70-41cc-96de-d07f746a282c admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:12.424290 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-5bfd4692-ed70-41cc-96de-d07f746a282c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:12.461722 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:12.496491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd4692-ed70-41cc-96de-d07f746a282c admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:12.500528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd8947-494b-421f-9435-36dfbaa65d3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:12.501298 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8947-494b-421f-9435-36dfbaa65d3a service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:12.501583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8947-494b-421f-9435-36dfbaa65d3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:12.501853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8947-494b-421f-9435-36dfbaa65d3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:12.513223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd8947-494b-421f-9435-36dfbaa65d3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:12.514734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd8947-494b-421f-9435-36dfbaa65d3a service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:12.525279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1280/2555] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:12.984804 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061159ae-59a7-4c9f-a166-c61fd7050a1b None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:13.057276 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061159ae-59a7-4c9f-a166-c61fd7050a1b None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:13.061932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:13.062572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:13.062851 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:13.063128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] PATH_INFO: `/v3/users/38eefee5c7dc43e39fcb8ab1c619e0b4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:13.064255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38eefee5c7dc43e39fcb8ab1c619e0b4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:13.066966 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:13.116899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38eefee5c7dc43e39fcb8ab1c619e0b4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.124918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38eefee5c7dc43e39fcb8ab1c619e0b4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.125535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38eefee5c7dc43e39fcb8ab1c619e0b4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.126161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38eefee5c7dc43e39fcb8ab1c619e0b4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.139716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38eefee5c7dc43e39fcb8ab1c619e0b4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.152199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1276/2556] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:12 2022] DELETE /identity/v3/users/38eefee5c7dc43e39fcb8ab1c619e0b4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:13.156971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37becaeb-a2bf-4888-b0b5-0c9d22a8d8cf None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:13.157259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37becaeb-a2bf-4888-b0b5-0c9d22a8d8cf None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:13.157536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37becaeb-a2bf-4888-b0b5-0c9d22a8d8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:13.178428 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-37becaeb-a2bf-4888-b0b5-0c9d22a8d8cf None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:13.179653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-37becaeb-a2bf-4888-b0b5-0c9d22a8d8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:13.250283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1281/2557] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:13.260981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:13.262412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:13.304817 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:13.330612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e2610-47b6-4f5a-a4fa-c6a88597935e admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:13.334799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f1832-1019-407b-801f-0cd355901b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:13.335410 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f1832-1019-407b-801f-0cd355901b4d service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:13.335765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f1832-1019-407b-801f-0cd355901b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:13.335972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f1832-1019-407b-801f-0cd355901b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:13.346872 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f1832-1019-407b-801f-0cd355901b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:13.348340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f1832-1019-407b-801f-0cd355901b4d service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:13.358504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1277/2558] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:13.650381 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37becaeb-a2bf-4888-b0b5-0c9d22a8d8cf None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:13.651875 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-37becaeb-a2bf-4888-b0b5-0c9d22a8d8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:13.666032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37becaeb-a2bf-4888-b0b5-0c9d22a8d8cf None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:13.670964 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:13.671607 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:13.672020 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:13.672302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] PATH_INFO: `/v3/projects/29b7fa06ad024c6e91b7922c05f40773` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:13.673492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b7fa06ad024c6e91b7922c05f40773)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:13.676881 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:13.737777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b7fa06ad024c6e91b7922c05f40773', 'request_id': 'req-3d775f00-786d-4a65-b2a9-dd76c68c89ab'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.745246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b7fa06ad024c6e91b7922c05f40773', 'request_id': 'req-3d775f00-786d-4a65-b2a9-dd76c68c89ab'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.753053 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b7fa06ad024c6e91b7922c05f40773', 'request_id': 'req-3d775f00-786d-4a65-b2a9-dd76c68c89ab'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.765990 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] The token cache is being invalidate because project 29b7fa06ad024c6e91b7922c05f40773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:13.766285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.766940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.768415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1282/2559] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:13 2022] DELETE /identity/v3/projects/29b7fa06ad024c6e91b7922c05f40773 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:17:13.772580 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f1832-1019-407b-801f-0cd355901b4d service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:13.791329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f1832-1019-407b-801f-0cd355901b4d service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:13.856580 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75479db4-2033-4091-af69-86c16b0ba48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:13.857509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75479db4-2033-4091-af69-86c16b0ba48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:13.857785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75479db4-2033-4091-af69-86c16b0ba48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:13.858389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75479db4-2033-4091-af69-86c16b0ba48d admin admin] PATH_INFO: `/v3/users/e20a32a7a55c42009340d7b16482696e` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:13.859534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75479db4-2033-4091-af69-86c16b0ba48d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20a32a7a55c42009340d7b16482696e)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:13.861533 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75479db4-2033-4091-af69-86c16b0ba48d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:13.920849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-75479db4-2033-4091-af69-86c16b0ba48d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20a32a7a55c42009340d7b16482696e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.929394 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-75479db4-2033-4091-af69-86c16b0ba48d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20a32a7a55c42009340d7b16482696e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.930000 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-75479db4-2033-4091-af69-86c16b0ba48d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20a32a7a55c42009340d7b16482696e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.930642 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-75479db4-2033-4091-af69-86c16b0ba48d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20a32a7a55c42009340d7b16482696e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.944568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-75479db4-2033-4091-af69-86c16b0ba48d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20a32a7a55c42009340d7b16482696e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:13.959374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1278/2560] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:13 2022] DELETE /identity/v3/users/e20a32a7a55c42009340d7b16482696e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:14.281479 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:14.282949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:14.299710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d775f00-786d-4a65-b2a9-dd76c68c89ab admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:14.352619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:14.365117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225917b-1b8d-420e-8a41-ad74e552c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:14.365765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225917b-1b8d-420e-8a41-ad74e552c951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:14.366212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225917b-1b8d-420e-8a41-ad74e552c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:14.366484 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225917b-1b8d-420e-8a41-ad74e552c951 admin admin] PATH_INFO: `/v3/projects/6dc6ceacb26149a5b1bf40f498d90178` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:14.367611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225917b-1b8d-420e-8a41-ad74e552c951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc6ceacb26149a5b1bf40f498d90178)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:14.369582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225917b-1b8d-420e-8a41-ad74e552c951 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:14.437391 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4225917b-1b8d-420e-8a41-ad74e552c951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc6ceacb26149a5b1bf40f498d90178', 'request_id': 'req-4225917b-1b8d-420e-8a41-ad74e552c951'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:14.444511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4225917b-1b8d-420e-8a41-ad74e552c951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc6ceacb26149a5b1bf40f498d90178', 'request_id': 'req-4225917b-1b8d-420e-8a41-ad74e552c951'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:14.453404 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4225917b-1b8d-420e-8a41-ad74e552c951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc6ceacb26149a5b1bf40f498d90178', 'request_id': 'req-4225917b-1b8d-420e-8a41-ad74e552c951'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:14.465881 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4225917b-1b8d-420e-8a41-ad74e552c951 admin admin] The token cache is being invalidate because project 6dc6ceacb26149a5b1bf40f498d90178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:14.466165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4225917b-1b8d-420e-8a41-ad74e552c951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:14.466824 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4225917b-1b8d-420e-8a41-ad74e552c951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:14.468578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1283/2561] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:14 2022] DELETE /identity/v3/projects/6dc6ceacb26149a5b1bf40f498d90178 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:14.476720 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27568f-3044-4cac-9158-c042debe49b6 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:14.477218 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27568f-3044-4cac-9158-c042debe49b6 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:14.477422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27568f-3044-4cac-9158-c042debe49b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:14.501585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-5c27568f-3044-4cac-9158-c042debe49b6 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:14.502932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5c27568f-3044-4cac-9158-c042debe49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:14.554311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:14.572246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1279/2562] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:14.580347 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8c30-01d0-4c08-a3b9-4aaebfe94b51 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:14.580661 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8c30-01d0-4c08-a3b9-4aaebfe94b51 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:14.580971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8c30-01d0-4c08-a3b9-4aaebfe94b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:14.602131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b7ba8c30-01d0-4c08-a3b9-4aaebfe94b51 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:14.603360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b7ba8c30-01d0-4c08-a3b9-4aaebfe94b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:14.611536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1284/2563] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:14.616703 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27568f-3044-4cac-9158-c042debe49b6 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:14.626571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27568f-3044-4cac-9158-c042debe49b6 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:14.631744 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204317c-7565-409e-bf6b-ca95477fbda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:14.632349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204317c-7565-409e-bf6b-ca95477fbda3 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:14.632630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204317c-7565-409e-bf6b-ca95477fbda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:14.632939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204317c-7565-409e-bf6b-ca95477fbda3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:14.633613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204317c-7565-409e-bf6b-ca95477fbda3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:17:14.633916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204317c-7565-409e-bf6b-ca95477fbda3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:14.635727 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204317c-7565-409e-bf6b-ca95477fbda3 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:14.649955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1280/2564] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:17:14.654641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba8c30-01d0-4c08-a3b9-4aaebfe94b51 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:14.665611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba8c30-01d0-4c08-a3b9-4aaebfe94b51 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:14.670325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d0e5d-bf59-41b3-a000-789516281192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:14.670934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d0e5d-bf59-41b3-a000-789516281192 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:14.671213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d0e5d-bf59-41b3-a000-789516281192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:14.671484 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d0e5d-bf59-41b3-a000-789516281192 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:14.672136 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d0e5d-bf59-41b3-a000-789516281192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:14.674087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d0e5d-bf59-41b3-a000-789516281192 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:14.705220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1285/2565] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:14 2022] POST /identity/v3/projects => generated 355 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:14.710414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204317c-7565-409e-bf6b-ca95477fbda3 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:14.721418 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204317c-7565-409e-bf6b-ca95477fbda3 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:14.807640 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad9912-ba0d-46bd-b6e4-6bce825f8157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:14.808283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad9912-ba0d-46bd-b6e4-6bce825f8157 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:14.808562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad9912-ba0d-46bd-b6e4-6bce825f8157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:14.808866 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad9912-ba0d-46bd-b6e4-6bce825f8157 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:14.809496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad9912-ba0d-46bd-b6e4-6bce825f8157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:14.811403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad9912-ba0d-46bd-b6e4-6bce825f8157 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:14.840600 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1281/2566] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:14 2022] POST /identity/v3/users => generated 278 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:14.841893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d0e5d-bf59-41b3-a000-789516281192 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:14.854111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d0e5d-bf59-41b3-a000-789516281192 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:14.859519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b89ad-17da-45d5-818b-42a94cbc9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:14.860393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b89ad-17da-45d5-818b-42a94cbc9556 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:14.860931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b89ad-17da-45d5-818b-42a94cbc9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:14.861367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b89ad-17da-45d5-818b-42a94cbc9556 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:14.862432 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b89ad-17da-45d5-818b-42a94cbc9556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:14.865561 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b89ad-17da-45d5-818b-42a94cbc9556 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:14.881513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1286/2567] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:14.886752 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad9912-ba0d-46bd-b6e4-6bce825f8157 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:14.900061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad9912-ba0d-46bd-b6e4-6bce825f8157 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:14.905505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e0278-2107-4109-8b4a-61cc4acf99f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:14.906369 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e0278-2107-4109-8b4a-61cc4acf99f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:14.906649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e0278-2107-4109-8b4a-61cc4acf99f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:14.906921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e0278-2107-4109-8b4a-61cc4acf99f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:14.907564 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e0278-2107-4109-8b4a-61cc4acf99f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:14.909174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e0278-2107-4109-8b4a-61cc4acf99f9 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:14.925779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1282/2568] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:17:14.927118 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b89ad-17da-45d5-818b-42a94cbc9556 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:14.937895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b89ad-17da-45d5-818b-42a94cbc9556 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:14.943474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d69afd-efdd-4168-8f85-532d9dca8190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:14.944131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d69afd-efdd-4168-8f85-532d9dca8190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:14.944413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d69afd-efdd-4168-8f85-532d9dca8190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:14.944714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d69afd-efdd-4168-8f85-532d9dca8190 admin admin] PATH_INFO: `/v3/projects/71be823baeea48079e5d27917317741e/users/1c7e487649d844dc80f1d47b180e4a58/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:14.962609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d69afd-efdd-4168-8f85-532d9dca8190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71be823baeea48079e5d27917317741e, user_id=1c7e487649d844dc80f1d47b180e4a58, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:14.965491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d69afd-efdd-4168-8f85-532d9dca8190 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:14.981590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1287/2569] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:14 2022] PUT /identity/v3/projects/71be823baeea48079e5d27917317741e/users/1c7e487649d844dc80f1d47b180e4a58/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:14.995177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebbe05-863b-4f12-8afc-ead0eb1447a2 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:14.995633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebbe05-863b-4f12-8afc-ead0eb1447a2 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:14.996020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebbe05-863b-4f12-8afc-ead0eb1447a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:15.039605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-96ebbe05-863b-4f12-8afc-ead0eb1447a2 None None] MFA Rules not processed for user `1c7e487649d844dc80f1d47b180e4a58`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:15.045711 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-96ebbe05-863b-4f12-8afc-ead0eb1447a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:15.122767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1283/2570] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:15.127909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d69afd-efdd-4168-8f85-532d9dca8190 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:15.197278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d69afd-efdd-4168-8f85-532d9dca8190 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:15.202563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d137c-70c4-42bd-aab5-e183b875d83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:15.203205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d137c-70c4-42bd-aab5-e183b875d83d admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:15.203456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d137c-70c4-42bd-aab5-e183b875d83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:15.203733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d137c-70c4-42bd-aab5-e183b875d83d admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:15.204382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d137c-70c4-42bd-aab5-e183b875d83d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:15.206366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d137c-70c4-42bd-aab5-e183b875d83d admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:15.237026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1288/2571] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:15 2022] POST /identity/v3/projects => generated 357 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:15.241638 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebbe05-863b-4f12-8afc-ead0eb1447a2 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:15.253003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebbe05-863b-4f12-8afc-ead0eb1447a2 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:15.323471 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:15.335419 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf701ea6-6c06-4f63-9dfa-958dc3343e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:15.336034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf701ea6-6c06-4f63-9dfa-958dc3343e61 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:15.336311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf701ea6-6c06-4f63-9dfa-958dc3343e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:15.336582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf701ea6-6c06-4f63-9dfa-958dc3343e61 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:15.337244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf701ea6-6c06-4f63-9dfa-958dc3343e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:15.339448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf701ea6-6c06-4f63-9dfa-958dc3343e61 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:15.363850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1284/2572] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:15 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:15.367853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d137c-70c4-42bd-aab5-e183b875d83d admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:15.373565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:15.379913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d137c-70c4-42bd-aab5-e183b875d83d admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:15.386092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb91b-85e9-41fc-9732-ef482ed7e23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:15.386709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb91b-85e9-41fc-9732-ef482ed7e23e admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:15.386989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb91b-85e9-41fc-9732-ef482ed7e23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:15.387264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb91b-85e9-41fc-9732-ef482ed7e23e admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:15.387913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdb91b-85e9-41fc-9732-ef482ed7e23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:15.389587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdb91b-85e9-41fc-9732-ef482ed7e23e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:15.401504 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1289/2573] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:15.414207 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf701ea6-6c06-4f63-9dfa-958dc3343e61 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:15.424891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf701ea6-6c06-4f63-9dfa-958dc3343e61 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:15.430219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2bae3-ebd4-4eab-826c-64926161a5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:15.430896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2bae3-ebd4-4eab-826c-64926161a5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:15.431175 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2bae3-ebd4-4eab-826c-64926161a5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:15.431449 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2bae3-ebd4-4eab-826c-64926161a5eb admin admin] PATH_INFO: `/v3/projects/3a6c20e6ad6e4944b13f6618e290b354/users/dc70e85b1632498ea233e77264aa7b69/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:15.454318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2bae3-ebd4-4eab-826c-64926161a5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6c20e6ad6e4944b13f6618e290b354, user_id=dc70e85b1632498ea233e77264aa7b69, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:15.457062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2bae3-ebd4-4eab-826c-64926161a5eb admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:15.470180 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1285/2574] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:15 2022] PUT /identity/v3/projects/3a6c20e6ad6e4944b13f6618e290b354/users/dc70e85b1632498ea233e77264aa7b69/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:17:15.474763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb91b-85e9-41fc-9732-ef482ed7e23e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:15.485097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb91b-85e9-41fc-9732-ef482ed7e23e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:15.544512 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a38d1-4cfa-459c-8cf8-e4f531509e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:15.545062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a38d1-4cfa-459c-8cf8-e4f531509e2e admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:15.545346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a38d1-4cfa-459c-8cf8-e4f531509e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:15.545625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a38d1-4cfa-459c-8cf8-e4f531509e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:15.546283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a38d1-4cfa-459c-8cf8-e4f531509e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:15.548254 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a38d1-4cfa-459c-8cf8-e4f531509e2e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:15.559270 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1290/2575] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:15.563674 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2bae3-ebd4-4eab-826c-64926161a5eb admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:15.575232 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2bae3-ebd4-4eab-826c-64926161a5eb admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:15.579925 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172d800-2f14-403e-b215-f1622c5a2814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:15.580587 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172d800-2f14-403e-b215-f1622c5a2814 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:15.580892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172d800-2f14-403e-b215-f1622c5a2814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:15.581162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172d800-2f14-403e-b215-f1622c5a2814 admin admin] PATH_INFO: `/v3/projects/3a6c20e6ad6e4944b13f6618e290b354/users/dc70e85b1632498ea233e77264aa7b69/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:15.583334 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172d800-2f14-403e-b215-f1622c5a2814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6c20e6ad6e4944b13f6618e290b354, user_id=dc70e85b1632498ea233e77264aa7b69, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:15.586011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172d800-2f14-403e-b215-f1622c5a2814 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:15.597644 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1286/2576] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:15 2022] PUT /identity/v3/projects/3a6c20e6ad6e4944b13f6618e290b354/users/dc70e85b1632498ea233e77264aa7b69/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:15.609171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015de8f-c008-4fc8-b5f0-6ecbcc9430ba None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:15.609461 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015de8f-c008-4fc8-b5f0-6ecbcc9430ba None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:15.609741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015de8f-c008-4fc8-b5f0-6ecbcc9430ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:15.643599 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-4015de8f-c008-4fc8-b5f0-6ecbcc9430ba None None] MFA Rules not processed for user `dc70e85b1632498ea233e77264aa7b69`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:15.644876 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4015de8f-c008-4fc8-b5f0-6ecbcc9430ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:15.726267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1291/2577] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:15.738521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172d800-2f14-403e-b215-f1622c5a2814 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:15.740493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9172d800-2f14-403e-b215-f1622c5a2814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:15.809265 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172d800-2f14-403e-b215-f1622c5a2814 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:15.812973 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1108b03-78f0-42e4-ad51-c53cbddf6198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:15.813594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1108b03-78f0-42e4-ad51-c53cbddf6198 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:15.813894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1108b03-78f0-42e4-ad51-c53cbddf6198 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:15.814170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1108b03-78f0-42e4-ad51-c53cbddf6198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:15.825774 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1108b03-78f0-42e4-ad51-c53cbddf6198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:15.827298 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1108b03-78f0-42e4-ad51-c53cbddf6198 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:15.839161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1287/2578] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:15.926380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015de8f-c008-4fc8-b5f0-6ecbcc9430ba None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:15.939055 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015de8f-c008-4fc8-b5f0-6ecbcc9430ba None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:15.944544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f45d8-f8f6-4eef-87ef-02dd91e18813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:15.945196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f45d8-f8f6-4eef-87ef-02dd91e18813 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:15.945480 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f45d8-f8f6-4eef-87ef-02dd91e18813 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:15.945754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f45d8-f8f6-4eef-87ef-02dd91e18813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:16.007395 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f45d8-f8f6-4eef-87ef-02dd91e18813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:16.008891 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f45d8-f8f6-4eef-87ef-02dd91e18813 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:16.018314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1292/2579] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:21.943023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1108b03-78f0-42e4-ad51-c53cbddf6198 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:21.944519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b1108b03-78f0-42e4-ad51-c53cbddf6198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:22.002577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1108b03-78f0-42e4-ad51-c53cbddf6198 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:22.007118 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdb3d0-7275-4733-a413-ea70caa0614e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:22.007725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdb3d0-7275-4733-a413-ea70caa0614e service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:22.008003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdb3d0-7275-4733-a413-ea70caa0614e service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:22.008274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdb3d0-7275-4733-a413-ea70caa0614e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:22.010045 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9bbdb3d0-7275-4733-a413-ea70caa0614e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:22.076669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:22.079737 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdb3d0-7275-4733-a413-ea70caa0614e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:22.081887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdb3d0-7275-4733-a413-ea70caa0614e service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:22.094526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1288/2580] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:25.609458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f45d8-f8f6-4eef-87ef-02dd91e18813 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:25.611402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-915f45d8-f8f6-4eef-87ef-02dd91e18813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:25.628838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:25.688483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdb3d0-7275-4733-a413-ea70caa0614e service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:25.692246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9bbdb3d0-7275-4733-a413-ea70caa0614e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:25.713585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdb3d0-7275-4733-a413-ea70caa0614e service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:25.718410 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11171b59-e508-421c-8acf-f160bfa58005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:25.719414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11171b59-e508-421c-8acf-f160bfa58005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:25.719883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11171b59-e508-421c-8acf-f160bfa58005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:25.720518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11171b59-e508-421c-8acf-f160bfa58005 admin admin] PATH_INFO: `/v3/users/6ddf97a836074da89dacb0d8029e2165` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:25.722103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11171b59-e508-421c-8acf-f160bfa58005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ddf97a836074da89dacb0d8029e2165)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:25.725189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11171b59-e508-421c-8acf-f160bfa58005 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:25.738234 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f45d8-f8f6-4eef-87ef-02dd91e18813 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:25.744031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dbdfd-4f12-4f51-a542-b913997fd07a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b918da0f83754f3887de1cfa2e4df028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:25.744652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dbdfd-4f12-4f51-a542-b913997fd07a service placement] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:25.745022 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dbdfd-4f12-4f51-a542-b913997fd07a service placement] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:25.745260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dbdfd-4f12-4f51-a542-b913997fd07a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:25.747108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-988dbdfd-4f12-4f51-a542-b913997fd07a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:25.760758 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dbdfd-4f12-4f51-a542-b913997fd07a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:25.762285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dbdfd-4f12-4f51-a542-b913997fd07a service placement] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:25.786994 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1293/2581] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:25.825673 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-11171b59-e508-421c-8acf-f160bfa58005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ddf97a836074da89dacb0d8029e2165'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:25.837569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-11171b59-e508-421c-8acf-f160bfa58005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ddf97a836074da89dacb0d8029e2165'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:25.838762 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-11171b59-e508-421c-8acf-f160bfa58005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ddf97a836074da89dacb0d8029e2165'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:25.839891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-11171b59-e508-421c-8acf-f160bfa58005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ddf97a836074da89dacb0d8029e2165'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:25.861348 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-11171b59-e508-421c-8acf-f160bfa58005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ddf97a836074da89dacb0d8029e2165'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:25.877156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1289/2582] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:25 2022] DELETE /identity/v3/users/6ddf97a836074da89dacb0d8029e2165 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:17:26.101248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dbdfd-4f12-4f51-a542-b913997fd07a service placement] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:26.137460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dbdfd-4f12-4f51-a542-b913997fd07a service placement] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:26.216010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c52ed-1146-405b-ad5e-68cc2f132fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:26.216803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c52ed-1146-405b-ad5e-68cc2f132fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:26.217091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c52ed-1146-405b-ad5e-68cc2f132fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:26.217431 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c52ed-1146-405b-ad5e-68cc2f132fb7 admin admin] PATH_INFO: `/v3/projects/9229025e7cfd412caee76c1154f1b15e` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:26.218695 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c52ed-1146-405b-ad5e-68cc2f132fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9229025e7cfd412caee76c1154f1b15e)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:26.221529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c52ed-1146-405b-ad5e-68cc2f132fb7 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:26.294806 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-203c52ed-1146-405b-ad5e-68cc2f132fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9229025e7cfd412caee76c1154f1b15e', 'request_id': 'req-203c52ed-1146-405b-ad5e-68cc2f132fb7'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:26.302887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-203c52ed-1146-405b-ad5e-68cc2f132fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9229025e7cfd412caee76c1154f1b15e', 'request_id': 'req-203c52ed-1146-405b-ad5e-68cc2f132fb7'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:26.311844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-203c52ed-1146-405b-ad5e-68cc2f132fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9229025e7cfd412caee76c1154f1b15e', 'request_id': 'req-203c52ed-1146-405b-ad5e-68cc2f132fb7'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:26.329582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-203c52ed-1146-405b-ad5e-68cc2f132fb7 admin admin] The token cache is being invalidate because project 9229025e7cfd412caee76c1154f1b15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:26.330287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-203c52ed-1146-405b-ad5e-68cc2f132fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:26.331226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-203c52ed-1146-405b-ad5e-68cc2f132fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:26.335113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1294/2583] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:26 2022] DELETE /identity/v3/projects/9229025e7cfd412caee76c1154f1b15e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:26.340172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c248bb5-ae0c-4b4f-9216-bf4abf33d989 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:26.340460 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c248bb5-ae0c-4b4f-9216-bf4abf33d989 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:26.340731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c248bb5-ae0c-4b4f-9216-bf4abf33d989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:26.370391 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-8c248bb5-ae0c-4b4f-9216-bf4abf33d989 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:26.371683 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8c248bb5-ae0c-4b4f-9216-bf4abf33d989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:26.451562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1290/2584] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:26.461367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d9c1f-bfe3-4ca8-b3d7-3281b4861bed None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:26.461718 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d9c1f-bfe3-4ca8-b3d7-3281b4861bed None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:26.461911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d9c1f-bfe3-4ca8-b3d7-3281b4861bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:26.486226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e61d9c1f-bfe3-4ca8-b3d7-3281b4861bed None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:26.488241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e61d9c1f-bfe3-4ca8-b3d7-3281b4861bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:26.497689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1295/2585] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:26.502112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c248bb5-ae0c-4b4f-9216-bf4abf33d989 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:26.512427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c248bb5-ae0c-4b4f-9216-bf4abf33d989 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:26.517116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869bc1c-c0fa-49ba-800e-07b79935221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:26.521237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869bc1c-c0fa-49ba-800e-07b79935221b admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:26.521237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869bc1c-c0fa-49ba-800e-07b79935221b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:26.521237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869bc1c-c0fa-49ba-800e-07b79935221b admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:26.521237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869bc1c-c0fa-49ba-800e-07b79935221b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:17:26.521237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869bc1c-c0fa-49ba-800e-07b79935221b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:26.521237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869bc1c-c0fa-49ba-800e-07b79935221b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:26.534024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1291/2586] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:17:26.539318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d9c1f-bfe3-4ca8-b3d7-3281b4861bed None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:26.549042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d9c1f-bfe3-4ca8-b3d7-3281b4861bed None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:26.555013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3aebd-024f-4697-a806-ac65001eb8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:26.555715 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3aebd-024f-4697-a806-ac65001eb8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:26.555999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3aebd-024f-4697-a806-ac65001eb8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:26.556258 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3aebd-024f-4697-a806-ac65001eb8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:26.557116 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3aebd-024f-4697-a806-ac65001eb8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:26.559056 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3aebd-024f-4697-a806-ac65001eb8f2 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:26.592487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1296/2587] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:26 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:17:26.597431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869bc1c-c0fa-49ba-800e-07b79935221b admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:26.608861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869bc1c-c0fa-49ba-800e-07b79935221b admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:26.662799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:26.670551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad08da-1fc0-4591-a398-959b76bc58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:26.671685 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad08da-1fc0-4591-a398-959b76bc58f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:26.672083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad08da-1fc0-4591-a398-959b76bc58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:26.672502 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad08da-1fc0-4591-a398-959b76bc58f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:26.673370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad08da-1fc0-4591-a398-959b76bc58f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:26.677347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad08da-1fc0-4591-a398-959b76bc58f6 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:26.699657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1292/2588] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:26 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:26.703779 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3aebd-024f-4697-a806-ac65001eb8f2 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:26.711551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:26.718443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3aebd-024f-4697-a806-ac65001eb8f2 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:26.725794 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86607d4b-d1eb-40ed-80ec-8aad7a6c7efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:26.726421 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86607d4b-d1eb-40ed-80ec-8aad7a6c7efb admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:26.726705 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86607d4b-d1eb-40ed-80ec-8aad7a6c7efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:26.726983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86607d4b-d1eb-40ed-80ec-8aad7a6c7efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:26.727646 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86607d4b-d1eb-40ed-80ec-8aad7a6c7efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:26.729484 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86607d4b-d1eb-40ed-80ec-8aad7a6c7efb admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:26.740195 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1297/2589] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:26.744484 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad08da-1fc0-4591-a398-959b76bc58f6 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:26.755739 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad08da-1fc0-4591-a398-959b76bc58f6 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:26.760615 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ca6b1-bcb2-4f26-a886-aed3dd8544f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:26.761269 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ca6b1-bcb2-4f26-a886-aed3dd8544f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:26.761553 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ca6b1-bcb2-4f26-a886-aed3dd8544f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:26.761860 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ca6b1-bcb2-4f26-a886-aed3dd8544f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:26.762517 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ca6b1-bcb2-4f26-a886-aed3dd8544f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:26.764194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ca6b1-bcb2-4f26-a886-aed3dd8544f5 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:26.776496 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1293/2590] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:26.780999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86607d4b-d1eb-40ed-80ec-8aad7a6c7efb admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:26.792527 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86607d4b-d1eb-40ed-80ec-8aad7a6c7efb admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:26.797237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072827a-dd9d-4aa5-b02c-f35df5d50f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:26.797893 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072827a-dd9d-4aa5-b02c-f35df5d50f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:26.798163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072827a-dd9d-4aa5-b02c-f35df5d50f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:26.798442 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072827a-dd9d-4aa5-b02c-f35df5d50f42 admin admin] PATH_INFO: `/v3/projects/110dd2443eb84da19ebd0010310e635e/users/01f0919ecc5b41fe81eec4b4a36f6400/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:26.814702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072827a-dd9d-4aa5-b02c-f35df5d50f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=110dd2443eb84da19ebd0010310e635e, user_id=01f0919ecc5b41fe81eec4b4a36f6400, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:26.817528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072827a-dd9d-4aa5-b02c-f35df5d50f42 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:26.832355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1298/2591] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:26 2022] PUT /identity/v3/projects/110dd2443eb84da19ebd0010310e635e/users/01f0919ecc5b41fe81eec4b4a36f6400/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:26.843089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d32f4-4f37-4d86-b256-507286465c9f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:26.843336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d32f4-4f37-4d86-b256-507286465c9f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:26.843563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d32f4-4f37-4d86-b256-507286465c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:26.873286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-cc0d32f4-4f37-4d86-b256-507286465c9f None None] MFA Rules not processed for user `01f0919ecc5b41fe81eec4b4a36f6400`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:26.874520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-cc0d32f4-4f37-4d86-b256-507286465c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:26.943698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1294/2592] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:26.948410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072827a-dd9d-4aa5-b02c-f35df5d50f42 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:27.014580 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072827a-dd9d-4aa5-b02c-f35df5d50f42 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:27.023126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd1fc1-8be1-4d90-bc08-aa7c8b22adb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:27.023760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1fc1-8be1-4d90-bc08-aa7c8b22adb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:27.024044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1fc1-8be1-4d90-bc08-aa7c8b22adb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:27.024324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1fc1-8be1-4d90-bc08-aa7c8b22adb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:27.025003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd1fc1-8be1-4d90-bc08-aa7c8b22adb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:27.026959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd1fc1-8be1-4d90-bc08-aa7c8b22adb1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:27.056877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1299/2593] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:26 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:27.060274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d32f4-4f37-4d86-b256-507286465c9f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:27.073525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d32f4-4f37-4d86-b256-507286465c9f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:27.151051 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dd3e6-489d-40fb-8a17-4c8d04f81f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:27.151937 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd3e6-489d-40fb-8a17-4c8d04f81f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:27.152516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd3e6-489d-40fb-8a17-4c8d04f81f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:27.153006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd3e6-489d-40fb-8a17-4c8d04f81f55 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:27.153993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dd3e6-489d-40fb-8a17-4c8d04f81f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:27.157695 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dd3e6-489d-40fb-8a17-4c8d04f81f55 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:27.188042 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1295/2594] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:27 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:17:27.192809 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd1fc1-8be1-4d90-bc08-aa7c8b22adb1 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:27.203471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd1fc1-8be1-4d90-bc08-aa7c8b22adb1 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:27.208299 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ea827-ffda-413a-b1bd-cb8af52094b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:27.208940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ea827-ffda-413a-b1bd-cb8af52094b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:27.209226 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ea827-ffda-413a-b1bd-cb8af52094b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:27.209503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ea827-ffda-413a-b1bd-cb8af52094b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:27.210151 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ea827-ffda-413a-b1bd-cb8af52094b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:27.211776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ea827-ffda-413a-b1bd-cb8af52094b2 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:27.223898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1300/2595] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:27.228307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dd3e6-489d-40fb-8a17-4c8d04f81f55 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:27.239137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dd3e6-489d-40fb-8a17-4c8d04f81f55 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:27.243952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0603d-fe63-4891-a658-65c107bb1457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:27.244636 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0603d-fe63-4891-a658-65c107bb1457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:27.244960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0603d-fe63-4891-a658-65c107bb1457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:27.245229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0603d-fe63-4891-a658-65c107bb1457 admin admin] PATH_INFO: `/v3/projects/aa3b4ee5336f4fc68c9c18adbeb2a601/users/3531f2d17893467fb8a77da7ea1a2097/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:27.260818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0603d-fe63-4891-a658-65c107bb1457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3b4ee5336f4fc68c9c18adbeb2a601, user_id=3531f2d17893467fb8a77da7ea1a2097, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:27.263478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0603d-fe63-4891-a658-65c107bb1457 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:27.278534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1296/2596] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:27 2022] PUT /identity/v3/projects/aa3b4ee5336f4fc68c9c18adbeb2a601/users/3531f2d17893467fb8a77da7ea1a2097/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:17:27.282912 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ea827-ffda-413a-b1bd-cb8af52094b2 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:27.294048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ea827-ffda-413a-b1bd-cb8af52094b2 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:27.354702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b807e3-ec35-4a18-b749-ec86d97b2444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:27.355238 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b807e3-ec35-4a18-b749-ec86d97b2444 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:27.355521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b807e3-ec35-4a18-b749-ec86d97b2444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:27.355800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b807e3-ec35-4a18-b749-ec86d97b2444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:27.356456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b807e3-ec35-4a18-b749-ec86d97b2444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:27.358221 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b807e3-ec35-4a18-b749-ec86d97b2444 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:27.379280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1301/2597] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:27.382514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0603d-fe63-4891-a658-65c107bb1457 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:27.394559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0603d-fe63-4891-a658-65c107bb1457 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:27.399735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b438c0-6706-4900-ad1f-8f8b24ba7b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:27.400736 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b438c0-6706-4900-ad1f-8f8b24ba7b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:27.401024 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b438c0-6706-4900-ad1f-8f8b24ba7b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:27.401290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b438c0-6706-4900-ad1f-8f8b24ba7b4f admin admin] PATH_INFO: `/v3/projects/aa3b4ee5336f4fc68c9c18adbeb2a601/users/3531f2d17893467fb8a77da7ea1a2097/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:27.403343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b438c0-6706-4900-ad1f-8f8b24ba7b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3b4ee5336f4fc68c9c18adbeb2a601, user_id=3531f2d17893467fb8a77da7ea1a2097, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:27.406326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b438c0-6706-4900-ad1f-8f8b24ba7b4f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:27.418257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1297/2598] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:27 2022] PUT /identity/v3/projects/aa3b4ee5336f4fc68c9c18adbeb2a601/users/3531f2d17893467fb8a77da7ea1a2097/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:27.437547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b35c29-d866-4e89-94aa-b4f2e580ca79 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:27.437917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b35c29-d866-4e89-94aa-b4f2e580ca79 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:27.438504 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b35c29-d866-4e89-94aa-b4f2e580ca79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:27.472628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-d8b35c29-d866-4e89-94aa-b4f2e580ca79 None None] MFA Rules not processed for user `3531f2d17893467fb8a77da7ea1a2097`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:27.473909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d8b35c29-d866-4e89-94aa-b4f2e580ca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:27.505501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:27.556648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1302/2599] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:27.569407 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b438c0-6706-4900-ad1f-8f8b24ba7b4f admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:27.571157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-e1b438c0-6706-4900-ad1f-8f8b24ba7b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:27.593348 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:27.639139 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b438c0-6706-4900-ad1f-8f8b24ba7b4f admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:27.647406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be64ff-bb08-48a2-ae86-c0a64b802bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:27.648400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be64ff-bb08-48a2-ae86-c0a64b802bfa service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:27.651230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be64ff-bb08-48a2-ae86-c0a64b802bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:27.651668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be64ff-bb08-48a2-ae86-c0a64b802bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:27.664764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be64ff-bb08-48a2-ae86-c0a64b802bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:27.666201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be64ff-bb08-48a2-ae86-c0a64b802bfa service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:27.677877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1298/2600] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:27.756601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b35c29-d866-4e89-94aa-b4f2e580ca79 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:27.767542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b35c29-d866-4e89-94aa-b4f2e580ca79 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:27.772732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377c9b4-cb9b-4603-ab7b-71cbdf9a51c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:27.773349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377c9b4-cb9b-4603-ab7b-71cbdf9a51c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:27.773631 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377c9b4-cb9b-4603-ab7b-71cbdf9a51c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:27.773902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377c9b4-cb9b-4603-ab7b-71cbdf9a51c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:27.838496 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377c9b4-cb9b-4603-ab7b-71cbdf9a51c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:27.839962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377c9b4-cb9b-4603-ab7b-71cbdf9a51c9 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:27.849853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1303/2601] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:31.699027 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be64ff-bb08-48a2-ae86-c0a64b802bfa service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:31.700583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c7be64ff-bb08-48a2-ae86-c0a64b802bfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:31.775253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be64ff-bb08-48a2-ae86-c0a64b802bfa service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:31.780091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:31.780761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:31.781412 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:31.781696 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] PATH_INFO: `/v3/users/1c7e487649d844dc80f1d47b180e4a58` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:31.782844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7e487649d844dc80f1d47b180e4a58)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:31.785444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:31.845769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7e487649d844dc80f1d47b180e4a58'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:31.854676 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7e487649d844dc80f1d47b180e4a58'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:31.855359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7e487649d844dc80f1d47b180e4a58'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:31.856008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7e487649d844dc80f1d47b180e4a58'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:31.870122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7e487649d844dc80f1d47b180e4a58'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:31.883977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1299/2602] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:31 2022] DELETE /identity/v3/users/1c7e487649d844dc80f1d47b180e4a58 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:31.888220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cece0-fd02-4966-86dc-b80c21228bdb None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:31.888733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cece0-fd02-4966-86dc-b80c21228bdb None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:31.889039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cece0-fd02-4966-86dc-b80c21228bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:31.912730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-ab1cece0-fd02-4966-86dc-b80c21228bdb None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:31.913978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ab1cece0-fd02-4966-86dc-b80c21228bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:31.982446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1304/2603] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:31.993568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:31.995494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:32.055908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:32.075036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3df29-136f-492e-bb33-465c4fcd79d0 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:32.080067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a422880-1833-42aa-822b-e734087a63c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:32.081791 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a422880-1833-42aa-822b-e734087a63c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:32.082073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a422880-1833-42aa-822b-e734087a63c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:32.082377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a422880-1833-42aa-822b-e734087a63c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:32.094330 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a422880-1833-42aa-822b-e734087a63c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:32.095763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a422880-1833-42aa-822b-e734087a63c1 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:32.106612 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1300/2604] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:32.439747 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cece0-fd02-4966-86dc-b80c21228bdb None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:32.442857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ab1cece0-fd02-4966-86dc-b80c21228bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:32.461130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cece0-fd02-4966-86dc-b80c21228bdb None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:32.466541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:32.467130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:32.470917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:32.470917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] PATH_INFO: `/v3/projects/71be823baeea48079e5d27917317741e` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:32.470917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] RBAC: Authorizing `identity:delete_project(project_id=71be823baeea48079e5d27917317741e)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:32.471282 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:32.531813 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71be823baeea48079e5d27917317741e', 'request_id': 'req-dd3ec00a-4073-454f-9f3f-50a554e7487c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:32.538189 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:32.539529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71be823baeea48079e5d27917317741e', 'request_id': 'req-dd3ec00a-4073-454f-9f3f-50a554e7487c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:32.554458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71be823baeea48079e5d27917317741e', 'request_id': 'req-dd3ec00a-4073-454f-9f3f-50a554e7487c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:32.567555 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] The token cache is being invalidate because project 71be823baeea48079e5d27917317741e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:32.567877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:32.568549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:32.570488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1305/2605] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:32 2022] DELETE /identity/v3/projects/71be823baeea48079e5d27917317741e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:17:32.574988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a422880-1833-42aa-822b-e734087a63c1 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:32.585772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a422880-1833-42aa-822b-e734087a63c1 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:32.644994 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ebc1a-6aa7-4e93-ad3e-c7351aa2adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:32.645635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ebc1a-6aa7-4e93-ad3e-c7351aa2adb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:32.645918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ebc1a-6aa7-4e93-ad3e-c7351aa2adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:32.646194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ebc1a-6aa7-4e93-ad3e-c7351aa2adb7 admin admin] PATH_INFO: `/v3/users/dc70e85b1632498ea233e77264aa7b69` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:32.647325 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ebc1a-6aa7-4e93-ad3e-c7351aa2adb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc70e85b1632498ea233e77264aa7b69)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:32.649392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ebc1a-6aa7-4e93-ad3e-c7351aa2adb7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:32.697960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-764ebc1a-6aa7-4e93-ad3e-c7351aa2adb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc70e85b1632498ea233e77264aa7b69'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:32.708039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-764ebc1a-6aa7-4e93-ad3e-c7351aa2adb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc70e85b1632498ea233e77264aa7b69'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:32.708774 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-764ebc1a-6aa7-4e93-ad3e-c7351aa2adb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc70e85b1632498ea233e77264aa7b69'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:32.709332 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-764ebc1a-6aa7-4e93-ad3e-c7351aa2adb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc70e85b1632498ea233e77264aa7b69'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:32.722284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-764ebc1a-6aa7-4e93-ad3e-c7351aa2adb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc70e85b1632498ea233e77264aa7b69'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:32.734264 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1301/2606] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:32 2022] DELETE /identity/v3/users/dc70e85b1632498ea233e77264aa7b69 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:33.032363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:33.034414 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:33.049377 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ec00a-4073-454f-9f3f-50a554e7487c admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:33.124280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c825312-f985-421b-b5b4-8e8ae9ae8eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:33.124955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c825312-f985-421b-b5b4-8e8ae9ae8eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:33.125233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c825312-f985-421b-b5b4-8e8ae9ae8eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:33.125502 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c825312-f985-421b-b5b4-8e8ae9ae8eae admin admin] PATH_INFO: `/v3/projects/3a6c20e6ad6e4944b13f6618e290b354` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:33.126627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c825312-f985-421b-b5b4-8e8ae9ae8eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6c20e6ad6e4944b13f6618e290b354)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:33.128619 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c825312-f985-421b-b5b4-8e8ae9ae8eae admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:33.179032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4c825312-f985-421b-b5b4-8e8ae9ae8eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6c20e6ad6e4944b13f6618e290b354', 'request_id': 'req-4c825312-f985-421b-b5b4-8e8ae9ae8eae'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:33.184672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4c825312-f985-421b-b5b4-8e8ae9ae8eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6c20e6ad6e4944b13f6618e290b354', 'request_id': 'req-4c825312-f985-421b-b5b4-8e8ae9ae8eae'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:33.193249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4c825312-f985-421b-b5b4-8e8ae9ae8eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6c20e6ad6e4944b13f6618e290b354', 'request_id': 'req-4c825312-f985-421b-b5b4-8e8ae9ae8eae'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:33.204737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4c825312-f985-421b-b5b4-8e8ae9ae8eae admin admin] The token cache is being invalidate because project 3a6c20e6ad6e4944b13f6618e290b354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:33.205137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4c825312-f985-421b-b5b4-8e8ae9ae8eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:33.205864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-4c825312-f985-421b-b5b4-8e8ae9ae8eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:33.207332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1306/2607] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:33 2022] DELETE /identity/v3/projects/3a6c20e6ad6e4944b13f6618e290b354 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:33.213451 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba005b2-693d-4b9a-aec2-4ee2cd2a3811 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:33.215489 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba005b2-693d-4b9a-aec2-4ee2cd2a3811 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:33.216032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba005b2-693d-4b9a-aec2-4ee2cd2a3811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:33.239694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-bba005b2-693d-4b9a-aec2-4ee2cd2a3811 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:33.240895 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-bba005b2-693d-4b9a-aec2-4ee2cd2a3811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:33.294568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:33.305141 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1302/2608] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:33.313289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038e310-47ca-4a15-93b1-6263265d674a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:33.313701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038e310-47ca-4a15-93b1-6263265d674a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:33.314205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038e310-47ca-4a15-93b1-6263265d674a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:33.335677 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f038e310-47ca-4a15-93b1-6263265d674a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:33.336955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f038e310-47ca-4a15-93b1-6263265d674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:33.345408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1307/2609] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:33.350279 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba005b2-693d-4b9a-aec2-4ee2cd2a3811 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:33.360446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba005b2-693d-4b9a-aec2-4ee2cd2a3811 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:33.366053 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f864ac-78a5-46e5-9725-ffd8502bdf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:33.366668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f864ac-78a5-46e5-9725-ffd8502bdf12 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:33.366945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f864ac-78a5-46e5-9725-ffd8502bdf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:33.367218 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f864ac-78a5-46e5-9725-ffd8502bdf12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:33.367869 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f864ac-78a5-46e5-9725-ffd8502bdf12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:17:33.368168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f864ac-78a5-46e5-9725-ffd8502bdf12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:33.369832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f864ac-78a5-46e5-9725-ffd8502bdf12 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:33.382322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1303/2610] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:17:33.387224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038e310-47ca-4a15-93b1-6263265d674a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:33.399674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038e310-47ca-4a15-93b1-6263265d674a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:33.407142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9c307-f532-496b-aab1-9f331372a8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:33.408186 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9c307-f532-496b-aab1-9f331372a8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:33.408710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9c307-f532-496b-aab1-9f331372a8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:33.410614 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9c307-f532-496b-aab1-9f331372a8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:33.411743 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9c307-f532-496b-aab1-9f331372a8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:33.415131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9c307-f532-496b-aab1-9f331372a8a6 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:33.457675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1308/2611] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:33 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:33.461952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f864ac-78a5-46e5-9725-ffd8502bdf12 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:33.473071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f864ac-78a5-46e5-9725-ffd8502bdf12 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:33.538518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fc42b-b6dd-44e4-9fd5-2c757eb80d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:33.539057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fc42b-b6dd-44e4-9fd5-2c757eb80d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:33.539338 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fc42b-b6dd-44e4-9fd5-2c757eb80d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:33.539618 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fc42b-b6dd-44e4-9fd5-2c757eb80d3a admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:33.540270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fc42b-b6dd-44e4-9fd5-2c757eb80d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:33.542291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fc42b-b6dd-44e4-9fd5-2c757eb80d3a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:33.567242 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1304/2612] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:33 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:33.576911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9c307-f532-496b-aab1-9f331372a8a6 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:33.591174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9c307-f532-496b-aab1-9f331372a8a6 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:33.598928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116a826-f79a-4cd4-8a7a-769980a2aaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:33.599545 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116a826-f79a-4cd4-8a7a-769980a2aaff admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:33.599825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116a826-f79a-4cd4-8a7a-769980a2aaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:33.600098 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116a826-f79a-4cd4-8a7a-769980a2aaff admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:33.600780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116a826-f79a-4cd4-8a7a-769980a2aaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:33.602465 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116a826-f79a-4cd4-8a7a-769980a2aaff admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:33.613640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1309/2613] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:33.617521 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fc42b-b6dd-44e4-9fd5-2c757eb80d3a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:33.629280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fc42b-b6dd-44e4-9fd5-2c757eb80d3a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:33.634080 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ebc19-94bf-4677-a018-8b21a99bd22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:33.635723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ebc19-94bf-4677-a018-8b21a99bd22c admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:33.635723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ebc19-94bf-4677-a018-8b21a99bd22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:33.635723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ebc19-94bf-4677-a018-8b21a99bd22c admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:33.635985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ebc19-94bf-4677-a018-8b21a99bd22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:33.637453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ebc19-94bf-4677-a018-8b21a99bd22c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:33.652735 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1305/2614] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:33.654564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116a826-f79a-4cd4-8a7a-769980a2aaff admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:33.666210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116a826-f79a-4cd4-8a7a-769980a2aaff admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:33.671323 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e824be-123a-49a9-9b8a-963577df309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:33.672002 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e824be-123a-49a9-9b8a-963577df309b admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:33.672285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e824be-123a-49a9-9b8a-963577df309b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:33.672565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e824be-123a-49a9-9b8a-963577df309b admin admin] PATH_INFO: `/v3/projects/19911e9f732141a0ab900933f1db9392/users/5322da0ed6e140aeb2078d8fbd305cef/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:33.696313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e824be-123a-49a9-9b8a-963577df309b admin admin] RBAC: Authorizing `identity:create_grant(project_id=19911e9f732141a0ab900933f1db9392, user_id=5322da0ed6e140aeb2078d8fbd305cef, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:33.699053 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e824be-123a-49a9-9b8a-963577df309b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:33.716544 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1310/2615] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:33 2022] PUT /identity/v3/projects/19911e9f732141a0ab900933f1db9392/users/5322da0ed6e140aeb2078d8fbd305cef/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:17:33.728627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e54a7c-a401-45ad-b8ad-dd33d4edc0cf None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:33.729210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e54a7c-a401-45ad-b8ad-dd33d4edc0cf None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:33.729210 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e54a7c-a401-45ad-b8ad-dd33d4edc0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:33.775893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-06e54a7c-a401-45ad-b8ad-dd33d4edc0cf None None] MFA Rules not processed for user `5322da0ed6e140aeb2078d8fbd305cef`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:33.778065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-06e54a7c-a401-45ad-b8ad-dd33d4edc0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:33.874659 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1306/2616] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:33.879887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e824be-123a-49a9-9b8a-963577df309b admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:33.894988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:34.010276 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e824be-123a-49a9-9b8a-963577df309b admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:34.036216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945a741-8d8a-4bdd-bdb8-d5326f65a373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:34.038613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945a741-8d8a-4bdd-bdb8-d5326f65a373 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:34.039179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945a741-8d8a-4bdd-bdb8-d5326f65a373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:34.043015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945a741-8d8a-4bdd-bdb8-d5326f65a373 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:34.047383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945a741-8d8a-4bdd-bdb8-d5326f65a373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:34.052831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945a741-8d8a-4bdd-bdb8-d5326f65a373 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:34.119995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1311/2617] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:33 2022] POST /identity/v3/projects => generated 367 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:34.121176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e54a7c-a401-45ad-b8ad-dd33d4edc0cf None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:34.133294 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e54a7c-a401-45ad-b8ad-dd33d4edc0cf None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:34.206360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:34.216857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82067f7-33f6-447e-b984-e7d3c389e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:34.217962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82067f7-33f6-447e-b984-e7d3c389e554 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:34.218290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82067f7-33f6-447e-b984-e7d3c389e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:34.218941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82067f7-33f6-447e-b984-e7d3c389e554 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:34.219891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82067f7-33f6-447e-b984-e7d3c389e554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:34.223578 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82067f7-33f6-447e-b984-e7d3c389e554 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:34.269712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1307/2618] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:34 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:34.274044 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945a741-8d8a-4bdd-bdb8-d5326f65a373 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:34.286387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945a741-8d8a-4bdd-bdb8-d5326f65a373 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:34.291687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324b68d-57d8-46a0-bfea-b1708a67ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:34.292303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b68d-57d8-46a0-bfea-b1708a67ab7f admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:34.292590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b68d-57d8-46a0-bfea-b1708a67ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:34.292971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b68d-57d8-46a0-bfea-b1708a67ab7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:34.293677 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324b68d-57d8-46a0-bfea-b1708a67ab7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:34.295230 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324b68d-57d8-46a0-bfea-b1708a67ab7f admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:34.308469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1312/2619] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:17:34.312580 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82067f7-33f6-447e-b984-e7d3c389e554 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:34.323205 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82067f7-33f6-447e-b984-e7d3c389e554 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:34.328107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48553c10-393e-45de-a5c5-eb158e2dabe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:34.328901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48553c10-393e-45de-a5c5-eb158e2dabe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:34.329257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48553c10-393e-45de-a5c5-eb158e2dabe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:34.329611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48553c10-393e-45de-a5c5-eb158e2dabe7 admin admin] PATH_INFO: `/v3/projects/64b7521d21364df69b0ab44423b5139a/users/dd3a8ab646ba4967b0218dd29c5e0b3c/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:34.347569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48553c10-393e-45de-a5c5-eb158e2dabe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b7521d21364df69b0ab44423b5139a, user_id=dd3a8ab646ba4967b0218dd29c5e0b3c, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:34.351052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48553c10-393e-45de-a5c5-eb158e2dabe7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:34.369466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1308/2620] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:34 2022] PUT /identity/v3/projects/64b7521d21364df69b0ab44423b5139a/users/dd3a8ab646ba4967b0218dd29c5e0b3c/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:34.373712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324b68d-57d8-46a0-bfea-b1708a67ab7f admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:34.384882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324b68d-57d8-46a0-bfea-b1708a67ab7f admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:34.460361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e802b-d999-4724-89f8-4440748a611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:34.461223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e802b-d999-4724-89f8-4440748a611a admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:34.461612 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e802b-d999-4724-89f8-4440748a611a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:34.462147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e802b-d999-4724-89f8-4440748a611a admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:34.463177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e802b-d999-4724-89f8-4440748a611a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:34.465390 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e802b-d999-4724-89f8-4440748a611a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:34.478981 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1313/2621] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:34.484644 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48553c10-393e-45de-a5c5-eb158e2dabe7 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:34.496832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48553c10-393e-45de-a5c5-eb158e2dabe7 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:34.502014 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d569f7-7ce5-4dcb-a94b-a813f6ec2505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:34.503362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d569f7-7ce5-4dcb-a94b-a813f6ec2505 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:34.503728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d569f7-7ce5-4dcb-a94b-a813f6ec2505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:34.504083 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d569f7-7ce5-4dcb-a94b-a813f6ec2505 admin admin] PATH_INFO: `/v3/projects/64b7521d21364df69b0ab44423b5139a/users/dd3a8ab646ba4967b0218dd29c5e0b3c/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:34.506543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d569f7-7ce5-4dcb-a94b-a813f6ec2505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b7521d21364df69b0ab44423b5139a, user_id=dd3a8ab646ba4967b0218dd29c5e0b3c, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:34.509308 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d569f7-7ce5-4dcb-a94b-a813f6ec2505 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:34.525422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1309/2622] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:34 2022] PUT /identity/v3/projects/64b7521d21364df69b0ab44423b5139a/users/dd3a8ab646ba4967b0218dd29c5e0b3c/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:17:34.536879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19ee1-3a9f-44cc-b480-245464f592e3 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:34.537171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19ee1-3a9f-44cc-b480-245464f592e3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:34.537454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19ee1-3a9f-44cc-b480-245464f592e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:34.574796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-23b19ee1-3a9f-44cc-b480-245464f592e3 None None] MFA Rules not processed for user `dd3a8ab646ba4967b0218dd29c5e0b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:34.576745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-23b19ee1-3a9f-44cc-b480-245464f592e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:34.655415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1314/2623] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:34.666992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d569f7-7ce5-4dcb-a94b-a813f6ec2505 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:34.668705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d5d569f7-7ce5-4dcb-a94b-a813f6ec2505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:34.734161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d569f7-7ce5-4dcb-a94b-a813f6ec2505 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:34.737974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4d90f-d554-4c44-9216-856e45d941dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:34.738589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4d90f-d554-4c44-9216-856e45d941dd service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:34.738869 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4d90f-d554-4c44-9216-856e45d941dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:34.739145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4d90f-d554-4c44-9216-856e45d941dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:34.749257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4d90f-d554-4c44-9216-856e45d941dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:34.750702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4d90f-d554-4c44-9216-856e45d941dd service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:34.761785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1310/2624] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:36.369097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19ee1-3a9f-44cc-b480-245464f592e3 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:36.378503 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:36.440565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19ee1-3a9f-44cc-b480-245464f592e3 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:36.445099 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:36.445738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:36.446017 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:36.446290 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] PATH_INFO: `/v3/users/5322da0ed6e140aeb2078d8fbd305cef` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:36.447415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5322da0ed6e140aeb2078d8fbd305cef)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:36.449399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:36.513436 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5322da0ed6e140aeb2078d8fbd305cef'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:36.525984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5322da0ed6e140aeb2078d8fbd305cef'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:36.543179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5322da0ed6e140aeb2078d8fbd305cef'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:36.543960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5322da0ed6e140aeb2078d8fbd305cef'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:36.544710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5322da0ed6e140aeb2078d8fbd305cef'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:36.561439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1315/2625] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:36 2022] DELETE /identity/v3/users/5322da0ed6e140aeb2078d8fbd305cef => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:36.566899 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802c086-734e-4a6b-bba4-6e0ec0b97066 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:36.567440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802c086-734e-4a6b-bba4-6e0ec0b97066 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:36.567440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802c086-734e-4a6b-bba4-6e0ec0b97066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:36.593386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-6802c086-734e-4a6b-bba4-6e0ec0b97066 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:36.595714 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6802c086-734e-4a6b-bba4-6e0ec0b97066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:36.700282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1311/2626] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:36.709585 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:36.711358 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:36.782213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b4764-54a9-4203-9e1c-53894200ec6e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:36.788400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6edb4-3d2b-4d58-b7e8-c4db1af6adb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:36.789077 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6edb4-3d2b-4d58-b7e8-c4db1af6adb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:36.789359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6edb4-3d2b-4d58-b7e8-c4db1af6adb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:36.789633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6edb4-3d2b-4d58-b7e8-c4db1af6adb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:36.802171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6edb4-3d2b-4d58-b7e8-c4db1af6adb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:36.803664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6edb4-3d2b-4d58-b7e8-c4db1af6adb6 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:36.819398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1316/2627] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:37.142689 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802c086-734e-4a6b-bba4-6e0ec0b97066 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:37.145017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6802c086-734e-4a6b-bba4-6e0ec0b97066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:37.158516 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802c086-734e-4a6b-bba4-6e0ec0b97066 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:37.165128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:37.165785 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:37.166064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:37.166335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] PATH_INFO: `/v3/projects/19911e9f732141a0ab900933f1db9392` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:37.167553 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19911e9f732141a0ab900933f1db9392)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:37.169520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:37.223356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:37.227326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19911e9f732141a0ab900933f1db9392', 'request_id': 'req-9d496429-9e63-47bb-ad39-55bdd06177e7'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.236736 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19911e9f732141a0ab900933f1db9392', 'request_id': 'req-9d496429-9e63-47bb-ad39-55bdd06177e7'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.243386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19911e9f732141a0ab900933f1db9392', 'request_id': 'req-9d496429-9e63-47bb-ad39-55bdd06177e7'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.256213 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] The token cache is being invalidate because project 19911e9f732141a0ab900933f1db9392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:37.256503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.257193 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.258664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1312/2628] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:37 2022] DELETE /identity/v3/projects/19911e9f732141a0ab900933f1db9392 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:37.263274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6edb4-3d2b-4d58-b7e8-c4db1af6adb6 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:37.275542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6edb4-3d2b-4d58-b7e8-c4db1af6adb6 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:37.303665 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:37.347411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02954723-e36a-49ef-b7b3-422ef8d109e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:37.348127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02954723-e36a-49ef-b7b3-422ef8d109e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:37.348408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02954723-e36a-49ef-b7b3-422ef8d109e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:37.348772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02954723-e36a-49ef-b7b3-422ef8d109e1 admin admin] PATH_INFO: `/v3/users/dd3a8ab646ba4967b0218dd29c5e0b3c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:37.349929 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02954723-e36a-49ef-b7b3-422ef8d109e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3a8ab646ba4967b0218dd29c5e0b3c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:37.351874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02954723-e36a-49ef-b7b3-422ef8d109e1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:37.403828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-02954723-e36a-49ef-b7b3-422ef8d109e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3a8ab646ba4967b0218dd29c5e0b3c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.412300 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-02954723-e36a-49ef-b7b3-422ef8d109e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3a8ab646ba4967b0218dd29c5e0b3c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.426286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-02954723-e36a-49ef-b7b3-422ef8d109e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3a8ab646ba4967b0218dd29c5e0b3c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.427027 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-02954723-e36a-49ef-b7b3-422ef8d109e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3a8ab646ba4967b0218dd29c5e0b3c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.427641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-02954723-e36a-49ef-b7b3-422ef8d109e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3a8ab646ba4967b0218dd29c5e0b3c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.441213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1317/2629] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:37 2022] DELETE /identity/v3/users/dd3a8ab646ba4967b0218dd29c5e0b3c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:37.732440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:37.734148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:37.748350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d496429-9e63-47bb-ad39-55bdd06177e7 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:37.814478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e2a39-bac6-490e-ae62-795394fd3439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:37.815064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e2a39-bac6-490e-ae62-795394fd3439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:37.815696 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e2a39-bac6-490e-ae62-795394fd3439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:37.815696 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e2a39-bac6-490e-ae62-795394fd3439 admin admin] PATH_INFO: `/v3/projects/64b7521d21364df69b0ab44423b5139a` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:37.816964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e2a39-bac6-490e-ae62-795394fd3439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b7521d21364df69b0ab44423b5139a)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:37.818879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e2a39-bac6-490e-ae62-795394fd3439 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:37.874477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-691e2a39-bac6-490e-ae62-795394fd3439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b7521d21364df69b0ab44423b5139a', 'request_id': 'req-691e2a39-bac6-490e-ae62-795394fd3439'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.885357 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-691e2a39-bac6-490e-ae62-795394fd3439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b7521d21364df69b0ab44423b5139a', 'request_id': 'req-691e2a39-bac6-490e-ae62-795394fd3439'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.894930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-691e2a39-bac6-490e-ae62-795394fd3439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b7521d21364df69b0ab44423b5139a', 'request_id': 'req-691e2a39-bac6-490e-ae62-795394fd3439'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.916255 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-691e2a39-bac6-490e-ae62-795394fd3439 admin admin] The token cache is being invalidate because project 64b7521d21364df69b0ab44423b5139a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:37.916773 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-691e2a39-bac6-490e-ae62-795394fd3439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.917778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-691e2a39-bac6-490e-ae62-795394fd3439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:37.921525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1313/2630] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:37 2022] DELETE /identity/v3/projects/64b7521d21364df69b0ab44423b5139a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:37.927828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c0a73-8075-4438-899e-6459dcf45feb None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:37.928285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c0a73-8075-4438-899e-6459dcf45feb None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:37.928733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c0a73-8075-4438-899e-6459dcf45feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:37.969513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-107c0a73-8075-4438-899e-6459dcf45feb None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:37.970756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-107c0a73-8075-4438-899e-6459dcf45feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:38.049195 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1318/2631] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:38.058494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2e250-e84f-496a-9337-929ab769955c None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:38.058836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2e250-e84f-496a-9337-929ab769955c None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:38.059058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2e250-e84f-496a-9337-929ab769955c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:38.088153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-3fa2e250-e84f-496a-9337-929ab769955c None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:38.089526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3fa2e250-e84f-496a-9337-929ab769955c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:38.098878 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1314/2632] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:38.103470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c0a73-8075-4438-899e-6459dcf45feb None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:38.114425 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c0a73-8075-4438-899e-6459dcf45feb None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:38.122030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda61b03-a1a9-4e54-8ef7-a277c74593b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:38.122773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61b03-a1a9-4e54-8ef7-a277c74593b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:38.123132 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61b03-a1a9-4e54-8ef7-a277c74593b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:38.123525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61b03-a1a9-4e54-8ef7-a277c74593b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:38.124271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda61b03-a1a9-4e54-8ef7-a277c74593b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:17:38.124648 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda61b03-a1a9-4e54-8ef7-a277c74593b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:38.126731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda61b03-a1a9-4e54-8ef7-a277c74593b9 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:38.151734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1319/2633] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:17:38.153363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2e250-e84f-496a-9337-929ab769955c None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:38.167979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2e250-e84f-496a-9337-929ab769955c None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:38.171411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75d08-7571-4869-abec-d3c9dfe3fa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:38.171968 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75d08-7571-4869-abec-d3c9dfe3fa56 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:38.172252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75d08-7571-4869-abec-d3c9dfe3fa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:38.172544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75d08-7571-4869-abec-d3c9dfe3fa56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:38.173252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a75d08-7571-4869-abec-d3c9dfe3fa56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:38.176611 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a75d08-7571-4869-abec-d3c9dfe3fa56 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:38.223490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1315/2634] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:38 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:38.228892 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda61b03-a1a9-4e54-8ef7-a277c74593b9 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:38.249257 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda61b03-a1a9-4e54-8ef7-a277c74593b9 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:38.296078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:38.329925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6558f2-2e16-4edf-923f-6f59eb9df8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:38.331123 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6558f2-2e16-4edf-923f-6f59eb9df8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:38.331560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6558f2-2e16-4edf-923f-6f59eb9df8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:38.331838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6558f2-2e16-4edf-923f-6f59eb9df8f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:38.332484 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6558f2-2e16-4edf-923f-6f59eb9df8f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:38.334469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6558f2-2e16-4edf-923f-6f59eb9df8f1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:38.361879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1320/2635] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:38 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:38.366041 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75d08-7571-4869-abec-d3c9dfe3fa56 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:38.380347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75d08-7571-4869-abec-d3c9dfe3fa56 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:38.387145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abc252-7420-48de-8f2c-b4b2849f8674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:38.387901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abc252-7420-48de-8f2c-b4b2849f8674 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:38.388147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abc252-7420-48de-8f2c-b4b2849f8674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:38.388419 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abc252-7420-48de-8f2c-b4b2849f8674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:38.389128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abc252-7420-48de-8f2c-b4b2849f8674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:38.390723 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abc252-7420-48de-8f2c-b4b2849f8674 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:38.402161 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1316/2636] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:38.406511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6558f2-2e16-4edf-923f-6f59eb9df8f1 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:38.419991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6558f2-2e16-4edf-923f-6f59eb9df8f1 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:38.425370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939bc41-c674-46ea-bdae-9d621756d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:38.425990 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939bc41-c674-46ea-bdae-9d621756d4fa admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:38.426269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939bc41-c674-46ea-bdae-9d621756d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:38.426546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939bc41-c674-46ea-bdae-9d621756d4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:38.427230 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939bc41-c674-46ea-bdae-9d621756d4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:38.428854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939bc41-c674-46ea-bdae-9d621756d4fa admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:38.439405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1321/2637] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:38.443750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abc252-7420-48de-8f2c-b4b2849f8674 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:38.453964 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abc252-7420-48de-8f2c-b4b2849f8674 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:38.459552 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714fedb-a64a-4a1f-bdb9-63472727484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:38.460207 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714fedb-a64a-4a1f-bdb9-63472727484b admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:38.460483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714fedb-a64a-4a1f-bdb9-63472727484b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:38.460789 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714fedb-a64a-4a1f-bdb9-63472727484b admin admin] PATH_INFO: `/v3/projects/1d39426ef18d40a4a645ff4ace804956/users/4fd92b501ffb42fa9a7404a07a506b68/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:38.477504 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714fedb-a64a-4a1f-bdb9-63472727484b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d39426ef18d40a4a645ff4ace804956, user_id=4fd92b501ffb42fa9a7404a07a506b68, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:38.480186 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714fedb-a64a-4a1f-bdb9-63472727484b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:38.493828 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:38.499843 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1317/2638] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:38 2022] PUT /identity/v3/projects/1d39426ef18d40a4a645ff4ace804956/users/4fd92b501ffb42fa9a7404a07a506b68/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:38.570605 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0371-822d-434d-be67-1a962c18c7a6 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:38.570895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0371-822d-434d-be67-1a962c18c7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:38.571208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0371-822d-434d-be67-1a962c18c7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:38.605638 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e53b0371-822d-434d-be67-1a962c18c7a6 None None] MFA Rules not processed for user `4fd92b501ffb42fa9a7404a07a506b68`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:38.606959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e53b0371-822d-434d-be67-1a962c18c7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:38.683628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1322/2639] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:38.688362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714fedb-a64a-4a1f-bdb9-63472727484b admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:38.753972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714fedb-a64a-4a1f-bdb9-63472727484b admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:38.758935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fe35-3f00-4a06-881a-dda3bf596f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:38.759554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fe35-3f00-4a06-881a-dda3bf596f40 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:38.759841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fe35-3f00-4a06-881a-dda3bf596f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:38.760153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fe35-3f00-4a06-881a-dda3bf596f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:38.760969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596fe35-3f00-4a06-881a-dda3bf596f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:38.762882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596fe35-3f00-4a06-881a-dda3bf596f40 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:38.792148 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1318/2640] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:38 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:17:38.796275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0371-822d-434d-be67-1a962c18c7a6 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:38.809125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0371-822d-434d-be67-1a962c18c7a6 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:38.869169 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ef614-c4c3-4017-88e7-5de6b5f7ee19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:38.869696 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef614-c4c3-4017-88e7-5de6b5f7ee19 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:38.869978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef614-c4c3-4017-88e7-5de6b5f7ee19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:38.870253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef614-c4c3-4017-88e7-5de6b5f7ee19 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:38.870907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ef614-c4c3-4017-88e7-5de6b5f7ee19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:38.872894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ef614-c4c3-4017-88e7-5de6b5f7ee19 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:38.900523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1323/2641] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:38 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:38.904570 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fe35-3f00-4a06-881a-dda3bf596f40 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:38.916284 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fe35-3f00-4a06-881a-dda3bf596f40 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:38.921289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ac43b-4079-42a4-861c-ccc1fccc5b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:38.921907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ac43b-4079-42a4-861c-ccc1fccc5b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:38.922197 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ac43b-4079-42a4-861c-ccc1fccc5b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:38.922472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ac43b-4079-42a4-861c-ccc1fccc5b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:38.923152 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ac43b-4079-42a4-861c-ccc1fccc5b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:38.924936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ac43b-4079-42a4-861c-ccc1fccc5b17 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:38.937063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1319/2642] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:38.942011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ef614-c4c3-4017-88e7-5de6b5f7ee19 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:38.952598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ef614-c4c3-4017-88e7-5de6b5f7ee19 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:38.957962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd6ca7-e2c8-49a2-b8d9-27a0ede2eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:38.958625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd6ca7-e2c8-49a2-b8d9-27a0ede2eb9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:38.958901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd6ca7-e2c8-49a2-b8d9-27a0ede2eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:38.959199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd6ca7-e2c8-49a2-b8d9-27a0ede2eb9f admin admin] PATH_INFO: `/v3/projects/2f13ae1c8b61427c9794f7b89509f025/users/00baa3c09a0c40e4b6e5afbf12a974b4/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:38.977259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd6ca7-e2c8-49a2-b8d9-27a0ede2eb9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f13ae1c8b61427c9794f7b89509f025, user_id=00baa3c09a0c40e4b6e5afbf12a974b4, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:38.979917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd6ca7-e2c8-49a2-b8d9-27a0ede2eb9f admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:38.994454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1324/2643] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:38 2022] PUT /identity/v3/projects/2f13ae1c8b61427c9794f7b89509f025/users/00baa3c09a0c40e4b6e5afbf12a974b4/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:38.999272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ac43b-4079-42a4-861c-ccc1fccc5b17 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:39.011597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ac43b-4079-42a4-861c-ccc1fccc5b17 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:39.079529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc108d-a226-4299-accf-0c7d94c1ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:39.080208 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc108d-a226-4299-accf-0c7d94c1ba08 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:39.080627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc108d-a226-4299-accf-0c7d94c1ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:39.080974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc108d-a226-4299-accf-0c7d94c1ba08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:39.081666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc108d-a226-4299-accf-0c7d94c1ba08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:39.083495 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc108d-a226-4299-accf-0c7d94c1ba08 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:39.096275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1320/2644] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:39.101162 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd6ca7-e2c8-49a2-b8d9-27a0ede2eb9f admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:39.112352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd6ca7-e2c8-49a2-b8d9-27a0ede2eb9f admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:39.117994 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66668b-5622-4508-a7f2-19297edb1bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:39.118662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66668b-5622-4508-a7f2-19297edb1bed admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:39.118937 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66668b-5622-4508-a7f2-19297edb1bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:39.119268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66668b-5622-4508-a7f2-19297edb1bed admin admin] PATH_INFO: `/v3/projects/2f13ae1c8b61427c9794f7b89509f025/users/00baa3c09a0c40e4b6e5afbf12a974b4/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:39.121177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66668b-5622-4508-a7f2-19297edb1bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f13ae1c8b61427c9794f7b89509f025, user_id=00baa3c09a0c40e4b6e5afbf12a974b4, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:39.123862 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66668b-5622-4508-a7f2-19297edb1bed admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:39.128130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:39.138441 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1325/2645] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:39 2022] PUT /identity/v3/projects/2f13ae1c8b61427c9794f7b89509f025/users/00baa3c09a0c40e4b6e5afbf12a974b4/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:39.148902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29764029-8e48-4efe-a7aa-35ef6abce173 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:39.149197 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29764029-8e48-4efe-a7aa-35ef6abce173 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:39.149479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29764029-8e48-4efe-a7aa-35ef6abce173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:39.180781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-29764029-8e48-4efe-a7aa-35ef6abce173 None None] MFA Rules not processed for user `00baa3c09a0c40e4b6e5afbf12a974b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:39.182038 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-29764029-8e48-4efe-a7aa-35ef6abce173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:39.246028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:39.259107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1321/2646] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:39.270551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66668b-5622-4508-a7f2-19297edb1bed admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:39.272928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4f66668b-5622-4508-a7f2-19297edb1bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:39.337673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66668b-5622-4508-a7f2-19297edb1bed admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:39.341330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db9359-2f9c-4ae9-a693-3f0febf40eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:39.341940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db9359-2f9c-4ae9-a693-3f0febf40eca service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:39.342214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db9359-2f9c-4ae9-a693-3f0febf40eca service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:39.342483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db9359-2f9c-4ae9-a693-3f0febf40eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:39.353479 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db9359-2f9c-4ae9-a693-3f0febf40eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:39.354949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db9359-2f9c-4ae9-a693-3f0febf40eca service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:39.365754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1326/2647] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:39.396656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29764029-8e48-4efe-a7aa-35ef6abce173 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:39.482313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29764029-8e48-4efe-a7aa-35ef6abce173 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:39.488988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:39.489648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:39.489932 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:39.490211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] PATH_INFO: `/v3/users/4fd92b501ffb42fa9a7404a07a506b68` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:39.491425 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd92b501ffb42fa9a7404a07a506b68)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:39.493414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:39.552887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd92b501ffb42fa9a7404a07a506b68'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:39.563869 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd92b501ffb42fa9a7404a07a506b68'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:39.564512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd92b501ffb42fa9a7404a07a506b68'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:39.565894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd92b501ffb42fa9a7404a07a506b68'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:39.584120 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd92b501ffb42fa9a7404a07a506b68'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:39.625326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1322/2648] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:39 2022] DELETE /identity/v3/users/4fd92b501ffb42fa9a7404a07a506b68 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:39.630344 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7eb5-fa1e-4887-99ef-960a9b790a43 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:39.630841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7eb5-fa1e-4887-99ef-960a9b790a43 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:39.630949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7eb5-fa1e-4887-99ef-960a9b790a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:39.651473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-508d7eb5-fa1e-4887-99ef-960a9b790a43 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:39.652804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-508d7eb5-fa1e-4887-99ef-960a9b790a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:39.730153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1327/2649] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:39.740708 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:39.742140 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:39.803748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b9d11-c5dd-4e22-8968-3f0a23632c4b admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:39.807639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3354ff4-dcda-493c-b82c-37463f30a7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:39.808253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3354ff4-dcda-493c-b82c-37463f30a7db service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:39.808561 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3354ff4-dcda-493c-b82c-37463f30a7db service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:39.808894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3354ff4-dcda-493c-b82c-37463f30a7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:39.818656 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3354ff4-dcda-493c-b82c-37463f30a7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:39.820092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3354ff4-dcda-493c-b82c-37463f30a7db service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:39.830254 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1323/2650] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:40.163830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7eb5-fa1e-4887-99ef-960a9b790a43 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:40.165357 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-508d7eb5-fa1e-4887-99ef-960a9b790a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:40.182465 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7eb5-fa1e-4887-99ef-960a9b790a43 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:40.194641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:40.195654 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:40.196019 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:40.196294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] PATH_INFO: `/v3/projects/1d39426ef18d40a4a645ff4ace804956` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:40.197534 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d39426ef18d40a4a645ff4ace804956)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:40.199607 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:40.257109 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d39426ef18d40a4a645ff4ace804956', 'request_id': 'req-76e23135-239b-4267-88f7-6c4672bd702e'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.263995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d39426ef18d40a4a645ff4ace804956', 'request_id': 'req-76e23135-239b-4267-88f7-6c4672bd702e'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.282664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d39426ef18d40a4a645ff4ace804956', 'request_id': 'req-76e23135-239b-4267-88f7-6c4672bd702e'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.296527 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] The token cache is being invalidate because project 1d39426ef18d40a4a645ff4ace804956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:40.296866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.297495 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.301757 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1328/2651] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:40 2022] DELETE /identity/v3/projects/1d39426ef18d40a4a645ff4ace804956 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:17:40.306058 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3354ff4-dcda-493c-b82c-37463f30a7db service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:40.317938 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3354ff4-dcda-493c-b82c-37463f30a7db service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:40.336562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:40.389742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15598600-db09-4c02-aa1e-e868d8a473fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:40.390417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15598600-db09-4c02-aa1e-e868d8a473fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:40.390692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15598600-db09-4c02-aa1e-e868d8a473fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:40.390970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15598600-db09-4c02-aa1e-e868d8a473fa admin admin] PATH_INFO: `/v3/users/00baa3c09a0c40e4b6e5afbf12a974b4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:40.392130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15598600-db09-4c02-aa1e-e868d8a473fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=00baa3c09a0c40e4b6e5afbf12a974b4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:40.394758 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15598600-db09-4c02-aa1e-e868d8a473fa admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:40.447672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-15598600-db09-4c02-aa1e-e868d8a473fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00baa3c09a0c40e4b6e5afbf12a974b4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.457238 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-15598600-db09-4c02-aa1e-e868d8a473fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00baa3c09a0c40e4b6e5afbf12a974b4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.457927 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-15598600-db09-4c02-aa1e-e868d8a473fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00baa3c09a0c40e4b6e5afbf12a974b4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.458591 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-15598600-db09-4c02-aa1e-e868d8a473fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00baa3c09a0c40e4b6e5afbf12a974b4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.476052 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-15598600-db09-4c02-aa1e-e868d8a473fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00baa3c09a0c40e4b6e5afbf12a974b4'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.488519 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1324/2652] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:40 2022] DELETE /identity/v3/users/00baa3c09a0c40e4b6e5afbf12a974b4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:40.791346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:40.792909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:40.809637 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e23135-239b-4267-88f7-6c4672bd702e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:40.835191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:40.885047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2415a6-0073-4f36-9022-1967be23a9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:40.885748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2415a6-0073-4f36-9022-1967be23a9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:40.886019 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2415a6-0073-4f36-9022-1967be23a9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:40.886284 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2415a6-0073-4f36-9022-1967be23a9da admin admin] PATH_INFO: `/v3/projects/2f13ae1c8b61427c9794f7b89509f025` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:40.887266 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2415a6-0073-4f36-9022-1967be23a9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f13ae1c8b61427c9794f7b89509f025)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:40.889252 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2415a6-0073-4f36-9022-1967be23a9da admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:40.949493 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd2415a6-0073-4f36-9022-1967be23a9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f13ae1c8b61427c9794f7b89509f025', 'request_id': 'req-dd2415a6-0073-4f36-9022-1967be23a9da'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.961219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd2415a6-0073-4f36-9022-1967be23a9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f13ae1c8b61427c9794f7b89509f025', 'request_id': 'req-dd2415a6-0073-4f36-9022-1967be23a9da'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.972788 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd2415a6-0073-4f36-9022-1967be23a9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f13ae1c8b61427c9794f7b89509f025', 'request_id': 'req-dd2415a6-0073-4f36-9022-1967be23a9da'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.990845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd2415a6-0073-4f36-9022-1967be23a9da admin admin] The token cache is being invalidate because project 2f13ae1c8b61427c9794f7b89509f025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:40.991360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd2415a6-0073-4f36-9022-1967be23a9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.992480 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-dd2415a6-0073-4f36-9022-1967be23a9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:40.994943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1329/2653] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:40 2022] DELETE /identity/v3/projects/2f13ae1c8b61427c9794f7b89509f025 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:41.001016 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571335-3114-44d0-b5bc-ccfb12bff2f3 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.002081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571335-3114-44d0-b5bc-ccfb12bff2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.002081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571335-3114-44d0-b5bc-ccfb12bff2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.026153 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-d6571335-3114-44d0-b5bc-ccfb12bff2f3 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:41.027409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d6571335-3114-44d0-b5bc-ccfb12bff2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:41.101740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1325/2654] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:41.109947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db8a05-1453-448c-8320-ac76e01b8a03 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.110279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db8a05-1453-448c-8320-ac76e01b8a03 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.110725 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db8a05-1453-448c-8320-ac76e01b8a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.147160 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c8db8a05-1453-448c-8320-ac76e01b8a03 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:41.148437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c8db8a05-1453-448c-8320-ac76e01b8a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:41.168084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1330/2655] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:41.169839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571335-3114-44d0-b5bc-ccfb12bff2f3 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:41.182303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571335-3114-44d0-b5bc-ccfb12bff2f3 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:41.187101 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbfb2c-b4c1-4a70-ba56-480f0d8a3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:41.187830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbfb2c-b4c1-4a70-ba56-480f0d8a3b9d admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.188182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbfb2c-b4c1-4a70-ba56-480f0d8a3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.188457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbfb2c-b4c1-4a70-ba56-480f0d8a3b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.189340 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbfb2c-b4c1-4a70-ba56-480f0d8a3b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:17:41.189737 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbfb2c-b4c1-4a70-ba56-480f0d8a3b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:41.191756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbfb2c-b4c1-4a70-ba56-480f0d8a3b9d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:41.208090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1326/2656] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:17:41.212672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db8a05-1453-448c-8320-ac76e01b8a03 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:41.223546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db8a05-1453-448c-8320-ac76e01b8a03 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:41.228560 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970f175-ceec-4f68-a9d1-b501407bfd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:41.229283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970f175-ceec-4f68-a9d1-b501407bfd66 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.229579 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970f175-ceec-4f68-a9d1-b501407bfd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.229846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970f175-ceec-4f68-a9d1-b501407bfd66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.230524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970f175-ceec-4f68-a9d1-b501407bfd66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:41.232987 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970f175-ceec-4f68-a9d1-b501407bfd66 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:41.262710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1331/2657] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:41 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:17:41.267082 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbfb2c-b4c1-4a70-ba56-480f0d8a3b9d admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:41.277515 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbfb2c-b4c1-4a70-ba56-480f0d8a3b9d admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:41.302974 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:41.349901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3833eab-55a1-44cb-84f9-7022c85fa7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:41.350527 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3833eab-55a1-44cb-84f9-7022c85fa7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.350814 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3833eab-55a1-44cb-84f9-7022c85fa7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.351098 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3833eab-55a1-44cb-84f9-7022c85fa7c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.351746 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3833eab-55a1-44cb-84f9-7022c85fa7c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:41.353758 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3833eab-55a1-44cb-84f9-7022c85fa7c2 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:41.381448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1327/2658] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:41 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:41.385738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970f175-ceec-4f68-a9d1-b501407bfd66 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:41.398450 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970f175-ceec-4f68-a9d1-b501407bfd66 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:41.404031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c723cb6-d018-4518-89c6-00e9d0dd20e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:41.404659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c723cb6-d018-4518-89c6-00e9d0dd20e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.405015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c723cb6-d018-4518-89c6-00e9d0dd20e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.405294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c723cb6-d018-4518-89c6-00e9d0dd20e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.406285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c723cb6-d018-4518-89c6-00e9d0dd20e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:41.408119 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c723cb6-d018-4518-89c6-00e9d0dd20e5 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:41.420627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1332/2659] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:41.425117 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3833eab-55a1-44cb-84f9-7022c85fa7c2 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:41.437478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3833eab-55a1-44cb-84f9-7022c85fa7c2 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:41.445977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6abd91-9c1a-44b9-8805-48f513256276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:41.446796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6abd91-9c1a-44b9-8805-48f513256276 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.447081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6abd91-9c1a-44b9-8805-48f513256276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.447361 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6abd91-9c1a-44b9-8805-48f513256276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.448068 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6abd91-9c1a-44b9-8805-48f513256276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:41.449794 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6abd91-9c1a-44b9-8805-48f513256276 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:41.467898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1328/2660] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:41.474432 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c723cb6-d018-4518-89c6-00e9d0dd20e5 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:41.484886 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c723cb6-d018-4518-89c6-00e9d0dd20e5 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:41.490966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359baca-655a-4499-920a-19b235b75c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:41.491830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359baca-655a-4499-920a-19b235b75c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.492183 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359baca-655a-4499-920a-19b235b75c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.492524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359baca-655a-4499-920a-19b235b75c8a admin admin] PATH_INFO: `/v3/projects/c5f8e532b65f43e9803eecaac770b1de/users/4a099bbc436044eb8abb38b7f632f45b/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.509630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359baca-655a-4499-920a-19b235b75c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f8e532b65f43e9803eecaac770b1de, user_id=4a099bbc436044eb8abb38b7f632f45b, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:41.512423 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359baca-655a-4499-920a-19b235b75c8a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:41.526960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1333/2661] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:41 2022] PUT /identity/v3/projects/c5f8e532b65f43e9803eecaac770b1de/users/4a099bbc436044eb8abb38b7f632f45b/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:41.538834 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe6970-394b-4fdf-a868-db33cbc45601 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.539126 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe6970-394b-4fdf-a868-db33cbc45601 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.539436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe6970-394b-4fdf-a868-db33cbc45601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.569170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f2fe6970-394b-4fdf-a868-db33cbc45601 None None] MFA Rules not processed for user `4a099bbc436044eb8abb38b7f632f45b`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:41.570427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f2fe6970-394b-4fdf-a868-db33cbc45601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:41.654222 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1329/2662] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:17:41.659549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359baca-655a-4499-920a-19b235b75c8a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:41.711397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:41.728006 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359baca-655a-4499-920a-19b235b75c8a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:41.734223 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52e423-0321-4dc6-9667-ee475c841ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:41.734841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52e423-0321-4dc6-9667-ee475c841ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.735122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52e423-0321-4dc6-9667-ee475c841ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.735399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52e423-0321-4dc6-9667-ee475c841ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.736062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52e423-0321-4dc6-9667-ee475c841ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:41.738075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52e423-0321-4dc6-9667-ee475c841ce5 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:41.782914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1334/2663] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:41 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:41.787122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe6970-394b-4fdf-a868-db33cbc45601 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:41.798425 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe6970-394b-4fdf-a868-db33cbc45601 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:41.864651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c388073-e987-448e-ab4f-3f86c1d649b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:41.865341 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c388073-e987-448e-ab4f-3f86c1d649b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.865619 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c388073-e987-448e-ab4f-3f86c1d649b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.865894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c388073-e987-448e-ab4f-3f86c1d649b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.866535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c388073-e987-448e-ab4f-3f86c1d649b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:41.868453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c388073-e987-448e-ab4f-3f86c1d649b0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:41.898669 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1330/2664] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:17:41 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:17:41.904008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52e423-0321-4dc6-9667-ee475c841ce5 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:41.919087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52e423-0321-4dc6-9667-ee475c841ce5 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:41.924299 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4d86-9008-46f9-9c02-b02a87d08caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:41.925297 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4d86-9008-46f9-9c02-b02a87d08caa admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.925583 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4d86-9008-46f9-9c02-b02a87d08caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.925861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4d86-9008-46f9-9c02-b02a87d08caa admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.926536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc4d86-9008-46f9-9c02-b02a87d08caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:41.928159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc4d86-9008-46f9-9c02-b02a87d08caa admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:41.942366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1335/2665] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:17:41.946257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c388073-e987-448e-ab4f-3f86c1d649b0 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:41.958562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c388073-e987-448e-ab4f-3f86c1d649b0 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:41.963328 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0ba45-7333-41bc-8643-8c0b2a3f4e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:41.964005 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0ba45-7333-41bc-8643-8c0b2a3f4e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:41.964288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0ba45-7333-41bc-8643-8c0b2a3f4e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:41.964593 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0ba45-7333-41bc-8643-8c0b2a3f4e03 admin admin] PATH_INFO: `/v3/projects/423742fbc4c54df2b75afed1c7c249a9/users/3328a80910d54444b890fce8182de27b/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:41.990039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0ba45-7333-41bc-8643-8c0b2a3f4e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=423742fbc4c54df2b75afed1c7c249a9, user_id=3328a80910d54444b890fce8182de27b, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:41.992604 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0ba45-7333-41bc-8643-8c0b2a3f4e03 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:42.004979 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:42.013469 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1331/2666] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:41 2022] PUT /identity/v3/projects/423742fbc4c54df2b75afed1c7c249a9/users/3328a80910d54444b890fce8182de27b/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:42.017653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4d86-9008-46f9-9c02-b02a87d08caa admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:42.035199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4d86-9008-46f9-9c02-b02a87d08caa admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:42.098999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572c901-af52-47ac-b43b-3ad5723c6b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:42.099658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572c901-af52-47ac-b43b-3ad5723c6b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:42.099953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572c901-af52-47ac-b43b-3ad5723c6b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:42.100211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572c901-af52-47ac-b43b-3ad5723c6b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:42.100961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572c901-af52-47ac-b43b-3ad5723c6b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:42.102486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572c901-af52-47ac-b43b-3ad5723c6b84 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:42.114326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1336/2667] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:17:42.118505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0ba45-7333-41bc-8643-8c0b2a3f4e03 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:42.131147 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0ba45-7333-41bc-8643-8c0b2a3f4e03 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:42.136158 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b76d6-c0d7-4de1-944e-efc5db3eab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:42.136945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b76d6-c0d7-4de1-944e-efc5db3eab6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:42.137229 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b76d6-c0d7-4de1-944e-efc5db3eab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:42.137512 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b76d6-c0d7-4de1-944e-efc5db3eab6a admin admin] PATH_INFO: `/v3/projects/423742fbc4c54df2b75afed1c7c249a9/users/3328a80910d54444b890fce8182de27b/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:42.139531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b76d6-c0d7-4de1-944e-efc5db3eab6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=423742fbc4c54df2b75afed1c7c249a9, user_id=3328a80910d54444b890fce8182de27b, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:42.142223 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b76d6-c0d7-4de1-944e-efc5db3eab6a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:42.154443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1332/2668] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:17:42 2022] PUT /identity/v3/projects/423742fbc4c54df2b75afed1c7c249a9/users/3328a80910d54444b890fce8182de27b/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:17:42.166050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60659504-f0ca-4800-a3ce-0d2369837566 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:42.166336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60659504-f0ca-4800-a3ce-0d2369837566 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:42.166613 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60659504-f0ca-4800-a3ce-0d2369837566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:42.197565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-60659504-f0ca-4800-a3ce-0d2369837566 None None] MFA Rules not processed for user `3328a80910d54444b890fce8182de27b`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:42.198790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-60659504-f0ca-4800-a3ce-0d2369837566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:42.298133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1337/2669] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:42.311230 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b76d6-c0d7-4de1-944e-efc5db3eab6a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:42.313219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0a8b76d6-c0d7-4de1-944e-efc5db3eab6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:42.401639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b76d6-c0d7-4de1-944e-efc5db3eab6a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:42.408088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a8094-d34c-424d-b72a-9f4e07f753ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:42.408811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a8094-d34c-424d-b72a-9f4e07f753ca service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:42.409721 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a8094-d34c-424d-b72a-9f4e07f753ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:42.409967 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a8094-d34c-424d-b72a-9f4e07f753ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:42.421718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a8094-d34c-424d-b72a-9f4e07f753ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:42.423168 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a8094-d34c-424d-b72a-9f4e07f753ca service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:42.436748 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1333/2670] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:42.520408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60659504-f0ca-4800-a3ce-0d2369837566 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:42.568337 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:42.588302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60659504-f0ca-4800-a3ce-0d2369837566 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:42.592843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:42.593474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:42.593751 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:42.594025 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] PATH_INFO: `/v3/users/4a099bbc436044eb8abb38b7f632f45b` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:42.595141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a099bbc436044eb8abb38b7f632f45b)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:42.597389 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:42.656335 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a099bbc436044eb8abb38b7f632f45b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:42.664963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a099bbc436044eb8abb38b7f632f45b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:42.678806 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a099bbc436044eb8abb38b7f632f45b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:42.679651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a099bbc436044eb8abb38b7f632f45b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:42.680249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a099bbc436044eb8abb38b7f632f45b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:42.695233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1338/2671] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:42 2022] DELETE /identity/v3/users/4a099bbc436044eb8abb38b7f632f45b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:42.700959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ab782-969b-47e2-b527-50ca1661933e None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:42.701313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ab782-969b-47e2-b527-50ca1661933e None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:42.701590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ab782-969b-47e2-b527-50ca1661933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:42.724068 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-4a4ab782-969b-47e2-b527-50ca1661933e None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:42.728777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4a4ab782-969b-47e2-b527-50ca1661933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:42.794434 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1334/2672] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:42.805086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:42.806575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:42.871616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c391845-0011-41ca-8581-322304ad04a1 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:42.875380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf67d0f-da0f-4fd3-96c6-d74a4b05a41a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:42.875999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf67d0f-da0f-4fd3-96c6-d74a4b05a41a service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:42.876315 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf67d0f-da0f-4fd3-96c6-d74a4b05a41a service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:42.876593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf67d0f-da0f-4fd3-96c6-d74a4b05a41a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:42.887458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf67d0f-da0f-4fd3-96c6-d74a4b05a41a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:42.888955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf67d0f-da0f-4fd3-96c6-d74a4b05a41a service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:42.900190 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1339/2673] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:43.188480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ab782-969b-47e2-b527-50ca1661933e None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:43.190547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4a4ab782-969b-47e2-b527-50ca1661933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:43.203245 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ab782-969b-47e2-b527-50ca1661933e None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:43.209060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:43.209725 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:43.210063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:43.210281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] PATH_INFO: `/v3/projects/c5f8e532b65f43e9803eecaac770b1de` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:43.211766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f8e532b65f43e9803eecaac770b1de)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:43.213819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:43.267054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f8e532b65f43e9803eecaac770b1de', 'request_id': 'req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:43.274992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f8e532b65f43e9803eecaac770b1de', 'request_id': 'req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:43.282215 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f8e532b65f43e9803eecaac770b1de', 'request_id': 'req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:43.296450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] The token cache is being invalidate because project c5f8e532b65f43e9803eecaac770b1de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:43.296761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:43.297450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:43.298951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1335/2674] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:43 2022] DELETE /identity/v3/projects/c5f8e532b65f43e9803eecaac770b1de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:43.303660 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf67d0f-da0f-4fd3-96c6-d74a4b05a41a service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:43.313678 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf67d0f-da0f-4fd3-96c6-d74a4b05a41a service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:43.383011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:43.383645 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:43.383923 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:43.384196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] PATH_INFO: `/v3/users/3328a80910d54444b890fce8182de27b` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:43.385331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3328a80910d54444b890fce8182de27b)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:43.387285 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:43.392998 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:43.439841 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3328a80910d54444b890fce8182de27b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:43.447602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3328a80910d54444b890fce8182de27b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:43.461599 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3328a80910d54444b890fce8182de27b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:43.462330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3328a80910d54444b890fce8182de27b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:43.462970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3328a80910d54444b890fce8182de27b'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:43.477499 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1340/2675] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:43 2022] DELETE /identity/v3/users/3328a80910d54444b890fce8182de27b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:43.813443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:43.815667 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:43.843302 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160fa0f-8b10-4bcb-bfe0-6b582eb53efa admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:43.857738 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:43.939918 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87881e83-78d2-41e7-bacb-4b04ffe75815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:43.940760 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87881e83-78d2-41e7-bacb-4b04ffe75815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:43.941036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87881e83-78d2-41e7-bacb-4b04ffe75815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:43.941311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87881e83-78d2-41e7-bacb-4b04ffe75815 admin admin] PATH_INFO: `/v3/projects/423742fbc4c54df2b75afed1c7c249a9` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:43.942488 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87881e83-78d2-41e7-bacb-4b04ffe75815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=423742fbc4c54df2b75afed1c7c249a9)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:43.944429 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87881e83-78d2-41e7-bacb-4b04ffe75815 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:44.009970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-87881e83-78d2-41e7-bacb-4b04ffe75815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '423742fbc4c54df2b75afed1c7c249a9', 'request_id': 'req-87881e83-78d2-41e7-bacb-4b04ffe75815'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:44.028788 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-87881e83-78d2-41e7-bacb-4b04ffe75815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '423742fbc4c54df2b75afed1c7c249a9', 'request_id': 'req-87881e83-78d2-41e7-bacb-4b04ffe75815'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:44.031645 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-87881e83-78d2-41e7-bacb-4b04ffe75815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '423742fbc4c54df2b75afed1c7c249a9', 'request_id': 'req-87881e83-78d2-41e7-bacb-4b04ffe75815'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:44.044472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-87881e83-78d2-41e7-bacb-4b04ffe75815 admin admin] The token cache is being invalidate because project 423742fbc4c54df2b75afed1c7c249a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:44.044800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-87881e83-78d2-41e7-bacb-4b04ffe75815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:44.045470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-87881e83-78d2-41e7-bacb-4b04ffe75815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:44.046955 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1336/2676] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:43 2022] DELETE /identity/v3/projects/423742fbc4c54df2b75afed1c7c249a9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:53.473942 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:54.041256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:58.332546 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:58.334146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:58.348564 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fb59a-0edb-410e-bc7f-a3134e01da0a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:58.416275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:58.417196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:58.417482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:58.417772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] PATH_INFO: `/v3/users/01f0919ecc5b41fe81eec4b4a36f6400` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:58.418921 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f0919ecc5b41fe81eec4b4a36f6400)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:58.421116 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:58.473637 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f0919ecc5b41fe81eec4b4a36f6400'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:58.481699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f0919ecc5b41fe81eec4b4a36f6400'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:58.495542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f0919ecc5b41fe81eec4b4a36f6400'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:58.496303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f0919ecc5b41fe81eec4b4a36f6400'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:58.496979 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f0919ecc5b41fe81eec4b4a36f6400'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:58.509908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1341/2677] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:58 2022] DELETE /identity/v3/users/01f0919ecc5b41fe81eec4b4a36f6400 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:58.514451 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16587106-fb6f-498e-ab3e-80cdf8561ea6 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:58.515154 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16587106-fb6f-498e-ab3e-80cdf8561ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:58.515154 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16587106-fb6f-498e-ab3e-80cdf8561ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:58.541384 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-16587106-fb6f-498e-ab3e-80cdf8561ea6 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:58.542617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-16587106-fb6f-498e-ab3e-80cdf8561ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:58.605028 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1337/2678] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:58.615216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:58.616709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:58.678090 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838d456-c2e5-4522-96ec-34bfec97f3e0 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:58.681830 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271fd83-1ee3-4998-99f4-29710210c840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:58.682446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271fd83-1ee3-4998-99f4-29710210c840 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:58.682717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271fd83-1ee3-4998-99f4-29710210c840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:58.682989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271fd83-1ee3-4998-99f4-29710210c840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:58.692917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271fd83-1ee3-4998-99f4-29710210c840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:58.694380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271fd83-1ee3-4998-99f4-29710210c840 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:58.704745 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1342/2679] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:17:59.003572 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16587106-fb6f-498e-ab3e-80cdf8561ea6 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:59.005048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-16587106-fb6f-498e-ab3e-80cdf8561ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:59.019250 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16587106-fb6f-498e-ab3e-80cdf8561ea6 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:59.026046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:59.026993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:59.027422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:59.027847 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] PATH_INFO: `/v3/projects/110dd2443eb84da19ebd0010310e635e` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:59.029702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=110dd2443eb84da19ebd0010310e635e)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:59.033747 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:59.089201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '110dd2443eb84da19ebd0010310e635e', 'request_id': 'req-3030c845-5b7a-4164-8bdf-b00343519c9e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.097311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '110dd2443eb84da19ebd0010310e635e', 'request_id': 'req-3030c845-5b7a-4164-8bdf-b00343519c9e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.104063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '110dd2443eb84da19ebd0010310e635e', 'request_id': 'req-3030c845-5b7a-4164-8bdf-b00343519c9e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.115886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] The token cache is being invalidate because project 110dd2443eb84da19ebd0010310e635e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:59.116173 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.116849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.118329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1338/2680] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:59 2022] DELETE /identity/v3/projects/110dd2443eb84da19ebd0010310e635e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:59.122775 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271fd83-1ee3-4998-99f4-29710210c840 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:59.134065 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271fd83-1ee3-4998-99f4-29710210c840 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:59.157738 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:59.203463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05da051-8db2-4811-9942-7452e585cc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:59.204117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05da051-8db2-4811-9942-7452e585cc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:59.204403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05da051-8db2-4811-9942-7452e585cc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:59.204729 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05da051-8db2-4811-9942-7452e585cc61 admin admin] PATH_INFO: `/v3/users/3531f2d17893467fb8a77da7ea1a2097` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:59.206519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05da051-8db2-4811-9942-7452e585cc61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3531f2d17893467fb8a77da7ea1a2097)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:59.208509 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05da051-8db2-4811-9942-7452e585cc61 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:59.260286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d05da051-8db2-4811-9942-7452e585cc61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3531f2d17893467fb8a77da7ea1a2097'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.269732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d05da051-8db2-4811-9942-7452e585cc61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3531f2d17893467fb8a77da7ea1a2097'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.284937 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d05da051-8db2-4811-9942-7452e585cc61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3531f2d17893467fb8a77da7ea1a2097'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.285806 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d05da051-8db2-4811-9942-7452e585cc61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3531f2d17893467fb8a77da7ea1a2097'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.286506 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d05da051-8db2-4811-9942-7452e585cc61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3531f2d17893467fb8a77da7ea1a2097'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.301001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1343/2681] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:17:59 2022] DELETE /identity/v3/users/3531f2d17893467fb8a77da7ea1a2097 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:59.624211 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:59.625822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:59.640411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030c845-5b7a-4164-8bdf-b00343519c9e admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:59.707481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7717c3-7156-4011-b65c-6cad7aabb0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:59.708036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7717c3-7156-4011-b65c-6cad7aabb0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:59.708326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7717c3-7156-4011-b65c-6cad7aabb0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:59.708661 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7717c3-7156-4011-b65c-6cad7aabb0c3 admin admin] PATH_INFO: `/v3/projects/aa3b4ee5336f4fc68c9c18adbeb2a601` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:59.709850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7717c3-7156-4011-b65c-6cad7aabb0c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3b4ee5336f4fc68c9c18adbeb2a601)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:59.711761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7717c3-7156-4011-b65c-6cad7aabb0c3 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:59.745086 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:17:59.763171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5e7717c3-7156-4011-b65c-6cad7aabb0c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3b4ee5336f4fc68c9c18adbeb2a601', 'request_id': 'req-5e7717c3-7156-4011-b65c-6cad7aabb0c3'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.771378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5e7717c3-7156-4011-b65c-6cad7aabb0c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3b4ee5336f4fc68c9c18adbeb2a601', 'request_id': 'req-5e7717c3-7156-4011-b65c-6cad7aabb0c3'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.777939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5e7717c3-7156-4011-b65c-6cad7aabb0c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3b4ee5336f4fc68c9c18adbeb2a601', 'request_id': 'req-5e7717c3-7156-4011-b65c-6cad7aabb0c3'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.790525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5e7717c3-7156-4011-b65c-6cad7aabb0c3 admin admin] The token cache is being invalidate because project aa3b4ee5336f4fc68c9c18adbeb2a601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:17:59.790816 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5e7717c3-7156-4011-b65c-6cad7aabb0c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.791467 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5e7717c3-7156-4011-b65c-6cad7aabb0c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:17:59.792989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1339/2682] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:17:59 2022] DELETE /identity/v3/projects/aa3b4ee5336f4fc68c9c18adbeb2a601 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:17:59.797906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b301e-af2d-4030-bf93-5fe6edbe37d3 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:59.798397 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b301e-af2d-4030-bf93-5fe6edbe37d3 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:59.798494 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b301e-af2d-4030-bf93-5fe6edbe37d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:59.820003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-963b301e-af2d-4030-bf93-5fe6edbe37d3 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:59.821267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-963b301e-af2d-4030-bf93-5fe6edbe37d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:59.886692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1344/2683] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:59.894432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ad43a-cce9-4e5e-a065-6c77b72754cd None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:59.894713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ad43a-cce9-4e5e-a065-6c77b72754cd None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:59.894985 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ad43a-cce9-4e5e-a065-6c77b72754cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:59.916802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-389ad43a-cce9-4e5e-a065-6c77b72754cd None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:17:59.918019 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-389ad43a-cce9-4e5e-a065-6c77b72754cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:17:59.926883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1340/2684] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:17:59.931216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b301e-af2d-4030-bf93-5fe6edbe37d3 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:59.941232 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b301e-af2d-4030-bf93-5fe6edbe37d3 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:59.945820 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa308c4-8409-4b3d-a9ba-b4b07ffa36df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:59.947075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa308c4-8409-4b3d-a9ba-b4b07ffa36df admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:59.947075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa308c4-8409-4b3d-a9ba-b4b07ffa36df admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:59.947075 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa308c4-8409-4b3d-a9ba-b4b07ffa36df admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:59.947634 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa308c4-8409-4b3d-a9ba-b4b07ffa36df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:17:59.947927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa308c4-8409-4b3d-a9ba-b4b07ffa36df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:59.949624 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa308c4-8409-4b3d-a9ba-b4b07ffa36df admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:17:59.962074 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1345/2685] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:17:59.966891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ad43a-cce9-4e5e-a065-6c77b72754cd None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:17:59.982420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ad43a-cce9-4e5e-a065-6c77b72754cd None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:17:59.990676 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77954be6-8713-4f99-a4e8-a14f5ae8b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:17:59.991563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77954be6-8713-4f99-a4e8-a14f5ae8b8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:17:59.991978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77954be6-8713-4f99-a4e8-a14f5ae8b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:17:59.992448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77954be6-8713-4f99-a4e8-a14f5ae8b8a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:17:59.993194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77954be6-8713-4f99-a4e8-a14f5ae8b8a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:17:59.995103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77954be6-8713-4f99-a4e8-a14f5ae8b8a2 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:00.029444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1341/2686] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:17:59 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:00.030584 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa308c4-8409-4b3d-a9ba-b4b07ffa36df admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:00.041789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa308c4-8409-4b3d-a9ba-b4b07ffa36df admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:00.068755 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:00.103516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b048fc-c3a9-4480-9194-c8033acf2dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:00.104130 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b048fc-c3a9-4480-9194-c8033acf2dac admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:00.104413 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b048fc-c3a9-4480-9194-c8033acf2dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:00.104706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b048fc-c3a9-4480-9194-c8033acf2dac admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:00.105387 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b048fc-c3a9-4480-9194-c8033acf2dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:00.107331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b048fc-c3a9-4480-9194-c8033acf2dac admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:00.131526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1346/2687] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:00 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:18:00.135787 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77954be6-8713-4f99-a4e8-a14f5ae8b8a2 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:00.151852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77954be6-8713-4f99-a4e8-a14f5ae8b8a2 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:00.157046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cead52-2696-4a08-bd85-a1d59d885738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:00.157670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cead52-2696-4a08-bd85-a1d59d885738 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:00.157953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cead52-2696-4a08-bd85-a1d59d885738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:00.158824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cead52-2696-4a08-bd85-a1d59d885738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:00.159573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cead52-2696-4a08-bd85-a1d59d885738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:00.161241 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cead52-2696-4a08-bd85-a1d59d885738 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:00.171790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1342/2688] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:00.176291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b048fc-c3a9-4480-9194-c8033acf2dac admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:00.187005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b048fc-c3a9-4480-9194-c8033acf2dac admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:00.192253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ced83e-6289-4a66-9a8b-e12a9231fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:00.192903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced83e-6289-4a66-9a8b-e12a9231fd43 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:00.193207 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced83e-6289-4a66-9a8b-e12a9231fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:00.193478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ced83e-6289-4a66-9a8b-e12a9231fd43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:00.194127 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ced83e-6289-4a66-9a8b-e12a9231fd43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:00.195732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ced83e-6289-4a66-9a8b-e12a9231fd43 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:00.207006 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1347/2689] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:00.211447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cead52-2696-4a08-bd85-a1d59d885738 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:00.224057 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cead52-2696-4a08-bd85-a1d59d885738 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:00.229248 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79f76-04c9-408e-afe2-50978c683c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:00.229989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79f76-04c9-408e-afe2-50978c683c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:00.230260 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79f76-04c9-408e-afe2-50978c683c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:00.230536 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79f76-04c9-408e-afe2-50978c683c24 admin admin] PATH_INFO: `/v3/projects/5b46039b388f4c63ba047c78f8cc9667/users/177f9d5cef044e7e9ea0abc545498ca4/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:00.246928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd79f76-04c9-408e-afe2-50978c683c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b46039b388f4c63ba047c78f8cc9667, user_id=177f9d5cef044e7e9ea0abc545498ca4, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:00.249620 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd79f76-04c9-408e-afe2-50978c683c24 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:00.263464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1343/2690] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:00 2022] PUT /identity/v3/projects/5b46039b388f4c63ba047c78f8cc9667/users/177f9d5cef044e7e9ea0abc545498ca4/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:00.276733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516895e-54fa-44b4-9e18-554c6ee970a5 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:00.277026 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516895e-54fa-44b4-9e18-554c6ee970a5 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:00.277326 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516895e-54fa-44b4-9e18-554c6ee970a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:00.307914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e516895e-54fa-44b4-9e18-554c6ee970a5 None None] MFA Rules not processed for user `177f9d5cef044e7e9ea0abc545498ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:00.309939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e516895e-54fa-44b4-9e18-554c6ee970a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:00.386007 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1348/2691] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:18:00.390947 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79f76-04c9-408e-afe2-50978c683c24 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:00.457403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79f76-04c9-408e-afe2-50978c683c24 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:00.462182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc08e3-afd6-4d2f-a83c-b99026a21313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:00.462792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc08e3-afd6-4d2f-a83c-b99026a21313 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:00.463074 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc08e3-afd6-4d2f-a83c-b99026a21313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:00.463351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc08e3-afd6-4d2f-a83c-b99026a21313 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:00.463997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc08e3-afd6-4d2f-a83c-b99026a21313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:00.466132 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc08e3-afd6-4d2f-a83c-b99026a21313 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:00.495378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1344/2692] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:18:00 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:18:00.500928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516895e-54fa-44b4-9e18-554c6ee970a5 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:00.514823 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516895e-54fa-44b4-9e18-554c6ee970a5 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:00.585354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af5110-89e1-4ce6-bcc4-f666f36edfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:00.585978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af5110-89e1-4ce6-bcc4-f666f36edfdb admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:00.586262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af5110-89e1-4ce6-bcc4-f666f36edfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:00.586535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af5110-89e1-4ce6-bcc4-f666f36edfdb admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:00.587192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af5110-89e1-4ce6-bcc4-f666f36edfdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:00.589163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af5110-89e1-4ce6-bcc4-f666f36edfdb admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:00.612741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1349/2693] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:00 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:18:00.616972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc08e3-afd6-4d2f-a83c-b99026a21313 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:00.628887 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc08e3-afd6-4d2f-a83c-b99026a21313 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:00.633635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a405f-5c36-40fa-a818-09922de9900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:00.634280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a405f-5c36-40fa-a818-09922de9900d admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:00.634563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a405f-5c36-40fa-a818-09922de9900d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:00.634838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a405f-5c36-40fa-a818-09922de9900d admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:00.635506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a405f-5c36-40fa-a818-09922de9900d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:00.637149 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a405f-5c36-40fa-a818-09922de9900d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:00.649474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1345/2694] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:00.655444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af5110-89e1-4ce6-bcc4-f666f36edfdb admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:00.667611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af5110-89e1-4ce6-bcc4-f666f36edfdb admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:00.682776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc35468-3ce2-4c17-b06e-d4f7a23ca5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:00.683463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc35468-3ce2-4c17-b06e-d4f7a23ca5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:00.683803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc35468-3ce2-4c17-b06e-d4f7a23ca5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:00.684051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc35468-3ce2-4c17-b06e-d4f7a23ca5c6 admin admin] PATH_INFO: `/v3/projects/e9becb28fd3241d58a6d26273c3decc0/users/6ba8365315e9479f98598993680e7ae2/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:00.701354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc35468-3ce2-4c17-b06e-d4f7a23ca5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9becb28fd3241d58a6d26273c3decc0, user_id=6ba8365315e9479f98598993680e7ae2, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:00.704039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc35468-3ce2-4c17-b06e-d4f7a23ca5c6 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:00.719566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1350/2695] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:00 2022] PUT /identity/v3/projects/e9becb28fd3241d58a6d26273c3decc0/users/6ba8365315e9479f98598993680e7ae2/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:00.724140 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a405f-5c36-40fa-a818-09922de9900d admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:00.734341 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a405f-5c36-40fa-a818-09922de9900d admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:00.756573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:00.797527 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665ff27-faca-40e6-90dd-26b55aaad8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:00.798143 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665ff27-faca-40e6-90dd-26b55aaad8ce admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:00.798433 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665ff27-faca-40e6-90dd-26b55aaad8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:00.799409 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665ff27-faca-40e6-90dd-26b55aaad8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:00.800163 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665ff27-faca-40e6-90dd-26b55aaad8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:00.801806 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665ff27-faca-40e6-90dd-26b55aaad8ce admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:00.812299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1346/2696] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:18:00.817319 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc35468-3ce2-4c17-b06e-d4f7a23ca5c6 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:00.822934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:00.829578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc35468-3ce2-4c17-b06e-d4f7a23ca5c6 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:00.834964 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39966e1a-e73f-46d7-96ba-aad181883b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:00.835630 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39966e1a-e73f-46d7-96ba-aad181883b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:00.835961 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39966e1a-e73f-46d7-96ba-aad181883b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:00.836231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39966e1a-e73f-46d7-96ba-aad181883b27 admin admin] PATH_INFO: `/v3/projects/e9becb28fd3241d58a6d26273c3decc0/users/6ba8365315e9479f98598993680e7ae2/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:00.838327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39966e1a-e73f-46d7-96ba-aad181883b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9becb28fd3241d58a6d26273c3decc0, user_id=6ba8365315e9479f98598993680e7ae2, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:00.841006 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39966e1a-e73f-46d7-96ba-aad181883b27 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:00.853969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1351/2697] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:00 2022] PUT /identity/v3/projects/e9becb28fd3241d58a6d26273c3decc0/users/6ba8365315e9479f98598993680e7ae2/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:00.873454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71538ae-4c50-4fb1-addb-a6a0cf62da85 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:00.873897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71538ae-4c50-4fb1-addb-a6a0cf62da85 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:00.874309 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71538ae-4c50-4fb1-addb-a6a0cf62da85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:00.906184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-c71538ae-4c50-4fb1-addb-a6a0cf62da85 None None] MFA Rules not processed for user `6ba8365315e9479f98598993680e7ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:00.907431 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c71538ae-4c50-4fb1-addb-a6a0cf62da85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:00.984567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1347/2698] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:00.999200 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39966e1a-e73f-46d7-96ba-aad181883b27 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:01.000933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-39966e1a-e73f-46d7-96ba-aad181883b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:01.060454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39966e1a-e73f-46d7-96ba-aad181883b27 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:01.064121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbdc49-224d-42fa-9cc5-3ad1a49fbca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:01.065296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbdc49-224d-42fa-9cc5-3ad1a49fbca6 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:01.065570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbdc49-224d-42fa-9cc5-3ad1a49fbca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:01.066036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbdc49-224d-42fa-9cc5-3ad1a49fbca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:01.124188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbdc49-224d-42fa-9cc5-3ad1a49fbca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:01.125667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbdc49-224d-42fa-9cc5-3ad1a49fbca6 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:01.135756 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1352/2699] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:03.769625 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71538ae-4c50-4fb1-addb-a6a0cf62da85 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:03.779371 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71538ae-4c50-4fb1-addb-a6a0cf62da85 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:03.783802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fede2ba-b1eb-436f-8598-5a528a4e557e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:03.784410 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fede2ba-b1eb-436f-8598-5a528a4e557e service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:03.784705 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fede2ba-b1eb-436f-8598-5a528a4e557e service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:03.784984 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fede2ba-b1eb-436f-8598-5a528a4e557e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:03.794401 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fede2ba-b1eb-436f-8598-5a528a4e557e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:03.795839 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fede2ba-b1eb-436f-8598-5a528a4e557e service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:03.807006 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1348/2700] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:05.264625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbdc49-224d-42fa-9cc5-3ad1a49fbca6 service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:05.266556 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8cdbdc49-224d-42fa-9cc5-3ad1a49fbca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:05.382665 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbdc49-224d-42fa-9cc5-3ad1a49fbca6 service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:05.392855 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6e9f1-c3f0-4214-9e7a-5bdebaea2c31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:05.394118 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6e9f1-c3f0-4214-9e7a-5bdebaea2c31 service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:05.394709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6e9f1-c3f0-4214-9e7a-5bdebaea2c31 service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:05.395215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6e9f1-c3f0-4214-9e7a-5bdebaea2c31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:05.397584 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-16f6e9f1-c3f0-4214-9e7a-5bdebaea2c31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:05.414646 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6e9f1-c3f0-4214-9e7a-5bdebaea2c31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:05.415804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6e9f1-c3f0-4214-9e7a-5bdebaea2c31 service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:05.439934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1353/2701] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:09.089957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fede2ba-b1eb-436f-8598-5a528a4e557e service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:09.099945 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-9fede2ba-b1eb-436f-8598-5a528a4e557e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:09.116217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fede2ba-b1eb-436f-8598-5a528a4e557e service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:09.121884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f86dc9-94ab-488a-949a-f43d86399336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:09.122497 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f86dc9-94ab-488a-949a-f43d86399336 service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:09.122779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f86dc9-94ab-488a-949a-f43d86399336 service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:09.123053 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f86dc9-94ab-488a-949a-f43d86399336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:09.124852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-32f86dc9-94ab-488a-949a-f43d86399336 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:09.192627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f86dc9-94ab-488a-949a-f43d86399336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:09.194242 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f86dc9-94ab-488a-949a-f43d86399336 service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:09.203810 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1349/2702] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:18:09.521701 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6e9f1-c3f0-4214-9e7a-5bdebaea2c31 service nova] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:09.529679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-16f6e9f1-c3f0-4214-9e7a-5bdebaea2c31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:09.580224 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:09.609334 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6e9f1-c3f0-4214-9e7a-5bdebaea2c31 service nova] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:09.624433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7e0fa-b427-4e0e-88c9-17d6ffae870e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:09.624433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7e0fa-b427-4e0e-88c9-17d6ffae870e service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:09.624433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7e0fa-b427-4e0e-88c9-17d6ffae870e service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:09.624433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7e0fa-b427-4e0e-88c9-17d6ffae870e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:09.624992 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-80b7e0fa-b427-4e0e-88c9-17d6ffae870e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:09.704043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7e0fa-b427-4e0e-88c9-17d6ffae870e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:09.705790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7e0fa-b427-4e0e-88c9-17d6ffae870e service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:09.717260 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1354/2703] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:16.564559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f86dc9-94ab-488a-949a-f43d86399336 service nova] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:16.566219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-32f86dc9-94ab-488a-949a-f43d86399336 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:16.589030 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f86dc9-94ab-488a-949a-f43d86399336 service nova] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:16.594203 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:16.594924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:16.595706 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:16.595975 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] PATH_INFO: `/v3/users/7d8a58270ed34308b1f3f1ced8786292` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:16.597226 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8a58270ed34308b1f3f1ced8786292)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:16.599239 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:16.630836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:16.653333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8a58270ed34308b1f3f1ced8786292'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:16.663142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8a58270ed34308b1f3f1ced8786292'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:16.663755 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8a58270ed34308b1f3f1ced8786292'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:16.664374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8a58270ed34308b1f3f1ced8786292'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:16.679218 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8a58270ed34308b1f3f1ced8786292'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:16.692490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1350/2704] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:16 2022] DELETE /identity/v3/users/7d8a58270ed34308b1f3f1ced8786292 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:16.893362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7e0fa-b427-4e0e-88c9-17d6ffae870e service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:16.905719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7e0fa-b427-4e0e-88c9-17d6ffae870e service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:16.978641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:16.979308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:16.979589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:16.979863 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] PATH_INFO: `/v3/projects/e36f0594f3b44949aa0cc4c187e8d9c0` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:16.981062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36f0594f3b44949aa0cc4c187e8d9c0)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:16.982972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:17.033805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36f0594f3b44949aa0cc4c187e8d9c0', 'request_id': 'req-f73133f3-294d-4786-a2da-a3014e3c3885'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.039608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36f0594f3b44949aa0cc4c187e8d9c0', 'request_id': 'req-f73133f3-294d-4786-a2da-a3014e3c3885'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.047971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36f0594f3b44949aa0cc4c187e8d9c0', 'request_id': 'req-f73133f3-294d-4786-a2da-a3014e3c3885'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.060952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] The token cache is being invalidate because project e36f0594f3b44949aa0cc4c187e8d9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:17.061246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.061901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.063405 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1355/2705] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:16 2022] DELETE /identity/v3/projects/e36f0594f3b44949aa0cc4c187e8d9c0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:17.068039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:17.069444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:17.084799 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c339bb-27ed-4bcd-a031-f6927e88e974 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:17.147931 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe66cf-e68e-4f61-abc0-1cdc6986563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:17.148581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe66cf-e68e-4f61-abc0-1cdc6986563d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:17.148919 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe66cf-e68e-4f61-abc0-1cdc6986563d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:17.149203 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe66cf-e68e-4f61-abc0-1cdc6986563d admin admin] PATH_INFO: `/v3/users/6b2ecd9020e145f499a0940a8babda43` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:17.150555 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe66cf-e68e-4f61-abc0-1cdc6986563d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2ecd9020e145f499a0940a8babda43)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:17.152704 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe66cf-e68e-4f61-abc0-1cdc6986563d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:17.221633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c8fe66cf-e68e-4f61-abc0-1cdc6986563d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2ecd9020e145f499a0940a8babda43'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.222950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:17.224477 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:17.230364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c8fe66cf-e68e-4f61-abc0-1cdc6986563d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2ecd9020e145f499a0940a8babda43'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.231691 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c8fe66cf-e68e-4f61-abc0-1cdc6986563d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2ecd9020e145f499a0940a8babda43'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.232653 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c8fe66cf-e68e-4f61-abc0-1cdc6986563d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2ecd9020e145f499a0940a8babda43'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.239446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73133f3-294d-4786-a2da-a3014e3c3885 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:17.254447 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c8fe66cf-e68e-4f61-abc0-1cdc6986563d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2ecd9020e145f499a0940a8babda43'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.254614 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:17.255328 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:17.255677 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:17.255955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] PATH_INFO: `/v3/users/177f9d5cef044e7e9ea0abc545498ca4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:17.257280 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=177f9d5cef044e7e9ea0abc545498ca4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:17.259554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:17.262041 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:17.270343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1351/2706] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:17 2022] DELETE /identity/v3/users/6b2ecd9020e145f499a0940a8babda43 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:17.323655 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177f9d5cef044e7e9ea0abc545498ca4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.332785 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177f9d5cef044e7e9ea0abc545498ca4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.351133 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177f9d5cef044e7e9ea0abc545498ca4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.351895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177f9d5cef044e7e9ea0abc545498ca4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.352696 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177f9d5cef044e7e9ea0abc545498ca4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.366562 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1356/2707] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:17 2022] DELETE /identity/v3/users/177f9d5cef044e7e9ea0abc545498ca4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:18:17.380978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfbb6a-e94b-43d5-bf3b-259efe8f6e52 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:17.381273 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfbb6a-e94b-43d5-bf3b-259efe8f6e52 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:17.381551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfbb6a-e94b-43d5-bf3b-259efe8f6e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:17.402565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-54dfbb6a-e94b-43d5-bf3b-259efe8f6e52 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:17.403808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-54dfbb6a-e94b-43d5-bf3b-259efe8f6e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:17.422396 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:17.474686 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:17.476157 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:17.489971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1352/2708] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:17.496979 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab5691-2ccd-4797-a05a-02caa06828cf admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:17.502129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:17.502909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:17.503264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:17.503457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfbb6a-e94b-43d5-bf3b-259efe8f6e52 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:17.503678 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] PATH_INFO: `/v3/projects/3239c6c1ebba4b6a879eed367bbf12ef` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:17.504977 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3239c6c1ebba4b6a879eed367bbf12ef)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:17.506991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:17.509584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-54dfbb6a-e94b-43d5-bf3b-259efe8f6e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:17.568598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3239c6c1ebba4b6a879eed367bbf12ef', 'request_id': 'req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.574776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3239c6c1ebba4b6a879eed367bbf12ef', 'request_id': 'req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.583996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3239c6c1ebba4b6a879eed367bbf12ef', 'request_id': 'req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.586902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfbb6a-e94b-43d5-bf3b-259efe8f6e52 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:17.601318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] The token cache is being invalidate because project 3239c6c1ebba4b6a879eed367bbf12ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:17.601640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.602289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:17.603952 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1357/2709] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:17 2022] DELETE /identity/v3/projects/3239c6c1ebba4b6a879eed367bbf12ef => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:18:17.662383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d080d-922f-4d25-8a1f-f9d9d13bddfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:17.663064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d080d-922f-4d25-8a1f-f9d9d13bddfa service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:17.663343 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d080d-922f-4d25-8a1f-f9d9d13bddfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:17.663616 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d080d-922f-4d25-8a1f-f9d9d13bddfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:17.665568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-007d080d-922f-4d25-8a1f-f9d9d13bddfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:17.747280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d080d-922f-4d25-8a1f-f9d9d13bddfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:17.748776 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d080d-922f-4d25-8a1f-f9d9d13bddfa service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:17.760643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1353/2710] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:18:18.081988 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:18.084478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:18.099052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2ddc6-4d4a-4d0f-9d3a-9b9f0c225fcb admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:18.103999 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:18.104649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:18.104957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:18.105230 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] PATH_INFO: `/v3/projects/5b46039b388f4c63ba047c78f8cc9667` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:18.106380 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b46039b388f4c63ba047c78f8cc9667)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:18.108354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:18.167762 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b46039b388f4c63ba047c78f8cc9667', 'request_id': 'req-d3825ac1-6b62-4d0b-a8be-31a7c776525f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.173691 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b46039b388f4c63ba047c78f8cc9667', 'request_id': 'req-d3825ac1-6b62-4d0b-a8be-31a7c776525f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.175399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=75,keystone:DELETE=23,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:18.185879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b46039b388f4c63ba047c78f8cc9667', 'request_id': 'req-d3825ac1-6b62-4d0b-a8be-31a7c776525f'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.200142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] The token cache is being invalidate because project 5b46039b388f4c63ba047c78f8cc9667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:18.200487 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.201202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.202712 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1358/2711] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:18 2022] DELETE /identity/v3/projects/5b46039b388f4c63ba047c78f8cc9667 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:18:18.207359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d080d-922f-4d25-8a1f-f9d9d13bddfa service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:18.217719 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d080d-922f-4d25-8a1f-f9d9d13bddfa service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:18.257668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=100 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:18.294385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cecb4-ca03-40fe-9fa2-8cd396e12138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:18.295033 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cecb4-ca03-40fe-9fa2-8cd396e12138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:18.295317 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cecb4-ca03-40fe-9fa2-8cd396e12138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:18.295593 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cecb4-ca03-40fe-9fa2-8cd396e12138 admin admin] PATH_INFO: `/v3/users/6ba8365315e9479f98598993680e7ae2` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:18.296778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cecb4-ca03-40fe-9fa2-8cd396e12138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba8365315e9479f98598993680e7ae2)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:18.298822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cecb4-ca03-40fe-9fa2-8cd396e12138 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:18.353959 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-934cecb4-ca03-40fe-9fa2-8cd396e12138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba8365315e9479f98598993680e7ae2'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.361557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-934cecb4-ca03-40fe-9fa2-8cd396e12138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba8365315e9479f98598993680e7ae2'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.362181 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-934cecb4-ca03-40fe-9fa2-8cd396e12138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba8365315e9479f98598993680e7ae2'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.363307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-934cecb4-ca03-40fe-9fa2-8cd396e12138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba8365315e9479f98598993680e7ae2'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.375900 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-934cecb4-ca03-40fe-9fa2-8cd396e12138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba8365315e9479f98598993680e7ae2'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.389194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1354/2712] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:18 2022] DELETE /identity/v3/users/6ba8365315e9479f98598993680e7ae2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:18.689589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:18.692412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:18.709047 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3825ac1-6b62-4d0b-a8be-31a7c776525f admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:18.774541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ce2be-7eae-4c0e-8297-467dd6830d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:18.775182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ce2be-7eae-4c0e-8297-467dd6830d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:18.775462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ce2be-7eae-4c0e-8297-467dd6830d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:18.775732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ce2be-7eae-4c0e-8297-467dd6830d15 admin admin] PATH_INFO: `/v3/projects/e9becb28fd3241d58a6d26273c3decc0` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:18.776936 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ce2be-7eae-4c0e-8297-467dd6830d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9becb28fd3241d58a6d26273c3decc0)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:18.778840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ce2be-7eae-4c0e-8297-467dd6830d15 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:18.827831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-848ce2be-7eae-4c0e-8297-467dd6830d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9becb28fd3241d58a6d26273c3decc0', 'request_id': 'req-848ce2be-7eae-4c0e-8297-467dd6830d15'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.834031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-848ce2be-7eae-4c0e-8297-467dd6830d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9becb28fd3241d58a6d26273c3decc0', 'request_id': 'req-848ce2be-7eae-4c0e-8297-467dd6830d15'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.843011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-848ce2be-7eae-4c0e-8297-467dd6830d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9becb28fd3241d58a6d26273c3decc0', 'request_id': 'req-848ce2be-7eae-4c0e-8297-467dd6830d15'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.856911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-848ce2be-7eae-4c0e-8297-467dd6830d15 admin admin] The token cache is being invalidate because project e9becb28fd3241d58a6d26273c3decc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:18.857210 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-848ce2be-7eae-4c0e-8297-467dd6830d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.858088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-848ce2be-7eae-4c0e-8297-467dd6830d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:18.859928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1359/2713] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:18 2022] DELETE /identity/v3/projects/e9becb28fd3241d58a6d26273c3decc0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:18.867583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3f1df-3c67-4f3a-ab6f-71146dc9c5b4 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:18.868156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3f1df-3c67-4f3a-ab6f-71146dc9c5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:18.868256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3f1df-3c67-4f3a-ab6f-71146dc9c5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:18.890422 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-7ef3f1df-3c67-4f3a-ab6f-71146dc9c5b4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:18.892079 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-7ef3f1df-3c67-4f3a-ab6f-71146dc9c5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:19.083953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1355/2714] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:19.093436 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796483-3985-40d5-9df8-d93c0612f31b None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.093993 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796483-3985-40d5-9df8-d93c0612f31b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.094102 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796483-3985-40d5-9df8-d93c0612f31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.133869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9f796483-3985-40d5-9df8-d93c0612f31b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:19.135109 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9f796483-3985-40d5-9df8-d93c0612f31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:19.144249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1360/2715] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:19.148672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3f1df-3c67-4f3a-ab6f-71146dc9c5b4 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:19.159253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3f1df-3c67-4f3a-ab6f-71146dc9c5b4 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:19.163772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f2e23-b24c-44b4-9011-ca8a77f3b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:19.164380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f2e23-b24c-44b4-9011-ca8a77f3b166 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.164736 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f2e23-b24c-44b4-9011-ca8a77f3b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.167190 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f2e23-b24c-44b4-9011-ca8a77f3b166 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.167190 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f2e23-b24c-44b4-9011-ca8a77f3b166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:18:19.167190 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f2e23-b24c-44b4-9011-ca8a77f3b166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:19.167485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f2e23-b24c-44b4-9011-ca8a77f3b166 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:19.179991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1356/2716] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:18:19.184628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f796483-3985-40d5-9df8-d93c0612f31b None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:19.194687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f796483-3985-40d5-9df8-d93c0612f31b None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:19.199433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5fc61-d141-41b4-86bc-2a0ae1e79031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:19.200064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5fc61-d141-41b4-86bc-2a0ae1e79031 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.200340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5fc61-d141-41b4-86bc-2a0ae1e79031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.200610 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5fc61-d141-41b4-86bc-2a0ae1e79031 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.201288 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5fc61-d141-41b4-86bc-2a0ae1e79031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:19.203197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5fc61-d141-41b4-86bc-2a0ae1e79031 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:19.235320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1361/2717] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:18:19 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:19.237246 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f2e23-b24c-44b4-9011-ca8a77f3b166 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:19.247347 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f2e23-b24c-44b4-9011-ca8a77f3b166 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:19.281363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:19.307532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70f028-ad71-4b7b-8672-1d40e86b623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:19.308141 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70f028-ad71-4b7b-8672-1d40e86b623f admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.308423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70f028-ad71-4b7b-8672-1d40e86b623f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.308717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70f028-ad71-4b7b-8672-1d40e86b623f admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.309366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70f028-ad71-4b7b-8672-1d40e86b623f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:19.311269 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70f028-ad71-4b7b-8672-1d40e86b623f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:19.339089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1357/2718] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:19 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:18:19.343361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5fc61-d141-41b4-86bc-2a0ae1e79031 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:19.355213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5fc61-d141-41b4-86bc-2a0ae1e79031 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:19.360046 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75263a7-2bf1-4c03-a643-19415599623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:19.361253 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75263a7-2bf1-4c03-a643-19415599623a admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.361530 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75263a7-2bf1-4c03-a643-19415599623a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.361904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75263a7-2bf1-4c03-a643-19415599623a admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.362592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75263a7-2bf1-4c03-a643-19415599623a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:19.364205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75263a7-2bf1-4c03-a643-19415599623a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:19.374746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1362/2719] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:19.379584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70f028-ad71-4b7b-8672-1d40e86b623f admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:19.390046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70f028-ad71-4b7b-8672-1d40e86b623f admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:19.395542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc2391-8e22-4bf2-9b35-aa606b01299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:19.396113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc2391-8e22-4bf2-9b35-aa606b01299c admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.396393 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc2391-8e22-4bf2-9b35-aa606b01299c admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.396665 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc2391-8e22-4bf2-9b35-aa606b01299c admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.397334 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc2391-8e22-4bf2-9b35-aa606b01299c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:19.398957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc2391-8e22-4bf2-9b35-aa606b01299c admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:19.413685 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1358/2720] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:19.418466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75263a7-2bf1-4c03-a643-19415599623a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:19.433304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75263a7-2bf1-4c03-a643-19415599623a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:19.437984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944adc66-51a2-4e58-a3bb-f133d75d42db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:19.438955 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944adc66-51a2-4e58-a3bb-f133d75d42db admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.439637 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944adc66-51a2-4e58-a3bb-f133d75d42db admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.439912 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944adc66-51a2-4e58-a3bb-f133d75d42db admin admin] PATH_INFO: `/v3/projects/79f77baa6dec4b52920e466286cbce2a/users/fe5003421b9a49e98c7acefd2bae1c13/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.455674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944adc66-51a2-4e58-a3bb-f133d75d42db admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f77baa6dec4b52920e466286cbce2a, user_id=fe5003421b9a49e98c7acefd2bae1c13, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:19.458393 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944adc66-51a2-4e58-a3bb-f133d75d42db admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:19.471948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1363/2721] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:19 2022] PUT /identity/v3/projects/79f77baa6dec4b52920e466286cbce2a/users/fe5003421b9a49e98c7acefd2bae1c13/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:19.482430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e5ae-3db2-4401-90d5-b7d810623bca None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.482858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e5ae-3db2-4401-90d5-b7d810623bca None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.483223 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e5ae-3db2-4401-90d5-b7d810623bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.513907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-91b9e5ae-3db2-4401-90d5-b7d810623bca None None] MFA Rules not processed for user `fe5003421b9a49e98c7acefd2bae1c13`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:19.515141 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-91b9e5ae-3db2-4401-90d5-b7d810623bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:19.584314 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1359/2722] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:19.588866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944adc66-51a2-4e58-a3bb-f133d75d42db admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:19.603736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:19.663179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944adc66-51a2-4e58-a3bb-f133d75d42db admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:19.668086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab475e-6494-4c8a-a581-1ba0da38fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:19.668714 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab475e-6494-4c8a-a581-1ba0da38fa23 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.669001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab475e-6494-4c8a-a581-1ba0da38fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.669276 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab475e-6494-4c8a-a581-1ba0da38fa23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.669926 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab475e-6494-4c8a-a581-1ba0da38fa23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:19.671857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab475e-6494-4c8a-a581-1ba0da38fa23 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:19.700675 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1364/2723] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:18:19 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:19.706089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e5ae-3db2-4401-90d5-b7d810623bca None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:19.717064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e5ae-3db2-4401-90d5-b7d810623bca None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:19.778204 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a858fa0-640f-4982-90e7-4e6292066a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:19.778822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a858fa0-640f-4982-90e7-4e6292066a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.779102 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a858fa0-640f-4982-90e7-4e6292066a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.779373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a858fa0-640f-4982-90e7-4e6292066a6e admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.780011 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a858fa0-640f-4982-90e7-4e6292066a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:19.782281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a858fa0-640f-4982-90e7-4e6292066a6e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:19.806560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1360/2724] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:19 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:19.810634 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab475e-6494-4c8a-a581-1ba0da38fa23 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:19.821577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab475e-6494-4c8a-a581-1ba0da38fa23 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:19.826579 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df62d37-51e5-4ac7-9e85-3d970b70e85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:19.827233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df62d37-51e5-4ac7-9e85-3d970b70e85d admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.827629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df62d37-51e5-4ac7-9e85-3d970b70e85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.827792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df62d37-51e5-4ac7-9e85-3d970b70e85d admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.828417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df62d37-51e5-4ac7-9e85-3d970b70e85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:19.831362 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df62d37-51e5-4ac7-9e85-3d970b70e85d admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:19.842710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1365/2725] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:19.847499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a858fa0-640f-4982-90e7-4e6292066a6e admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:19.858329 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a858fa0-640f-4982-90e7-4e6292066a6e admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:19.863312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653f7f9-58ed-4d1f-a597-f24cf8c65483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:19.863978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653f7f9-58ed-4d1f-a597-f24cf8c65483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.864291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653f7f9-58ed-4d1f-a597-f24cf8c65483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.864566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653f7f9-58ed-4d1f-a597-f24cf8c65483 admin admin] PATH_INFO: `/v3/projects/151ec246234a47f29ad365fe53d1d84c/users/8b5b255cbd7d4a1c9e81e1cd0381a7ee/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.881219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653f7f9-58ed-4d1f-a597-f24cf8c65483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=151ec246234a47f29ad365fe53d1d84c, user_id=8b5b255cbd7d4a1c9e81e1cd0381a7ee, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:19.883862 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653f7f9-58ed-4d1f-a597-f24cf8c65483 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:19.897944 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1361/2726] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:19 2022] PUT /identity/v3/projects/151ec246234a47f29ad365fe53d1d84c/users/8b5b255cbd7d4a1c9e81e1cd0381a7ee/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:19.902165 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df62d37-51e5-4ac7-9e85-3d970b70e85d admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:19.914680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df62d37-51e5-4ac7-9e85-3d970b70e85d admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:19.981392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c648ba-5d73-4057-8a8c-b8a4300cffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:19.982011 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c648ba-5d73-4057-8a8c-b8a4300cffe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:19.982295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c648ba-5d73-4057-8a8c-b8a4300cffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:19.982569 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c648ba-5d73-4057-8a8c-b8a4300cffe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:19.983220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c648ba-5d73-4057-8a8c-b8a4300cffe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:19.984876 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c648ba-5d73-4057-8a8c-b8a4300cffe3 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:20.000747 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1366/2727] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:20.003438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653f7f9-58ed-4d1f-a597-f24cf8c65483 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:20.018039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653f7f9-58ed-4d1f-a597-f24cf8c65483 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:20.022717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ea600-e329-4968-9770-3f04c05c05a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:20.023374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea600-e329-4968-9770-3f04c05c05a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:20.023658 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea600-e329-4968-9770-3f04c05c05a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:20.023929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea600-e329-4968-9770-3f04c05c05a0 admin admin] PATH_INFO: `/v3/projects/151ec246234a47f29ad365fe53d1d84c/users/8b5b255cbd7d4a1c9e81e1cd0381a7ee/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:20.025880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ea600-e329-4968-9770-3f04c05c05a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=151ec246234a47f29ad365fe53d1d84c, user_id=8b5b255cbd7d4a1c9e81e1cd0381a7ee, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:20.028499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ea600-e329-4968-9770-3f04c05c05a0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:20.032159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:20.041274 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1362/2728] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:20 2022] PUT /identity/v3/projects/151ec246234a47f29ad365fe53d1d84c/users/8b5b255cbd7d4a1c9e81e1cd0381a7ee/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:20.052653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf6649-ec05-46c2-93a7-8fba9cf8b48e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:20.052984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf6649-ec05-46c2-93a7-8fba9cf8b48e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:20.053264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf6649-ec05-46c2-93a7-8fba9cf8b48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:20.087742 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8cdf6649-ec05-46c2-93a7-8fba9cf8b48e None None] MFA Rules not processed for user `8b5b255cbd7d4a1c9e81e1cd0381a7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:20.089010 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8cdf6649-ec05-46c2-93a7-8fba9cf8b48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:20.159846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1367/2729] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:20.171414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ea600-e329-4968-9770-3f04c05c05a0 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:20.173280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4b7ea600-e329-4968-9770-3f04c05c05a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:20.231729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ea600-e329-4968-9770-3f04c05c05a0 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:20.235552 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e3241-639d-4690-a73e-632621a575c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:20.236187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e3241-639d-4690-a73e-632621a575c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:20.236442 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e3241-639d-4690-a73e-632621a575c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:20.236736 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e3241-639d-4690-a73e-632621a575c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:20.246253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e3241-639d-4690-a73e-632621a575c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:20.247683 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e3241-639d-4690-a73e-632621a575c0 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:20.258297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1363/2730] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:20.311180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf6649-ec05-46c2-93a7-8fba9cf8b48e None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:20.312617 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8cdf6649-ec05-46c2-93a7-8fba9cf8b48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:20.330070 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf6649-ec05-46c2-93a7-8fba9cf8b48e None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:20.333803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73c139-e596-4c12-b50d-7318b70129cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:20.334415 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73c139-e596-4c12-b50d-7318b70129cc service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:20.334698 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73c139-e596-4c12-b50d-7318b70129cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:20.335024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73c139-e596-4c12-b50d-7318b70129cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:20.340574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:20.398851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73c139-e596-4c12-b50d-7318b70129cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:20.400315 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73c139-e596-4c12-b50d-7318b70129cc service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:20.410542 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1368/2731] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:23.953382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e3241-639d-4690-a73e-632621a575c0 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:24.050420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e3241-639d-4690-a73e-632621a575c0 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:24.058468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:24.059563 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:24.059993 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:24.060494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] PATH_INFO: `/v3/users/fe5003421b9a49e98c7acefd2bae1c13` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:24.062643 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5003421b9a49e98c7acefd2bae1c13)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:24.066893 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:24.133490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5003421b9a49e98c7acefd2bae1c13'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:24.147665 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5003421b9a49e98c7acefd2bae1c13'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:24.148378 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5003421b9a49e98c7acefd2bae1c13'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:24.149243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5003421b9a49e98c7acefd2bae1c13'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:24.166698 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5003421b9a49e98c7acefd2bae1c13'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:24.181116 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1364/2732] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:23 2022] DELETE /identity/v3/users/fe5003421b9a49e98c7acefd2bae1c13 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:18:24.185598 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b6391-8a85-4547-9619-5c59eb1b69e2 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:24.186147 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b6391-8a85-4547-9619-5c59eb1b69e2 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:24.186408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b6391-8a85-4547-9619-5c59eb1b69e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:24.206969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-bb5b6391-8a85-4547-9619-5c59eb1b69e2 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:24.208205 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-bb5b6391-8a85-4547-9619-5c59eb1b69e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:24.284433 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1369/2733] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:24.296507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:24.300091 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:24.338231 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:24.411923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a7782-b914-4ac2-99ba-fec66b288b60 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:24.433372 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f5b59-d496-43e4-bb39-f1b2cd23bc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:24.434538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f5b59-d496-43e4-bb39-f1b2cd23bc29 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:24.435039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f5b59-d496-43e4-bb39-f1b2cd23bc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:24.435856 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f5b59-d496-43e4-bb39-f1b2cd23bc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:24.453257 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f5b59-d496-43e4-bb39-f1b2cd23bc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:24.454764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f5b59-d496-43e4-bb39-f1b2cd23bc29 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:24.467026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1365/2734] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:24.838197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b6391-8a85-4547-9619-5c59eb1b69e2 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:24.839662 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-bb5b6391-8a85-4547-9619-5c59eb1b69e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:24.860732 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b6391-8a85-4547-9619-5c59eb1b69e2 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:24.868573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:24.869540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:24.870031 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:24.870446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] PATH_INFO: `/v3/projects/79f77baa6dec4b52920e466286cbce2a` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:24.871867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f77baa6dec4b52920e466286cbce2a)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:24.874356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:24.939231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f77baa6dec4b52920e466286cbce2a', 'request_id': 'req-6f42a456-30da-4874-b760-dc75b96efcaa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:24.945078 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f77baa6dec4b52920e466286cbce2a', 'request_id': 'req-6f42a456-30da-4874-b760-dc75b96efcaa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:24.954857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f77baa6dec4b52920e466286cbce2a', 'request_id': 'req-6f42a456-30da-4874-b760-dc75b96efcaa'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:24.968214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] The token cache is being invalidate because project 79f77baa6dec4b52920e466286cbce2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:24.968508 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:24.969302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:24.972104 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1370/2735] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:24 2022] DELETE /identity/v3/projects/79f77baa6dec4b52920e466286cbce2a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:24.976272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f5b59-d496-43e4-bb39-f1b2cd23bc29 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:24.986115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f5b59-d496-43e4-bb39-f1b2cd23bc29 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:25.076840 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502a8d2-c3da-421a-a125-ab4f2fa013c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:25.077830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502a8d2-c3da-421a-a125-ab4f2fa013c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:25.078145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502a8d2-c3da-421a-a125-ab4f2fa013c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:25.078819 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502a8d2-c3da-421a-a125-ab4f2fa013c0 admin admin] PATH_INFO: `/v3/users/8b5b255cbd7d4a1c9e81e1cd0381a7ee` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:25.080172 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502a8d2-c3da-421a-a125-ab4f2fa013c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5b255cbd7d4a1c9e81e1cd0381a7ee)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:25.083971 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502a8d2-c3da-421a-a125-ab4f2fa013c0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:25.167907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5502a8d2-c3da-421a-a125-ab4f2fa013c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5b255cbd7d4a1c9e81e1cd0381a7ee'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:25.184037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5502a8d2-c3da-421a-a125-ab4f2fa013c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5b255cbd7d4a1c9e81e1cd0381a7ee'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:25.184889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5502a8d2-c3da-421a-a125-ab4f2fa013c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5b255cbd7d4a1c9e81e1cd0381a7ee'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:25.185569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5502a8d2-c3da-421a-a125-ab4f2fa013c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5b255cbd7d4a1c9e81e1cd0381a7ee'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:25.212134 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5502a8d2-c3da-421a-a125-ab4f2fa013c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5b255cbd7d4a1c9e81e1cd0381a7ee'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:25.236811 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1366/2736] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:24 2022] DELETE /identity/v3/users/8b5b255cbd7d4a1c9e81e1cd0381a7ee => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:25.592448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:25.594256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:25.618528 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42a456-30da-4874-b760-dc75b96efcaa admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:25.675996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:25.721154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21322b87-009c-443d-bd4c-6e842b7a0b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:25.721401 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21322b87-009c-443d-bd4c-6e842b7a0b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:25.721587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21322b87-009c-443d-bd4c-6e842b7a0b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:25.721872 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21322b87-009c-443d-bd4c-6e842b7a0b13 admin admin] PATH_INFO: `/v3/projects/151ec246234a47f29ad365fe53d1d84c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:25.723112 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21322b87-009c-443d-bd4c-6e842b7a0b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=151ec246234a47f29ad365fe53d1d84c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:25.725099 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21322b87-009c-443d-bd4c-6e842b7a0b13 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:25.787778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-21322b87-009c-443d-bd4c-6e842b7a0b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '151ec246234a47f29ad365fe53d1d84c', 'request_id': 'req-21322b87-009c-443d-bd4c-6e842b7a0b13'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:25.795861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-21322b87-009c-443d-bd4c-6e842b7a0b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '151ec246234a47f29ad365fe53d1d84c', 'request_id': 'req-21322b87-009c-443d-bd4c-6e842b7a0b13'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:25.805770 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-21322b87-009c-443d-bd4c-6e842b7a0b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '151ec246234a47f29ad365fe53d1d84c', 'request_id': 'req-21322b87-009c-443d-bd4c-6e842b7a0b13'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:25.818578 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-21322b87-009c-443d-bd4c-6e842b7a0b13 admin admin] The token cache is being invalidate because project 151ec246234a47f29ad365fe53d1d84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:25.818962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-21322b87-009c-443d-bd4c-6e842b7a0b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:25.819683 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-21322b87-009c-443d-bd4c-6e842b7a0b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:25.821485 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1371/2737] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:25 2022] DELETE /identity/v3/projects/151ec246234a47f29ad365fe53d1d84c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:25.826133 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381be95-eb46-4b22-9b73-c07d9aac2344 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:25.826426 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381be95-eb46-4b22-9b73-c07d9aac2344 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:25.826765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381be95-eb46-4b22-9b73-c07d9aac2344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:25.848486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-3381be95-eb46-4b22-9b73-c07d9aac2344 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:25.849754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3381be95-eb46-4b22-9b73-c07d9aac2344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:25.888702 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:25.920126 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1367/2738] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:25.929964 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e844e39-048f-4644-b4f6-96af1ce4dfd7 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:25.930257 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e844e39-048f-4644-b4f6-96af1ce4dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:25.930535 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e844e39-048f-4644-b4f6-96af1ce4dfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:25.952615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8e844e39-048f-4644-b4f6-96af1ce4dfd7 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:25.954650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8e844e39-048f-4644-b4f6-96af1ce4dfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:25.963754 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1372/2739] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:25.968115 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381be95-eb46-4b22-9b73-c07d9aac2344 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:25.979344 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381be95-eb46-4b22-9b73-c07d9aac2344 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:25.984850 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2416c2-4d38-4afa-8c00-6e5e35a9b028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:25.986185 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2416c2-4d38-4afa-8c00-6e5e35a9b028 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:25.986481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2416c2-4d38-4afa-8c00-6e5e35a9b028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:25.986762 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2416c2-4d38-4afa-8c00-6e5e35a9b028 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:25.987456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2416c2-4d38-4afa-8c00-6e5e35a9b028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:18:25.987761 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2416c2-4d38-4afa-8c00-6e5e35a9b028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:25.989522 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2416c2-4d38-4afa-8c00-6e5e35a9b028 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:26.002896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1368/2740] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:18:26.007602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e844e39-048f-4644-b4f6-96af1ce4dfd7 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:26.018859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e844e39-048f-4644-b4f6-96af1ce4dfd7 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:26.023644 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe759abe-dacb-4fda-9927-92822b12504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:26.024274 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe759abe-dacb-4fda-9927-92822b12504b admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:26.024709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe759abe-dacb-4fda-9927-92822b12504b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:26.025021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe759abe-dacb-4fda-9927-92822b12504b admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:26.025673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe759abe-dacb-4fda-9927-92822b12504b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:26.027602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe759abe-dacb-4fda-9927-92822b12504b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:26.058934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1373/2741] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:18:26 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:18:26.064061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2416c2-4d38-4afa-8c00-6e5e35a9b028 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:26.078291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2416c2-4d38-4afa-8c00-6e5e35a9b028 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:26.151685 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172cea4-76cb-4336-8f97-4fd39818a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:26.152310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172cea4-76cb-4336-8f97-4fd39818a1ce admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:26.152609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172cea4-76cb-4336-8f97-4fd39818a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:26.152903 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172cea4-76cb-4336-8f97-4fd39818a1ce admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:26.153557 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172cea4-76cb-4336-8f97-4fd39818a1ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:26.155489 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172cea4-76cb-4336-8f97-4fd39818a1ce admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:26.182458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1369/2742] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:26 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:26.183731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe759abe-dacb-4fda-9927-92822b12504b admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:26.195483 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe759abe-dacb-4fda-9927-92822b12504b admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:26.202398 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47b89c-b2f9-466d-addd-5d8b121e05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:26.203360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47b89c-b2f9-466d-addd-5d8b121e05a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:26.203931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47b89c-b2f9-466d-addd-5d8b121e05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:26.205196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47b89c-b2f9-466d-addd-5d8b121e05a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:26.206331 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47b89c-b2f9-466d-addd-5d8b121e05a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:26.209303 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47b89c-b2f9-466d-addd-5d8b121e05a5 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:26.220966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1374/2743] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:26.224890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172cea4-76cb-4336-8f97-4fd39818a1ce admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:26.235449 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172cea4-76cb-4336-8f97-4fd39818a1ce admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:26.240965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717c60b-2493-4f42-b88e-738bee842c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:26.241637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717c60b-2493-4f42-b88e-738bee842c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:26.241924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717c60b-2493-4f42-b88e-738bee842c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:26.242208 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717c60b-2493-4f42-b88e-738bee842c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:26.243048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717c60b-2493-4f42-b88e-738bee842c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:26.244907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717c60b-2493-4f42-b88e-738bee842c82 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:26.257939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1370/2744] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:26.262370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47b89c-b2f9-466d-addd-5d8b121e05a5 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:26.274035 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47b89c-b2f9-466d-addd-5d8b121e05a5 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:26.279453 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facca6a-c90f-475c-b23f-a50d1a23ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:26.280157 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facca6a-c90f-475c-b23f-a50d1a23ef1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:26.280566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facca6a-c90f-475c-b23f-a50d1a23ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:26.281137 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facca6a-c90f-475c-b23f-a50d1a23ef1d admin admin] PATH_INFO: `/v3/projects/ccfba53f41d7423ca39cf63c3b1c7747/users/080a21e578fe4eb89a2e0a07f9bc4880/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:26.296977 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facca6a-c90f-475c-b23f-a50d1a23ef1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccfba53f41d7423ca39cf63c3b1c7747, user_id=080a21e578fe4eb89a2e0a07f9bc4880, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:26.300178 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facca6a-c90f-475c-b23f-a50d1a23ef1d admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:26.317550 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1375/2745] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:26 2022] PUT /identity/v3/projects/ccfba53f41d7423ca39cf63c3b1c7747/users/080a21e578fe4eb89a2e0a07f9bc4880/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:26.328002 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896a80c-b425-4a38-8db3-51fc8cf50468 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:26.328365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896a80c-b425-4a38-8db3-51fc8cf50468 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:26.328775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896a80c-b425-4a38-8db3-51fc8cf50468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:26.359679 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-a896a80c-b425-4a38-8db3-51fc8cf50468 None None] MFA Rules not processed for user `080a21e578fe4eb89a2e0a07f9bc4880`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:26.361639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a896a80c-b425-4a38-8db3-51fc8cf50468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:26.452321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1371/2746] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:26.457744 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facca6a-c90f-475c-b23f-a50d1a23ef1d admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:26.524199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:26.528566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facca6a-c90f-475c-b23f-a50d1a23ef1d admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:26.538448 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ce8ef-e6e4-4f24-8708-32546b3e04de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:26.539615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ce8ef-e6e4-4f24-8708-32546b3e04de admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:26.540062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ce8ef-e6e4-4f24-8708-32546b3e04de admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:26.540569 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ce8ef-e6e4-4f24-8708-32546b3e04de admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:26.541367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ce8ef-e6e4-4f24-8708-32546b3e04de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:26.543325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ce8ef-e6e4-4f24-8708-32546b3e04de admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:26.580332 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1376/2747] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:18:26 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:18:26.585924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896a80c-b425-4a38-8db3-51fc8cf50468 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:26.600475 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896a80c-b425-4a38-8db3-51fc8cf50468 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:26.649772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:26.708963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a1a0a-3385-48be-94a0-18ba2f1a5fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:26.710007 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a1a0a-3385-48be-94a0-18ba2f1a5fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:26.710560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a1a0a-3385-48be-94a0-18ba2f1a5fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:26.711062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a1a0a-3385-48be-94a0-18ba2f1a5fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:26.712081 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a1a0a-3385-48be-94a0-18ba2f1a5fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:26.714189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a1a0a-3385-48be-94a0-18ba2f1a5fc0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:26.737884 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1372/2748] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:26 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:18:26.742175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ce8ef-e6e4-4f24-8708-32546b3e04de admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:26.760454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ce8ef-e6e4-4f24-8708-32546b3e04de admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:26.765013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876583ac-2df2-4ac2-9bdd-20a99839b3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:26.765633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876583ac-2df2-4ac2-9bdd-20a99839b3fb admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:26.765917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876583ac-2df2-4ac2-9bdd-20a99839b3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:26.766192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876583ac-2df2-4ac2-9bdd-20a99839b3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:26.767452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876583ac-2df2-4ac2-9bdd-20a99839b3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:26.769244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876583ac-2df2-4ac2-9bdd-20a99839b3fb admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:26.783124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1377/2749] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:26.787336 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a1a0a-3385-48be-94a0-18ba2f1a5fc0 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:26.797953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a1a0a-3385-48be-94a0-18ba2f1a5fc0 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:26.802969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aa8b3-ee9d-4516-9822-606040ab38a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:26.803634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa8b3-ee9d-4516-9822-606040ab38a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:26.803912 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa8b3-ee9d-4516-9822-606040ab38a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:26.804182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa8b3-ee9d-4516-9822-606040ab38a4 admin admin] PATH_INFO: `/v3/projects/1e71381f83844427ab442da7d42ba5d7/users/20447581872048428154de6c74c36fd0/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:26.823662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962aa8b3-ee9d-4516-9822-606040ab38a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e71381f83844427ab442da7d42ba5d7, user_id=20447581872048428154de6c74c36fd0, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:26.826809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962aa8b3-ee9d-4516-9822-606040ab38a4 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:26.844965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1373/2750] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:26 2022] PUT /identity/v3/projects/1e71381f83844427ab442da7d42ba5d7/users/20447581872048428154de6c74c36fd0/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:26.848857 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876583ac-2df2-4ac2-9bdd-20a99839b3fb admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:26.859417 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876583ac-2df2-4ac2-9bdd-20a99839b3fb admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:26.940159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16595648-5e27-46af-951a-8c635300255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:26.940834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16595648-5e27-46af-951a-8c635300255a admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:26.941440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16595648-5e27-46af-951a-8c635300255a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:26.941440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16595648-5e27-46af-951a-8c635300255a admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:26.942053 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16595648-5e27-46af-951a-8c635300255a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:26.944723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16595648-5e27-46af-951a-8c635300255a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:26.960325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1378/2751] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:26.963075 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aa8b3-ee9d-4516-9822-606040ab38a4 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:26.976879 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aa8b3-ee9d-4516-9822-606040ab38a4 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:26.981919 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f7e56-2b26-41db-a007-0b103fa0fc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:26.982837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f7e56-2b26-41db-a007-0b103fa0fc15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:26.982837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f7e56-2b26-41db-a007-0b103fa0fc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:26.983164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f7e56-2b26-41db-a007-0b103fa0fc15 admin admin] PATH_INFO: `/v3/projects/1e71381f83844427ab442da7d42ba5d7/users/20447581872048428154de6c74c36fd0/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:26.985478 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f7e56-2b26-41db-a007-0b103fa0fc15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e71381f83844427ab442da7d42ba5d7, user_id=20447581872048428154de6c74c36fd0, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:26.989339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f7e56-2b26-41db-a007-0b103fa0fc15 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:27.003170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1374/2752] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:26 2022] PUT /identity/v3/projects/1e71381f83844427ab442da7d42ba5d7/users/20447581872048428154de6c74c36fd0/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:18:27.014908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311481-82bf-483e-a47f-88608a548f85 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:27.015574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311481-82bf-483e-a47f-88608a548f85 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:27.016121 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311481-82bf-483e-a47f-88608a548f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:27.055114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8d311481-82bf-483e-a47f-88608a548f85 None None] MFA Rules not processed for user `20447581872048428154de6c74c36fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:27.057324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8d311481-82bf-483e-a47f-88608a548f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:27.157631 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1379/2753] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:18:27.172311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f7e56-2b26-41db-a007-0b103fa0fc15 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:27.175281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a26f7e56-2b26-41db-a007-0b103fa0fc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:27.249848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f7e56-2b26-41db-a007-0b103fa0fc15 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:27.255164 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a826a-a82d-4838-952f-6aa48684455c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:27.256744 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a826a-a82d-4838-952f-6aa48684455c service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:27.256744 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a826a-a82d-4838-952f-6aa48684455c service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:27.256744 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a826a-a82d-4838-952f-6aa48684455c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:27.272110 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a826a-a82d-4838-952f-6aa48684455c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:27.276624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a826a-a82d-4838-952f-6aa48684455c service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:27.288339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1375/2754] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:27.406853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d311481-82bf-483e-a47f-88608a548f85 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:27.418559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fe6e5-711c-4432-b8e4-d6f37c7cb163 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:27.418824 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fe6e5-711c-4432-b8e4-d6f37c7cb163 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:27.419046 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fe6e5-711c-4432-b8e4-d6f37c7cb163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:27.427128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d311481-82bf-483e-a47f-88608a548f85 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:27.431852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5eb09-a2c0-46ba-aded-877a0b50e856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:27.432501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5eb09-a2c0-46ba-aded-877a0b50e856 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:27.433379 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5eb09-a2c0-46ba-aded-877a0b50e856 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:27.433671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5eb09-a2c0-46ba-aded-877a0b50e856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:27.440486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-062fe6e5-711c-4432-b8e4-d6f37c7cb163 None None] MFA Rules not processed for user `f798985ff3b94ee7ac098697355aecfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:27.441874 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-062fe6e5-711c-4432-b8e4-d6f37c7cb163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:27.492963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:27.504324 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5eb09-a2c0-46ba-aded-877a0b50e856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:27.505825 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5eb09-a2c0-46ba-aded-877a0b50e856 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:27.509405 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1376/2755] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:18:27.515839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1380/2756] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:32.463989 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fe6e5-711c-4432-b8e4-d6f37c7cb163 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:32.507385 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:32.580157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fe6e5-711c-4432-b8e4-d6f37c7cb163 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:32.585471 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:32.586288 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:32.586575 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:32.586849 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] PATH_INFO: `/v3/users/080a21e578fe4eb89a2e0a07f9bc4880` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:32.587987 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] RBAC: Authorizing `identity:delete_user(user_id=080a21e578fe4eb89a2e0a07f9bc4880)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:32.589990 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:32.652446 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080a21e578fe4eb89a2e0a07f9bc4880'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:32.664984 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080a21e578fe4eb89a2e0a07f9bc4880'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:32.665666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080a21e578fe4eb89a2e0a07f9bc4880'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:32.666371 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080a21e578fe4eb89a2e0a07f9bc4880'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:32.679509 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080a21e578fe4eb89a2e0a07f9bc4880'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:32.694251 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1377/2757] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:32 2022] DELETE /identity/v3/users/080a21e578fe4eb89a2e0a07f9bc4880 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:32.698855 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ea8b-96bf-43d1-9552-63ecf0c9ae11 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:32.699543 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ea8b-96bf-43d1-9552-63ecf0c9ae11 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:32.699543 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ea8b-96bf-43d1-9552-63ecf0c9ae11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:32.753217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-4e99ea8b-96bf-43d1-9552-63ecf0c9ae11 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:32.754527 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4e99ea8b-96bf-43d1-9552-63ecf0c9ae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:32.823455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1381/2758] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:32.833914 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:32.835376 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:32.908034 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7217d2f-1383-4393-a778-dc81570051de admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:32.911573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3b13-50fa-4568-b30a-d16eee39697f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:32.912166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3b13-50fa-4568-b30a-d16eee39697f service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:32.912441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3b13-50fa-4568-b30a-d16eee39697f service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:32.912741 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3b13-50fa-4568-b30a-d16eee39697f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:32.921462 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3b13-50fa-4568-b30a-d16eee39697f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:32.922901 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3b13-50fa-4568-b30a-d16eee39697f service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:32.927777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:32.934613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1378/2759] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:33.242339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99ea8b-96bf-43d1-9552-63ecf0c9ae11 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:33.243856 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-4e99ea8b-96bf-43d1-9552-63ecf0c9ae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:33.257867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99ea8b-96bf-43d1-9552-63ecf0c9ae11 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:33.263115 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:33.263960 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:33.264425 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:33.264877 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] PATH_INFO: `/v3/projects/ccfba53f41d7423ca39cf63c3b1c7747` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:33.266264 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccfba53f41d7423ca39cf63c3b1c7747)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:33.268371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:33.319524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccfba53f41d7423ca39cf63c3b1c7747', 'request_id': 'req-9d85c6af-62dd-4919-adca-7d53c0350391'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.324892 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccfba53f41d7423ca39cf63c3b1c7747', 'request_id': 'req-9d85c6af-62dd-4919-adca-7d53c0350391'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.333267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccfba53f41d7423ca39cf63c3b1c7747', 'request_id': 'req-9d85c6af-62dd-4919-adca-7d53c0350391'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.344604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] The token cache is being invalidate because project ccfba53f41d7423ca39cf63c3b1c7747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:33.345469 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.346336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.347925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1382/2760] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:33 2022] DELETE /identity/v3/projects/ccfba53f41d7423ca39cf63c3b1c7747 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:33.351876 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3b13-50fa-4568-b30a-d16eee39697f service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:33.362382 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3b13-50fa-4568-b30a-d16eee39697f service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:33.426753 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3657ff-ae17-415f-9af9-3b962d87d9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:33.427387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3657ff-ae17-415f-9af9-3b962d87d9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:33.427662 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3657ff-ae17-415f-9af9-3b962d87d9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:33.427934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3657ff-ae17-415f-9af9-3b962d87d9fc admin admin] PATH_INFO: `/v3/users/20447581872048428154de6c74c36fd0` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:33.429121 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3657ff-ae17-415f-9af9-3b962d87d9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=20447581872048428154de6c74c36fd0)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:33.431097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3657ff-ae17-415f-9af9-3b962d87d9fc admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:33.480967 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5e3657ff-ae17-415f-9af9-3b962d87d9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20447581872048428154de6c74c36fd0'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.490630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5e3657ff-ae17-415f-9af9-3b962d87d9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20447581872048428154de6c74c36fd0'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.491838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5e3657ff-ae17-415f-9af9-3b962d87d9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20447581872048428154de6c74c36fd0'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.492560 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5e3657ff-ae17-415f-9af9-3b962d87d9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20447581872048428154de6c74c36fd0'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.505832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5e3657ff-ae17-415f-9af9-3b962d87d9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20447581872048428154de6c74c36fd0'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.518407 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1379/2761] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:33 2022] DELETE /identity/v3/users/20447581872048428154de6c74c36fd0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:33.814521 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:33.816061 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:33.830385 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85c6af-62dd-4919-adca-7d53c0350391 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:33.883295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:33.898687 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e7aa3-2533-4dd6-95df-e20fa8bac530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:33.899432 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e7aa3-2533-4dd6-95df-e20fa8bac530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:33.899822 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e7aa3-2533-4dd6-95df-e20fa8bac530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:33.900196 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e7aa3-2533-4dd6-95df-e20fa8bac530 admin admin] PATH_INFO: `/v3/projects/1e71381f83844427ab442da7d42ba5d7` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:33.901504 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e7aa3-2533-4dd6-95df-e20fa8bac530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e71381f83844427ab442da7d42ba5d7)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:33.903783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e7aa3-2533-4dd6-95df-e20fa8bac530 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:33.950651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-449e7aa3-2533-4dd6-95df-e20fa8bac530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e71381f83844427ab442da7d42ba5d7', 'request_id': 'req-449e7aa3-2533-4dd6-95df-e20fa8bac530'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.956599 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-449e7aa3-2533-4dd6-95df-e20fa8bac530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e71381f83844427ab442da7d42ba5d7', 'request_id': 'req-449e7aa3-2533-4dd6-95df-e20fa8bac530'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.964731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-449e7aa3-2533-4dd6-95df-e20fa8bac530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e71381f83844427ab442da7d42ba5d7', 'request_id': 'req-449e7aa3-2533-4dd6-95df-e20fa8bac530'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.978907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-449e7aa3-2533-4dd6-95df-e20fa8bac530 admin admin] The token cache is being invalidate because project 1e71381f83844427ab442da7d42ba5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:33.979204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-449e7aa3-2533-4dd6-95df-e20fa8bac530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.979927 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-449e7aa3-2533-4dd6-95df-e20fa8bac530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:33.981801 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1383/2762] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:33 2022] DELETE /identity/v3/projects/1e71381f83844427ab442da7d42ba5d7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:33.986871 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc990ad-d91f-4422-a1c3-e93482c84848 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:33.987214 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc990ad-d91f-4422-a1c3-e93482c84848 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:33.987500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc990ad-d91f-4422-a1c3-e93482c84848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.046456 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-4cc990ad-d91f-4422-a1c3-e93482c84848 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:34.047764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4cc990ad-d91f-4422-a1c3-e93482c84848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:34.099740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:34.112953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1380/2763] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:34.120949 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b0955-31e6-484a-b734-292ce088314d None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.121240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b0955-31e6-484a-b734-292ce088314d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.121520 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b0955-31e6-484a-b734-292ce088314d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.141971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-ee5b0955-31e6-484a-b734-292ce088314d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:34.143071 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ee5b0955-31e6-484a-b734-292ce088314d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:34.150978 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1384/2764] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:34.155485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc990ad-d91f-4422-a1c3-e93482c84848 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:34.166088 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc990ad-d91f-4422-a1c3-e93482c84848 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:34.170724 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ec46-cd60-4327-8c0c-013622fb53ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:34.171327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ec46-cd60-4327-8c0c-013622fb53ed admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.171605 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ec46-cd60-4327-8c0c-013622fb53ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.171875 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ec46-cd60-4327-8c0c-013622fb53ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.172526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98ec46-cd60-4327-8c0c-013622fb53ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:18:34.172855 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98ec46-cd60-4327-8c0c-013622fb53ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:34.174474 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98ec46-cd60-4327-8c0c-013622fb53ed admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:34.186258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1381/2765] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:18:34.191473 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b0955-31e6-484a-b734-292ce088314d None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:34.200703 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b0955-31e6-484a-b734-292ce088314d None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:34.205974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e8570-bb62-4c13-a5c3-7d4d522529f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:34.206573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e8570-bb62-4c13-a5c3-7d4d522529f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.206852 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e8570-bb62-4c13-a5c3-7d4d522529f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.207125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e8570-bb62-4c13-a5c3-7d4d522529f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.207767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e8570-bb62-4c13-a5c3-7d4d522529f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:34.209733 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e8570-bb62-4c13-a5c3-7d4d522529f1 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:34.238080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1385/2766] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:18:34 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:34.242318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ec46-cd60-4327-8c0c-013622fb53ed admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:34.253367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ec46-cd60-4327-8c0c-013622fb53ed admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:34.318781 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadd85d-894d-42ce-be66-7cd89a634294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:34.319392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadd85d-894d-42ce-be66-7cd89a634294 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.319670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadd85d-894d-42ce-be66-7cd89a634294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.319940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadd85d-894d-42ce-be66-7cd89a634294 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.320579 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadd85d-894d-42ce-be66-7cd89a634294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:34.322544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadd85d-894d-42ce-be66-7cd89a634294 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:34.355637 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1382/2767] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:34 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:34.355851 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e8570-bb62-4c13-a5c3-7d4d522529f1 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:34.377903 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e8570-bb62-4c13-a5c3-7d4d522529f1 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:34.386347 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622990d2-4bb1-4a1a-b834-fa0b24b654ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:34.387408 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622990d2-4bb1-4a1a-b834-fa0b24b654ae admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.387907 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622990d2-4bb1-4a1a-b834-fa0b24b654ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.388403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622990d2-4bb1-4a1a-b834-fa0b24b654ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.389651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622990d2-4bb1-4a1a-b834-fa0b24b654ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:34.394352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622990d2-4bb1-4a1a-b834-fa0b24b654ae admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:34.414724 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1386/2768] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:34.422483 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadd85d-894d-42ce-be66-7cd89a634294 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:34.433180 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadd85d-894d-42ce-be66-7cd89a634294 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:34.437857 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047ab74-4003-4864-9018-4a360d7a3e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:34.439322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047ab74-4003-4864-9018-4a360d7a3e31 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.439604 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047ab74-4003-4864-9018-4a360d7a3e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.439877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047ab74-4003-4864-9018-4a360d7a3e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.440526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047ab74-4003-4864-9018-4a360d7a3e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:34.442156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047ab74-4003-4864-9018-4a360d7a3e31 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:34.456367 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1383/2769] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:34.460979 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622990d2-4bb1-4a1a-b834-fa0b24b654ae admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:34.471649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622990d2-4bb1-4a1a-b834-fa0b24b654ae admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:34.476673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9677bd4-e242-4531-932b-8044c2a134e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:34.477366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9677bd4-e242-4531-932b-8044c2a134e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.477650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9677bd4-e242-4531-932b-8044c2a134e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.477928 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9677bd4-e242-4531-932b-8044c2a134e9 admin admin] PATH_INFO: `/v3/projects/1c189f7f122e4ba9895ff20c6f76af62/users/4afed33db29b4ad1a3b9c62b09dd44b2/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.495002 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9677bd4-e242-4531-932b-8044c2a134e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c189f7f122e4ba9895ff20c6f76af62, user_id=4afed33db29b4ad1a3b9c62b09dd44b2, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:34.497721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9677bd4-e242-4531-932b-8044c2a134e9 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:34.511631 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1387/2770] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:34 2022] PUT /identity/v3/projects/1c189f7f122e4ba9895ff20c6f76af62/users/4afed33db29b4ad1a3b9c62b09dd44b2/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:34.522903 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e922cd-2fff-438b-8e9f-6fe19359786f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.523464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e922cd-2fff-438b-8e9f-6fe19359786f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.523464 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e922cd-2fff-438b-8e9f-6fe19359786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.552435 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-f2e922cd-2fff-438b-8e9f-6fe19359786f None None] MFA Rules not processed for user `4afed33db29b4ad1a3b9c62b09dd44b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:34.553699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f2e922cd-2fff-438b-8e9f-6fe19359786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:34.622123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1384/2771] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:18:34.627593 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9677bd4-e242-4531-932b-8044c2a134e9 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:34.689340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9677bd4-e242-4531-932b-8044c2a134e9 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:34.694697 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c622be-d038-4b67-9a63-1561ef55a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:34.695316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c622be-d038-4b67-9a63-1561ef55a43f admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.695597 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c622be-d038-4b67-9a63-1561ef55a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.695868 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c622be-d038-4b67-9a63-1561ef55a43f admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.696667 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c622be-d038-4b67-9a63-1561ef55a43f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:34.700446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c622be-d038-4b67-9a63-1561ef55a43f admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:34.723537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:34.731092 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1388/2772] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:18:34 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:34.736271 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e922cd-2fff-438b-8e9f-6fe19359786f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:34.746818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e922cd-2fff-438b-8e9f-6fe19359786f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:34.792511 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:34.808668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8806c09-8679-4052-bdd0-cffe766f43ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:34.808668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8806c09-8679-4052-bdd0-cffe766f43ff admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.808668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8806c09-8679-4052-bdd0-cffe766f43ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.808668 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8806c09-8679-4052-bdd0-cffe766f43ff admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.809217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8806c09-8679-4052-bdd0-cffe766f43ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:34.809217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8806c09-8679-4052-bdd0-cffe766f43ff admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:34.830420 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1385/2773] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:34 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:34.834474 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c622be-d038-4b67-9a63-1561ef55a43f admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:34.845291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c622be-d038-4b67-9a63-1561ef55a43f admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:34.849874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a52dc6-118b-4caa-bb7d-90da1fcb6489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:34.850481 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a52dc6-118b-4caa-bb7d-90da1fcb6489 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.850760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a52dc6-118b-4caa-bb7d-90da1fcb6489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.851034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a52dc6-118b-4caa-bb7d-90da1fcb6489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.851679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a52dc6-118b-4caa-bb7d-90da1fcb6489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:34.853296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a52dc6-118b-4caa-bb7d-90da1fcb6489 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:34.864985 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1389/2774] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:34.869270 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8806c09-8679-4052-bdd0-cffe766f43ff admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:34.881251 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8806c09-8679-4052-bdd0-cffe766f43ff admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:34.887295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a5885-28c0-4b16-8238-f2178cfca971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:34.887960 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a5885-28c0-4b16-8238-f2178cfca971 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.888243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a5885-28c0-4b16-8238-f2178cfca971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.888518 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a5885-28c0-4b16-8238-f2178cfca971 admin admin] PATH_INFO: `/v3/projects/0e130bda901d43398a525880d48e1314/users/8e862b5eb90b4a5ab859df9aeaa37212/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:34.904245 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a5885-28c0-4b16-8238-f2178cfca971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e130bda901d43398a525880d48e1314, user_id=8e862b5eb90b4a5ab859df9aeaa37212, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:34.907256 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a5885-28c0-4b16-8238-f2178cfca971 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:34.921439 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1386/2775] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:34 2022] PUT /identity/v3/projects/0e130bda901d43398a525880d48e1314/users/8e862b5eb90b4a5ab859df9aeaa37212/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:34.926671 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a52dc6-118b-4caa-bb7d-90da1fcb6489 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:34.936963 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a52dc6-118b-4caa-bb7d-90da1fcb6489 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:34.998120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713ad82-1230-40cd-8dac-63cb70703cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:34.999073 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713ad82-1230-40cd-8dac-63cb70703cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:34.999356 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713ad82-1230-40cd-8dac-63cb70703cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:34.999628 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713ad82-1230-40cd-8dac-63cb70703cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:35.000309 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713ad82-1230-40cd-8dac-63cb70703cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:35.002403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713ad82-1230-40cd-8dac-63cb70703cc4 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:35.016446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1390/2776] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:35.017798 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a5885-28c0-4b16-8238-f2178cfca971 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:35.030224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a5885-28c0-4b16-8238-f2178cfca971 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:35.035503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d412128-c59a-4264-b927-3225ec1a595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:35.036187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d412128-c59a-4264-b927-3225ec1a595d admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:35.036466 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d412128-c59a-4264-b927-3225ec1a595d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:35.036766 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d412128-c59a-4264-b927-3225ec1a595d admin admin] PATH_INFO: `/v3/projects/0e130bda901d43398a525880d48e1314/users/8e862b5eb90b4a5ab859df9aeaa37212/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:35.038767 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d412128-c59a-4264-b927-3225ec1a595d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e130bda901d43398a525880d48e1314, user_id=8e862b5eb90b4a5ab859df9aeaa37212, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:35.041453 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d412128-c59a-4264-b927-3225ec1a595d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:35.053428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1387/2777] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:35 2022] PUT /identity/v3/projects/0e130bda901d43398a525880d48e1314/users/8e862b5eb90b4a5ab859df9aeaa37212/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:35.122269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5484ac-5ae9-453a-827f-cf8ef15d4306 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:35.122554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5484ac-5ae9-453a-827f-cf8ef15d4306 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:35.122828 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5484ac-5ae9-453a-827f-cf8ef15d4306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:35.163443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-9e5484ac-5ae9-453a-827f-cf8ef15d4306 None None] MFA Rules not processed for user `8e862b5eb90b4a5ab859df9aeaa37212`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:35.164900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-9e5484ac-5ae9-453a-827f-cf8ef15d4306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:35.250204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1391/2778] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:35.263400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d412128-c59a-4264-b927-3225ec1a595d admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:35.265157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0d412128-c59a-4264-b927-3225ec1a595d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:35.331311 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d412128-c59a-4264-b927-3225ec1a595d admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:35.335225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef054d-7fb9-4c77-b595-95fcdfea9e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:35.335830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef054d-7fb9-4c77-b595-95fcdfea9e8f service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:35.336109 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef054d-7fb9-4c77-b595-95fcdfea9e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:35.336379 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef054d-7fb9-4c77-b595-95fcdfea9e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:35.347951 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef054d-7fb9-4c77-b595-95fcdfea9e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:35.349500 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef054d-7fb9-4c77-b595-95fcdfea9e8f service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:35.359525 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1388/2779] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:18:36.016752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5484ac-5ae9-453a-827f-cf8ef15d4306 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:36.083040 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5484ac-5ae9-453a-827f-cf8ef15d4306 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:36.087761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:36.088429 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:36.088731 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:36.089007 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] PATH_INFO: `/v3/users/4afed33db29b4ad1a3b9c62b09dd44b2` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:36.090135 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4afed33db29b4ad1a3b9c62b09dd44b2)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:36.092084 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:36.105764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:36.145894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4afed33db29b4ad1a3b9c62b09dd44b2'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.154141 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4afed33db29b4ad1a3b9c62b09dd44b2'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.167359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4afed33db29b4ad1a3b9c62b09dd44b2'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.168099 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4afed33db29b4ad1a3b9c62b09dd44b2'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.168721 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4afed33db29b4ad1a3b9c62b09dd44b2'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.182471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1392/2780] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:36 2022] DELETE /identity/v3/users/4afed33db29b4ad1a3b9c62b09dd44b2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:36.187432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46ddc4-4ea8-4bbb-9c00-3f18c096bc93 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:36.188580 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46ddc4-4ea8-4bbb-9c00-3f18c096bc93 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:36.188729 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46ddc4-4ea8-4bbb-9c00-3f18c096bc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:36.208822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-8c46ddc4-4ea8-4bbb-9c00-3f18c096bc93 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:36.210356 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8c46ddc4-4ea8-4bbb-9c00-3f18c096bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:36.273632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1389/2781] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:36.284159 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:36.285641 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:36.358175 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d465f8-5c0a-4e4c-8920-d9bb5ecca8e9 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:36.363649 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d082e0-d4e6-4e9c-8073-688604dc26c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:36.364452 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d082e0-d4e6-4e9c-8073-688604dc26c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:36.364760 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d082e0-d4e6-4e9c-8073-688604dc26c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:36.365037 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d082e0-d4e6-4e9c-8073-688604dc26c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:36.376490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d082e0-d4e6-4e9c-8073-688604dc26c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:36.377995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d082e0-d4e6-4e9c-8073-688604dc26c7 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:36.389005 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1393/2782] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:36.690892 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46ddc4-4ea8-4bbb-9c00-3f18c096bc93 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:36.692322 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-8c46ddc4-4ea8-4bbb-9c00-3f18c096bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:36.707634 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46ddc4-4ea8-4bbb-9c00-3f18c096bc93 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:36.712433 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:36.713113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:36.713399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:36.713675 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] PATH_INFO: `/v3/projects/1c189f7f122e4ba9895ff20c6f76af62` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:36.714801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c189f7f122e4ba9895ff20c6f76af62)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:36.716778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:36.764310 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:36.774023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c189f7f122e4ba9895ff20c6f76af62', 'request_id': 'req-887b3b8d-9aa2-4834-87d6-f709465c325e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.783610 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c189f7f122e4ba9895ff20c6f76af62', 'request_id': 'req-887b3b8d-9aa2-4834-87d6-f709465c325e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.789342 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c189f7f122e4ba9895ff20c6f76af62', 'request_id': 'req-887b3b8d-9aa2-4834-87d6-f709465c325e'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.801749 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] The token cache is being invalidate because project 1c189f7f122e4ba9895ff20c6f76af62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:36.803119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.805119 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.806670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1390/2783] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:36 2022] DELETE /identity/v3/projects/1c189f7f122e4ba9895ff20c6f76af62 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:36.810608 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d082e0-d4e6-4e9c-8073-688604dc26c7 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:36.822403 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d082e0-d4e6-4e9c-8073-688604dc26c7 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:36.898489 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709937a-0380-47f5-8433-5cf54287e71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:36.899131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709937a-0380-47f5-8433-5cf54287e71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:36.899411 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709937a-0380-47f5-8433-5cf54287e71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:36.899685 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709937a-0380-47f5-8433-5cf54287e71e admin admin] PATH_INFO: `/v3/users/8e862b5eb90b4a5ab859df9aeaa37212` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:36.900881 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709937a-0380-47f5-8433-5cf54287e71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e862b5eb90b4a5ab859df9aeaa37212)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:36.902812 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709937a-0380-47f5-8433-5cf54287e71e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:36.942269 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:36.953241 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0709937a-0380-47f5-8433-5cf54287e71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e862b5eb90b4a5ab859df9aeaa37212'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.961623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0709937a-0380-47f5-8433-5cf54287e71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e862b5eb90b4a5ab859df9aeaa37212'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.973880 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0709937a-0380-47f5-8433-5cf54287e71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e862b5eb90b4a5ab859df9aeaa37212'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.974540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0709937a-0380-47f5-8433-5cf54287e71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e862b5eb90b4a5ab859df9aeaa37212'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.975157 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-0709937a-0380-47f5-8433-5cf54287e71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e862b5eb90b4a5ab859df9aeaa37212'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:36.990091 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1394/2784] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:36 2022] DELETE /identity/v3/users/8e862b5eb90b4a5ab859df9aeaa37212 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:37.510026 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:37.511690 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:37.539986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b3b8d-9aa2-4834-87d6-f709465c325e admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:37.611543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e13173-f595-4d53-a9a7-e558e7b59160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:37.612251 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13173-f595-4d53-a9a7-e558e7b59160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:37.612534 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13173-f595-4d53-a9a7-e558e7b59160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:37.612841 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13173-f595-4d53-a9a7-e558e7b59160 admin admin] PATH_INFO: `/v3/projects/0e130bda901d43398a525880d48e1314` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:37.614010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e13173-f595-4d53-a9a7-e558e7b59160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e130bda901d43398a525880d48e1314)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:37.615917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e13173-f595-4d53-a9a7-e558e7b59160 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:37.669244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d9e13173-f595-4d53-a9a7-e558e7b59160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e130bda901d43398a525880d48e1314', 'request_id': 'req-d9e13173-f595-4d53-a9a7-e558e7b59160'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:37.677350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d9e13173-f595-4d53-a9a7-e558e7b59160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e130bda901d43398a525880d48e1314', 'request_id': 'req-d9e13173-f595-4d53-a9a7-e558e7b59160'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:37.683142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d9e13173-f595-4d53-a9a7-e558e7b59160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e130bda901d43398a525880d48e1314', 'request_id': 'req-d9e13173-f595-4d53-a9a7-e558e7b59160'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:37.695258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d9e13173-f595-4d53-a9a7-e558e7b59160 admin admin] The token cache is being invalidate because project 0e130bda901d43398a525880d48e1314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:37.695556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d9e13173-f595-4d53-a9a7-e558e7b59160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:37.696227 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d9e13173-f595-4d53-a9a7-e558e7b59160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:37.697957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1391/2785] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:37 2022] DELETE /identity/v3/projects/0e130bda901d43398a525880d48e1314 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:18:37.702778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692ad52-148a-4c54-bd43-f4d0848fb432 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:37.703922 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692ad52-148a-4c54-bd43-f4d0848fb432 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:37.703922 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692ad52-148a-4c54-bd43-f4d0848fb432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:37.725265 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-3692ad52-148a-4c54-bd43-f4d0848fb432 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:37.726505 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3692ad52-148a-4c54-bd43-f4d0848fb432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:37.796261 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1395/2786] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:37.804524 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a0774-1ca6-4ac5-84ca-829ad384f1c4 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:37.804844 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a0774-1ca6-4ac5-84ca-829ad384f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:37.805128 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a0774-1ca6-4ac5-84ca-829ad384f1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:37.826920 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-443a0774-1ca6-4ac5-84ca-829ad384f1c4 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:37.828145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-443a0774-1ca6-4ac5-84ca-829ad384f1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:37.837408 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1392/2787] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:37.842318 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692ad52-148a-4c54-bd43-f4d0848fb432 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:37.852148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692ad52-148a-4c54-bd43-f4d0848fb432 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:37.856918 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09cd28-b691-4341-b0fb-2c70cd31034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:37.857348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09cd28-b691-4341-b0fb-2c70cd31034e admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:37.857625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09cd28-b691-4341-b0fb-2c70cd31034e admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:37.857895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09cd28-b691-4341-b0fb-2c70cd31034e admin admin] PATH_INFO: `/v3/domains` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:37.858549 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09cd28-b691-4341-b0fb-2c70cd31034e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81620) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:18:37.858853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09cd28-b691-4341-b0fb-2c70cd31034e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:37.860507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09cd28-b691-4341-b0fb-2c70cd31034e admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:37.872727 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1396/2788] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:18:37.877414 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a0774-1ca6-4ac5-84ca-829ad384f1c4 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:37.886957 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a0774-1ca6-4ac5-84ca-829ad384f1c4 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:37.892237 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ad8d5-a38c-47eb-b541-e5b447e08110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:37.892865 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ad8d5-a38c-47eb-b541-e5b447e08110 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:37.893144 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ad8d5-a38c-47eb-b541-e5b447e08110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:37.893415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ad8d5-a38c-47eb-b541-e5b447e08110 admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:37.894062 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ad8d5-a38c-47eb-b541-e5b447e08110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:37.895940 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ad8d5-a38c-47eb-b541-e5b447e08110 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:37.929124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1393/2789] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:18:37 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:18:37.930358 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09cd28-b691-4341-b0fb-2c70cd31034e admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:37.942592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09cd28-b691-4341-b0fb-2c70cd31034e admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:38.029837 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ad8d5-a38c-47eb-b541-e5b447e08110 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:38.032828 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ab3ad8d5-a38c-47eb-b541-e5b447e08110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:38.034456 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e70e2-49b1-4299-9691-e67115064821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:38.035143 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e70e2-49b1-4299-9691-e67115064821 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.035424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e70e2-49b1-4299-9691-e67115064821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.035719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e70e2-49b1-4299-9691-e67115064821 admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.036339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e70e2-49b1-4299-9691-e67115064821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:38.038541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e70e2-49b1-4299-9691-e67115064821 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:38.064673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1397/2790] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:37 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:38.068491 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e70e2-49b1-4299-9691-e67115064821 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:38.079623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:38.079985 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e70e2-49b1-4299-9691-e67115064821 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:38.087248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82e973-d7dd-4235-a328-ed00c8aa85c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:38.088199 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82e973-d7dd-4235-a328-ed00c8aa85c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.088589 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82e973-d7dd-4235-a328-ed00c8aa85c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.089097 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82e973-d7dd-4235-a328-ed00c8aa85c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.089867 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82e973-d7dd-4235-a328-ed00c8aa85c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:38.091643 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82e973-d7dd-4235-a328-ed00c8aa85c6 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:38.105522 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1398/2791] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:18:38.109497 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82e973-d7dd-4235-a328-ed00c8aa85c6 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:38.122028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82e973-d7dd-4235-a328-ed00c8aa85c6 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:38.129204 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f084-1be4-492c-a25b-d0c5e7766157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:38.129894 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f084-1be4-492c-a25b-d0c5e7766157 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.130182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f084-1be4-492c-a25b-d0c5e7766157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.130460 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f084-1be4-492c-a25b-d0c5e7766157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.131116 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9f084-1be4-492c-a25b-d0c5e7766157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:38.132740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9f084-1be4-492c-a25b-d0c5e7766157 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:38.148538 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1399/2792] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:18:38.150080 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f084-1be4-492c-a25b-d0c5e7766157 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:38.161273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f084-1be4-492c-a25b-d0c5e7766157 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:38.166184 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3cd27-7827-45c4-989c-629efbd18435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:38.166861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3cd27-7827-45c4-989c-629efbd18435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.167166 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3cd27-7827-45c4-989c-629efbd18435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.167470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3cd27-7827-45c4-989c-629efbd18435 admin admin] PATH_INFO: `/v3/projects/a1e1dc1d720d4f7388a0dcb62f9115d3/users/b021f9d2bad74d05add79370a539f210/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.169965 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:38.182017 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ad8d5-a38c-47eb-b541-e5b447e08110 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:38.185383 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3cd27-7827-45c4-989c-629efbd18435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e1dc1d720d4f7388a0dcb62f9115d3, user_id=b021f9d2bad74d05add79370a539f210, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:38.189471 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3cd27-7827-45c4-989c-629efbd18435 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:38.189692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f516e7e-70de-461a-9e24-ec88c7278f7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:38.190486 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f516e7e-70de-461a-9e24-ec88c7278f7f service nova] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.190780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f516e7e-70de-461a-9e24-ec88c7278f7f service nova] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.191040 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f516e7e-70de-461a-9e24-ec88c7278f7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.192830 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-2f516e7e-70de-461a-9e24-ec88c7278f7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:38.206655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f516e7e-70de-461a-9e24-ec88c7278f7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:38.208065 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1400/2793] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:38 2022] PUT /identity/v3/projects/a1e1dc1d720d4f7388a0dcb62f9115d3/users/b021f9d2bad74d05add79370a539f210/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:38.209247 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f516e7e-70de-461a-9e24-ec88c7278f7f service nova] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:38.219932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a825d75-559f-4661-ab14-63345efe5d0a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.220271 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a825d75-559f-4661-ab14-63345efe5d0a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.220554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a825d75-559f-4661-ab14-63345efe5d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.222107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1394/2794] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:18:38.251939 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-3a825d75-559f-4661-ab14-63345efe5d0a None None] MFA Rules not processed for user `b021f9d2bad74d05add79370a539f210`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:38.253305 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-3a825d75-559f-4661-ab14-63345efe5d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:38.337156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1401/2795] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:18:38.338071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f516e7e-70de-461a-9e24-ec88c7278f7f service nova] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:38.350114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f516e7e-70de-461a-9e24-ec88c7278f7f service nova] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:38.430654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843739c-b780-4d71-a80f-382b2ee395db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:38.432035 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843739c-b780-4d71-a80f-382b2ee395db admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.432346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843739c-b780-4d71-a80f-382b2ee395db admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.432999 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843739c-b780-4d71-a80f-382b2ee395db admin admin] PATH_INFO: `/v3/projects` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.433740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843739c-b780-4d71-a80f-382b2ee395db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:38.435730 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843739c-b780-4d71-a80f-382b2ee395db admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:38.474531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1395/2796] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:18:38 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:18:38.478443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a825d75-559f-4661-ab14-63345efe5d0a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:38.491106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a825d75-559f-4661-ab14-63345efe5d0a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:38.561307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745a90d-d853-48ea-8f57-e98fe0b8f68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:38.562789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745a90d-d853-48ea-8f57-e98fe0b8f68f admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.563590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745a90d-d853-48ea-8f57-e98fe0b8f68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.563864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745a90d-d853-48ea-8f57-e98fe0b8f68f admin admin] PATH_INFO: `/v3/users` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.564713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745a90d-d853-48ea-8f57-e98fe0b8f68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:38.566693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745a90d-d853-48ea-8f57-e98fe0b8f68f admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:38.604399 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1402/2797] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:38 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:38.605718 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843739c-b780-4d71-a80f-382b2ee395db admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:38.617392 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843739c-b780-4d71-a80f-382b2ee395db admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:38.626275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c9afb-e58d-4314-bfe9-9ac529f47897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:38.626275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c9afb-e58d-4314-bfe9-9ac529f47897 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.627567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c9afb-e58d-4314-bfe9-9ac529f47897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.627897 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c9afb-e58d-4314-bfe9-9ac529f47897 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.628712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c9afb-e58d-4314-bfe9-9ac529f47897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:38.630745 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c9afb-e58d-4314-bfe9-9ac529f47897 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:38.648913 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1396/2798] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:38.653100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745a90d-d853-48ea-8f57-e98fe0b8f68f admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:38.666215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745a90d-d853-48ea-8f57-e98fe0b8f68f admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:38.671659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3fbdf-5fec-45d1-b84d-892d18aa107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:38.673244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3fbdf-5fec-45d1-b84d-892d18aa107d admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.673533 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3fbdf-5fec-45d1-b84d-892d18aa107d admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.673991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3fbdf-5fec-45d1-b84d-892d18aa107d admin admin] PATH_INFO: `/v3/projects/1a8a0754a8c444b09342cecddd097b29/users/ec754f3950eb4bc29e874b31d6e31bd5/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.697909 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3fbdf-5fec-45d1-b84d-892d18aa107d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8a0754a8c444b09342cecddd097b29, user_id=ec754f3950eb4bc29e874b31d6e31bd5, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:38.704336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3fbdf-5fec-45d1-b84d-892d18aa107d admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:38.722592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1403/2799] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:38 2022] PUT /identity/v3/projects/1a8a0754a8c444b09342cecddd097b29/users/ec754f3950eb4bc29e874b31d6e31bd5/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:38.726929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c9afb-e58d-4314-bfe9-9ac529f47897 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:38.738997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c9afb-e58d-4314-bfe9-9ac529f47897 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:38.838670 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07061b83-e6aa-4c4e-bb36-612b53a367ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:38.839351 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061b83-e6aa-4c4e-bb36-612b53a367ed admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.839630 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061b83-e6aa-4c4e-bb36-612b53a367ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.839904 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061b83-e6aa-4c4e-bb36-612b53a367ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.840585 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07061b83-e6aa-4c4e-bb36-612b53a367ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:38.843301 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07061b83-e6aa-4c4e-bb36-612b53a367ed admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:38.850983 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:38.861890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1397/2800] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:18:38.862690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3fbdf-5fec-45d1-b84d-892d18aa107d admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:38.874167 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3fbdf-5fec-45d1-b84d-892d18aa107d admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:38.881029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241adb6-f36e-4138-96f0-32684682c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:38.881716 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241adb6-f36e-4138-96f0-32684682c7af admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.882145 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241adb6-f36e-4138-96f0-32684682c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.882430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241adb6-f36e-4138-96f0-32684682c7af admin admin] PATH_INFO: `/v3/projects/1a8a0754a8c444b09342cecddd097b29/users/ec754f3950eb4bc29e874b31d6e31bd5/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.884801 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241adb6-f36e-4138-96f0-32684682c7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8a0754a8c444b09342cecddd097b29, user_id=ec754f3950eb4bc29e874b31d6e31bd5, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:38.887948 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241adb6-f36e-4138-96f0-32684682c7af admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:38.901594 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1404/2801] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:38 2022] PUT /identity/v3/projects/1a8a0754a8c444b09342cecddd097b29/users/ec754f3950eb4bc29e874b31d6e31bd5/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:18:38.913107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a752-7c79-4e69-908b-37b204e188c5 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:38.913399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a752-7c79-4e69-908b-37b204e188c5 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:38.913681 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a752-7c79-4e69-908b-37b204e188c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:38.955858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-5665a752-7c79-4e69-908b-37b204e188c5 None None] MFA Rules not processed for user `ec754f3950eb4bc29e874b31d6e31bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:38.957372 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5665a752-7c79-4e69-908b-37b204e188c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:39.056368 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1398/2802] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:39.068932 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241adb6-f36e-4138-96f0-32684682c7af admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:39.074587 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c241adb6-f36e-4138-96f0-32684682c7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:39.117120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:39.163208 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241adb6-f36e-4138-96f0-32684682c7af admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:39.167062 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a1b84-3d6d-4b38-a3a1-4b80507ec48c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:39.167672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a1b84-3d6d-4b38-a3a1-4b80507ec48c service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:39.167950 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a1b84-3d6d-4b38-a3a1-4b80507ec48c service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:39.168236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a1b84-3d6d-4b38-a3a1-4b80507ec48c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:39.181077 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a1b84-3d6d-4b38-a3a1-4b80507ec48c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:39.184340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a1b84-3d6d-4b38-a3a1-4b80507ec48c service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:39.195866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1405/2803] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:39.610793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a752-7c79-4e69-908b-37b204e188c5 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:39.675883 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a752-7c79-4e69-908b-37b204e188c5 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:39.680646 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:39.681345 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:39.681620 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:39.681915 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] PATH_INFO: `/v3/users/b021f9d2bad74d05add79370a539f210` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:39.683067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b021f9d2bad74d05add79370a539f210)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:39.685049 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:39.732187 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b021f9d2bad74d05add79370a539f210'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:39.741048 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b021f9d2bad74d05add79370a539f210'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:39.741923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b021f9d2bad74d05add79370a539f210'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:39.742747 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b021f9d2bad74d05add79370a539f210'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:39.756130 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b021f9d2bad74d05add79370a539f210'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:39.769072 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1399/2804] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:39 2022] DELETE /identity/v3/users/b021f9d2bad74d05add79370a539f210 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:39.773609 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cb1cb-affb-4ea8-b776-b512305222b1 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:39.774106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cb1cb-affb-4ea8-b776-b512305222b1 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:39.774213 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cb1cb-affb-4ea8-b776-b512305222b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:39.794365 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-709cb1cb-affb-4ea8-b776-b512305222b1 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:39.795612 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-709cb1cb-affb-4ea8-b776-b512305222b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:39.858021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1406/2805] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:18:39.868494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:39.869939 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:39.876701 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:39.931189 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af25ed-fa9f-4e4b-b0eb-4ad11eb0fed6 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:39.934710 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240818e9-3c1b-426c-8658-cdb09d9cc17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:39.935315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240818e9-3c1b-426c-8658-cdb09d9cc17c service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:39.935590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240818e9-3c1b-426c-8658-cdb09d9cc17c service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:39.935862 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240818e9-3c1b-426c-8658-cdb09d9cc17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:39.945198 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240818e9-3c1b-426c-8658-cdb09d9cc17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:39.946627 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240818e9-3c1b-426c-8658-cdb09d9cc17c service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:39.956852 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1400/2806] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:40.252582 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cb1cb-affb-4ea8-b776-b512305222b1 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:40.254680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-709cb1cb-affb-4ea8-b776-b512305222b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:40.270627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cb1cb-affb-4ea8-b776-b512305222b1 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:40.275412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:40.276220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:40.277134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:40.277134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] PATH_INFO: `/v3/projects/a1e1dc1d720d4f7388a0dcb62f9115d3` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:40.278869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e1dc1d720d4f7388a0dcb62f9115d3)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:40.281352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:40.330262 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e1dc1d720d4f7388a0dcb62f9115d3', 'request_id': 'req-15740e39-19a5-49e6-ace6-8f3a7c8a314a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:40.336782 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e1dc1d720d4f7388a0dcb62f9115d3', 'request_id': 'req-15740e39-19a5-49e6-ace6-8f3a7c8a314a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:40.345574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e1dc1d720d4f7388a0dcb62f9115d3', 'request_id': 'req-15740e39-19a5-49e6-ace6-8f3a7c8a314a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:40.365419 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] The token cache is being invalidate because project a1e1dc1d720d4f7388a0dcb62f9115d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:40.365929 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:40.366980 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:40.369500 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1407/2807] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:40 2022] DELETE /identity/v3/projects/a1e1dc1d720d4f7388a0dcb62f9115d3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:40.375070 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240818e9-3c1b-426c-8658-cdb09d9cc17c service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:40.385345 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240818e9-3c1b-426c-8658-cdb09d9cc17c service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:40.443280 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee201d6-debc-494e-aa7d-4f826573157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:40.443832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee201d6-debc-494e-aa7d-4f826573157e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:40.444113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee201d6-debc-494e-aa7d-4f826573157e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:40.444388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee201d6-debc-494e-aa7d-4f826573157e admin admin] PATH_INFO: `/v3/users/ec754f3950eb4bc29e874b31d6e31bd5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:40.445577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee201d6-debc-494e-aa7d-4f826573157e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec754f3950eb4bc29e874b31d6e31bd5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:40.447554 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee201d6-debc-494e-aa7d-4f826573157e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:40.496352 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6ee201d6-debc-494e-aa7d-4f826573157e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec754f3950eb4bc29e874b31d6e31bd5'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:40.504603 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6ee201d6-debc-494e-aa7d-4f826573157e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec754f3950eb4bc29e874b31d6e31bd5'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:40.505287 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6ee201d6-debc-494e-aa7d-4f826573157e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec754f3950eb4bc29e874b31d6e31bd5'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:40.505891 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6ee201d6-debc-494e-aa7d-4f826573157e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec754f3950eb4bc29e874b31d6e31bd5'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:40.519277 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-6ee201d6-debc-494e-aa7d-4f826573157e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec754f3950eb4bc29e874b31d6e31bd5'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:40.532615 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1401/2808] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:40 2022] DELETE /identity/v3/users/ec754f3950eb4bc29e874b31d6e31bd5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:18:40.814595 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:40.816798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:40.838895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15740e39-19a5-49e6-ace6-8f3a7c8a314a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:40.895966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:40.911068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37815e-84a4-4a8e-b795-131247937ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:40.911741 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37815e-84a4-4a8e-b795-131247937ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:40.912368 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37815e-84a4-4a8e-b795-131247937ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:40.912914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37815e-84a4-4a8e-b795-131247937ab4 admin admin] PATH_INFO: `/v3/projects/1a8a0754a8c444b09342cecddd097b29` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:40.914412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37815e-84a4-4a8e-b795-131247937ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8a0754a8c444b09342cecddd097b29)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:40.916349 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37815e-84a4-4a8e-b795-131247937ab4 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:40.971170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fd37815e-84a4-4a8e-b795-131247937ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8a0754a8c444b09342cecddd097b29', 'request_id': 'req-fd37815e-84a4-4a8e-b795-131247937ab4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:40.977519 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fd37815e-84a4-4a8e-b795-131247937ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8a0754a8c444b09342cecddd097b29', 'request_id': 'req-fd37815e-84a4-4a8e-b795-131247937ab4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:40.987048 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fd37815e-84a4-4a8e-b795-131247937ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8a0754a8c444b09342cecddd097b29', 'request_id': 'req-fd37815e-84a4-4a8e-b795-131247937ab4'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:41.000562 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fd37815e-84a4-4a8e-b795-131247937ab4 admin admin] The token cache is being invalidate because project 1a8a0754a8c444b09342cecddd097b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:41.000861 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fd37815e-84a4-4a8e-b795-131247937ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:41.002235 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-fd37815e-84a4-4a8e-b795-131247937ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:41.004314 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1408/2809] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:40 2022] DELETE /identity/v3/projects/1a8a0754a8c444b09342cecddd097b29 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:41.008969 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b6a21-eb2d-416d-9823-e6f6e1512f3b None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.009440 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b6a21-eb2d-416d-9823-e6f6e1512f3b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.009556 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b6a21-eb2d-416d-9823-e6f6e1512f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.032162 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-1f2b6a21-eb2d-416d-9823-e6f6e1512f3b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:41.033417 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1f2b6a21-eb2d-416d-9823-e6f6e1512f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:41.056623 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:41.106454 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1402/2810] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:18:41.116766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b62a5-7677-48a7-9d48-f669b711cc99 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.117057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b62a5-7677-48a7-9d48-f669b711cc99 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.117339 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b62a5-7677-48a7-9d48-f669b711cc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.142375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-959b62a5-7677-48a7-9d48-f669b711cc99 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:41.143655 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-959b62a5-7677-48a7-9d48-f669b711cc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:41.151923 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1409/2811] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:41.157217 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b6a21-eb2d-416d-9823-e6f6e1512f3b None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:41.167380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b6a21-eb2d-416d-9823-e6f6e1512f3b None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:41.173018 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd7a1c-8815-4b14-888d-6c0285bac333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:41.173882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd7a1c-8815-4b14-888d-6c0285bac333 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.174199 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd7a1c-8815-4b14-888d-6c0285bac333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.174436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd7a1c-8815-4b14-888d-6c0285bac333 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.175142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd7a1c-8815-4b14-888d-6c0285bac333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:18:41.175430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd7a1c-8815-4b14-888d-6c0285bac333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:41.177559 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd7a1c-8815-4b14-888d-6c0285bac333 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:41.193341 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1403/2812] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:18:41.197772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b62a5-7677-48a7-9d48-f669b711cc99 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:41.207537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b62a5-7677-48a7-9d48-f669b711cc99 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:41.212361 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6e457-4261-4f5c-b445-7bcee44c7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:41.212991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6e457-4261-4f5c-b445-7bcee44c7052 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.213267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6e457-4261-4f5c-b445-7bcee44c7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.213537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6e457-4261-4f5c-b445-7bcee44c7052 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.214256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6e457-4261-4f5c-b445-7bcee44c7052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:41.216419 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6e457-4261-4f5c-b445-7bcee44c7052 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:41.249933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1410/2813] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:18:41 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:41.251174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd7a1c-8815-4b14-888d-6c0285bac333 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:41.261346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd7a1c-8815-4b14-888d-6c0285bac333 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:41.338542 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e6039-2b32-4f9d-9ec9-5942f96ccc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:41.339219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e6039-2b32-4f9d-9ec9-5942f96ccc31 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.339503 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e6039-2b32-4f9d-9ec9-5942f96ccc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.339769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e6039-2b32-4f9d-9ec9-5942f96ccc31 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.340448 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e6039-2b32-4f9d-9ec9-5942f96ccc31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:41.342591 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e6039-2b32-4f9d-9ec9-5942f96ccc31 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:41.369929 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1404/2814] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:41 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:18:41.374922 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6e457-4261-4f5c-b445-7bcee44c7052 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:41.387354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6e457-4261-4f5c-b445-7bcee44c7052 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:41.394068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be888307-6e2a-4c38-947f-f706534a50ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:41.394699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888307-6e2a-4c38-947f-f706534a50ca admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.394984 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888307-6e2a-4c38-947f-f706534a50ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.395259 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888307-6e2a-4c38-947f-f706534a50ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.395916 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be888307-6e2a-4c38-947f-f706534a50ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:41.397600 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be888307-6e2a-4c38-947f-f706534a50ca admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:41.410976 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1411/2815] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:41.416203 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e6039-2b32-4f9d-9ec9-5942f96ccc31 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:41.428406 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e6039-2b32-4f9d-9ec9-5942f96ccc31 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:41.433475 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f1a54-4b46-48eb-8fa0-d381164ec4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:41.434092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1a54-4b46-48eb-8fa0-d381164ec4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.434374 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1a54-4b46-48eb-8fa0-d381164ec4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.434649 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1a54-4b46-48eb-8fa0-d381164ec4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.435296 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f1a54-4b46-48eb-8fa0-d381164ec4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:41.436941 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f1a54-4b46-48eb-8fa0-d381164ec4c8 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:41.451319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1405/2816] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:41.455069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be888307-6e2a-4c38-947f-f706534a50ca admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:41.466438 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be888307-6e2a-4c38-947f-f706534a50ca admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:41.472492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3896f37-7252-401b-9610-a93e20f16ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:41.473490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3896f37-7252-401b-9610-a93e20f16ade admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.473913 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3896f37-7252-401b-9610-a93e20f16ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.474338 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3896f37-7252-401b-9610-a93e20f16ade admin admin] PATH_INFO: `/v3/projects/6316ffe69cae49b196e34ba90bbe5e7e/users/2b4fbff963c1403fa2298ab3bf2f9c06/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.494348 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3896f37-7252-401b-9610-a93e20f16ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=6316ffe69cae49b196e34ba90bbe5e7e, user_id=2b4fbff963c1403fa2298ab3bf2f9c06, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:41.497286 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3896f37-7252-401b-9610-a93e20f16ade admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:41.511623 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1412/2817] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:41 2022] PUT /identity/v3/projects/6316ffe69cae49b196e34ba90bbe5e7e/users/2b4fbff963c1403fa2298ab3bf2f9c06/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:18:41.524198 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f87f6-d443-462d-8597-ea6d9f079adc None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.524485 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f87f6-d443-462d-8597-ea6d9f079adc None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.524818 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f87f6-d443-462d-8597-ea6d9f079adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.554303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-c68f87f6-d443-462d-8597-ea6d9f079adc None None] MFA Rules not processed for user `2b4fbff963c1403fa2298ab3bf2f9c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:41.555547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c68f87f6-d443-462d-8597-ea6d9f079adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:41.637734 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1406/2818] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:41.645458 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3896f37-7252-401b-9610-a93e20f16ade admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:41.715627 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3896f37-7252-401b-9610-a93e20f16ade admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:41.722354 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e69dd4-931a-45a4-b259-72b478d11ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:41.723229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69dd4-931a-45a4-b259-72b478d11ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.725107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69dd4-931a-45a4-b259-72b478d11ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.725107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69dd4-931a-45a4-b259-72b478d11ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.725107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e69dd4-931a-45a4-b259-72b478d11ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:41.727556 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e69dd4-931a-45a4-b259-72b478d11ed7 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:41.757777 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1413/2819] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:18:41 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:41.761772 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f87f6-d443-462d-8597-ea6d9f079adc None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:41.772920 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f87f6-d443-462d-8597-ea6d9f079adc None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:41.791100 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:41.830490 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4e1d0-ce0a-4630-8e80-4571e1a8e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:41.831108 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4e1d0-ce0a-4630-8e80-4571e1a8e7bf admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.831386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4e1d0-ce0a-4630-8e80-4571e1a8e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.831654 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4e1d0-ce0a-4630-8e80-4571e1a8e7bf admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.832295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4e1d0-ce0a-4630-8e80-4571e1a8e7bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:41.834253 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4e1d0-ce0a-4630-8e80-4571e1a8e7bf admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:41.855576 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1407/2820] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:41 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:18:41.859804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e69dd4-931a-45a4-b259-72b478d11ed7 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:41.865385 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:41.874090 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e69dd4-931a-45a4-b259-72b478d11ed7 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:41.879824 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017b73d-9036-4d86-8b39-9160a5d2b005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:41.880440 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017b73d-9036-4d86-8b39-9160a5d2b005 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.880750 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017b73d-9036-4d86-8b39-9160a5d2b005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.881032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017b73d-9036-4d86-8b39-9160a5d2b005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.881685 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017b73d-9036-4d86-8b39-9160a5d2b005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:41.883295 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017b73d-9036-4d86-8b39-9160a5d2b005 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:41.895523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1414/2821] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:41.900992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4e1d0-ce0a-4630-8e80-4571e1a8e7bf admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:41.911671 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4e1d0-ce0a-4630-8e80-4571e1a8e7bf admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:41.916666 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45bc08-da9a-431d-adee-ec4157e946e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:41.917316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45bc08-da9a-431d-adee-ec4157e946e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.917617 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45bc08-da9a-431d-adee-ec4157e946e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.917894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45bc08-da9a-431d-adee-ec4157e946e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.918538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45bc08-da9a-431d-adee-ec4157e946e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:41.920158 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45bc08-da9a-431d-adee-ec4157e946e8 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:41.930765 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1408/2822] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:41.935105 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017b73d-9036-4d86-8b39-9160a5d2b005 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:41.946325 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017b73d-9036-4d86-8b39-9160a5d2b005 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:41.951077 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb71717-ff70-455c-b9c6-4234be0b570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:41.951730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb71717-ff70-455c-b9c6-4234be0b570b admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.952013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb71717-ff70-455c-b9c6-4234be0b570b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.952287 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb71717-ff70-455c-b9c6-4234be0b570b admin admin] PATH_INFO: `/v3/projects/81903eeeb1044e42beb867fd7f9a1fc3/users/8be02760818d40b0b0febce4c806f757/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:41.971313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb71717-ff70-455c-b9c6-4234be0b570b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81903eeeb1044e42beb867fd7f9a1fc3, user_id=8be02760818d40b0b0febce4c806f757, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:41.974049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb71717-ff70-455c-b9c6-4234be0b570b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:41.987117 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1415/2823] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:41 2022] PUT /identity/v3/projects/81903eeeb1044e42beb867fd7f9a1fc3/users/8be02760818d40b0b0febce4c806f757/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:41.997792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca48a1-aa02-4edc-9280-1f91bb5de88f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:41.998100 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca48a1-aa02-4edc-9280-1f91bb5de88f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:41.998377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca48a1-aa02-4edc-9280-1f91bb5de88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:42.026919 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-07ca48a1-aa02-4edc-9280-1f91bb5de88f None None] MFA Rules not processed for user `8be02760818d40b0b0febce4c806f757`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:42.028054 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-07ca48a1-aa02-4edc-9280-1f91bb5de88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:42.092501 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1409/2824] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:18:42.097039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb71717-ff70-455c-b9c6-4234be0b570b admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:42.159124 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb71717-ff70-455c-b9c6-4234be0b570b admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:42.163780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861bdf6-73c0-48b1-b7eb-6d87d365f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:42.164371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861bdf6-73c0-48b1-b7eb-6d87d365f364 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:42.164651 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861bdf6-73c0-48b1-b7eb-6d87d365f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:42.164958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861bdf6-73c0-48b1-b7eb-6d87d365f364 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:42.165600 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861bdf6-73c0-48b1-b7eb-6d87d365f364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:42.167505 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861bdf6-73c0-48b1-b7eb-6d87d365f364 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:42.194640 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1416/2825] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:18:42 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:42.198708 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca48a1-aa02-4edc-9280-1f91bb5de88f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:42.209359 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca48a1-aa02-4edc-9280-1f91bb5de88f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:42.265157 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67e8d3-bce8-460d-97e7-445b3e386be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:42.265763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67e8d3-bce8-460d-97e7-445b3e386be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:42.266105 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67e8d3-bce8-460d-97e7-445b3e386be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:42.266494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67e8d3-bce8-460d-97e7-445b3e386be3 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:42.267134 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67e8d3-bce8-460d-97e7-445b3e386be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:42.269090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67e8d3-bce8-460d-97e7-445b3e386be3 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:42.290142 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1410/2826] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:18:42 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:18:42.294193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861bdf6-73c0-48b1-b7eb-6d87d365f364 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:42.305225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861bdf6-73c0-48b1-b7eb-6d87d365f364 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:42.309802 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9362fc1-437d-4259-9039-799ac6860842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:42.310396 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362fc1-437d-4259-9039-799ac6860842 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:42.310669 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362fc1-437d-4259-9039-799ac6860842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:42.310938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362fc1-437d-4259-9039-799ac6860842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:42.311570 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9362fc1-437d-4259-9039-799ac6860842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:42.313748 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9362fc1-437d-4259-9039-799ac6860842 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:42.324822 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1417/2827] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:42.329033 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67e8d3-bce8-460d-97e7-445b3e386be3 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:42.339032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67e8d3-bce8-460d-97e7-445b3e386be3 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:42.343692 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6520d-8f97-41f6-b626-6c3c74c5ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:42.344363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6520d-8f97-41f6-b626-6c3c74c5ff85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:42.344648 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6520d-8f97-41f6-b626-6c3c74c5ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:42.344962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6520d-8f97-41f6-b626-6c3c74c5ff85 admin admin] PATH_INFO: `/v3/projects/4017d58d30474b8ba6e36d8f2a8693eb/users/0f3389743ad540c598b777a4b51ae00c/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:42.360065 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6520d-8f97-41f6-b626-6c3c74c5ff85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4017d58d30474b8ba6e36d8f2a8693eb, user_id=0f3389743ad540c598b777a4b51ae00c, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:42.362759 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6520d-8f97-41f6-b626-6c3c74c5ff85 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:42.365869 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:42.378390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1411/2828] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:42 2022] PUT /identity/v3/projects/4017d58d30474b8ba6e36d8f2a8693eb/users/0f3389743ad540c598b777a4b51ae00c/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:42.382477 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9362fc1-437d-4259-9039-799ac6860842 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:42.392982 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9362fc1-437d-4259-9039-799ac6860842 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:42.449424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7957f87-bee1-432a-a5fe-06a147bbd697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:42.450049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7957f87-bee1-432a-a5fe-06a147bbd697 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:42.450316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7957f87-bee1-432a-a5fe-06a147bbd697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:42.450590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7957f87-bee1-432a-a5fe-06a147bbd697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:42.451236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7957f87-bee1-432a-a5fe-06a147bbd697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:42.452873 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7957f87-bee1-432a-a5fe-06a147bbd697 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:42.462749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1418/2829] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:18:42.466962 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6520d-8f97-41f6-b626-6c3c74c5ff85 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:42.478012 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6520d-8f97-41f6-b626-6c3c74c5ff85 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:42.482583 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3d620-27b5-4cd2-801c-1897f937d73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:42.483251 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3d620-27b5-4cd2-801c-1897f937d73e admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:42.483530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3d620-27b5-4cd2-801c-1897f937d73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:42.483804 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3d620-27b5-4cd2-801c-1897f937d73e admin admin] PATH_INFO: `/v3/projects/4017d58d30474b8ba6e36d8f2a8693eb/users/0f3389743ad540c598b777a4b51ae00c/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:42.486618 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3d620-27b5-4cd2-801c-1897f937d73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4017d58d30474b8ba6e36d8f2a8693eb, user_id=0f3389743ad540c598b777a4b51ae00c, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:42.489390 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3d620-27b5-4cd2-801c-1897f937d73e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:42.500333 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1412/2830] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:18:42 2022] PUT /identity/v3/projects/4017d58d30474b8ba6e36d8f2a8693eb/users/0f3389743ad540c598b777a4b51ae00c/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:42.511128 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1834f3-5926-4d41-9383-dfc1b4bd9a02 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:42.511419 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1834f3-5926-4d41-9383-dfc1b4bd9a02 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:42.511699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1834f3-5926-4d41-9383-dfc1b4bd9a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:42.551797 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-fe1834f3-5926-4d41-9383-dfc1b4bd9a02 None None] MFA Rules not processed for user `0f3389743ad540c598b777a4b51ae00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:42.553034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-fe1834f3-5926-4d41-9383-dfc1b4bd9a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:42.580475 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:42.635679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1419/2831] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:42.648928 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3d620-27b5-4cd2-801c-1897f937d73e admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:42.650801 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-58d3d620-27b5-4cd2-801c-1897f937d73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:42.722875 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3d620-27b5-4cd2-801c-1897f937d73e admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:42.726635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f361f10-c3e3-4b4c-a2d7-56f482f3f631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:42.727249 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f361f10-c3e3-4b4c-a2d7-56f482f3f631 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:42.727528 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f361f10-c3e3-4b4c-a2d7-56f482f3f631 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:42.727802 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f361f10-c3e3-4b4c-a2d7-56f482f3f631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:42.787632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f361f10-c3e3-4b4c-a2d7-56f482f3f631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:42.789103 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f361f10-c3e3-4b4c-a2d7-56f482f3f631 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:42.800992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1413/2832] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:44.344002 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1834f3-5926-4d41-9383-dfc1b4bd9a02 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:44.345534 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-fe1834f3-5926-4d41-9383-dfc1b4bd9a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:44.357592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1834f3-5926-4d41-9383-dfc1b4bd9a02 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:44.361805 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0290e-09fd-4864-bef4-afe9498569ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:44.362444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0290e-09fd-4864-bef4-afe9498569ed service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:44.362720 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0290e-09fd-4864-bef4-afe9498569ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:44.362989 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0290e-09fd-4864-bef4-afe9498569ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:44.421327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0290e-09fd-4864-bef4-afe9498569ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:44.423457 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0290e-09fd-4864-bef4-afe9498569ed service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:44.433217 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1420/2833] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:44.988139 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f361f10-c3e3-4b4c-a2d7-56f482f3f631 service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:44.997676 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f361f10-c3e3-4b4c-a2d7-56f482f3f631 service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:45.001524 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b367af-019c-4edc-8905-a7c54aed45f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:45.002126 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b367af-019c-4edc-8905-a7c54aed45f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:45.002403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b367af-019c-4edc-8905-a7c54aed45f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:45.002677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b367af-019c-4edc-8905-a7c54aed45f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:45.012323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b367af-019c-4edc-8905-a7c54aed45f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:45.013780 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b367af-019c-4edc-8905-a7c54aed45f4 service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:45.023543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1414/2834] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:18:48.957866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0290e-09fd-4864-bef4-afe9498569ed service cinder] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:49.035118 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0290e-09fd-4864-bef4-afe9498569ed service cinder] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:49.039772 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:49.040402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:49.040706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:49.040986 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] PATH_INFO: `/v3/users/2b4fbff963c1403fa2298ab3bf2f9c06` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:49.042170 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4fbff963c1403fa2298ab3bf2f9c06)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:49.044131 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:49.093155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4fbff963c1403fa2298ab3bf2f9c06'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.100786 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4fbff963c1403fa2298ab3bf2f9c06'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.108120 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:49.114513 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4fbff963c1403fa2298ab3bf2f9c06'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.115279 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4fbff963c1403fa2298ab3bf2f9c06'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.116421 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4fbff963c1403fa2298ab3bf2f9c06'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.130202 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1421/2835] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:48 2022] DELETE /identity/v3/users/2b4fbff963c1403fa2298ab3bf2f9c06 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:49.134499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c292b-6737-44f6-9884-e38be253810f None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:49.134917 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c292b-6737-44f6-9884-e38be253810f None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:49.135033 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c292b-6737-44f6-9884-e38be253810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:49.154604 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-4b1c292b-6737-44f6-9884-e38be253810f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:18:49.156071 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4b1c292b-6737-44f6-9884-e38be253810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:49.231537 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1415/2836] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:18:49.241780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:49.243203 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:49.305336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec33da9-c382-4bb5-9f54-143836f51bfd admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:49.308947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f0f78-6a5a-4e7d-9242-bd7edff4224b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:49.309551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f0f78-6a5a-4e7d-9242-bd7edff4224b service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:49.309829 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f0f78-6a5a-4e7d-9242-bd7edff4224b service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:49.310100 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f0f78-6a5a-4e7d-9242-bd7edff4224b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:49.320620 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f0f78-6a5a-4e7d-9242-bd7edff4224b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:49.322050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f0f78-6a5a-4e7d-9242-bd7edff4224b service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:49.332946 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1422/2837] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:18:49.623907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c292b-6737-44f6-9884-e38be253810f None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:49.626158 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4b1c292b-6737-44f6-9884-e38be253810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:49.638411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c292b-6737-44f6-9884-e38be253810f None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:49.643427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:49.644436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:49.644436 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:49.644659 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] PATH_INFO: `/v3/projects/6316ffe69cae49b196e34ba90bbe5e7e` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:49.645882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6316ffe69cae49b196e34ba90bbe5e7e)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:49.647970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:49.671299 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:49.699430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6316ffe69cae49b196e34ba90bbe5e7e', 'request_id': 'req-d4ae2402-ca90-4a23-9b78-5209aa8a1720'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.707349 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6316ffe69cae49b196e34ba90bbe5e7e', 'request_id': 'req-d4ae2402-ca90-4a23-9b78-5209aa8a1720'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.713066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6316ffe69cae49b196e34ba90bbe5e7e', 'request_id': 'req-d4ae2402-ca90-4a23-9b78-5209aa8a1720'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.724073 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] The token cache is being invalidate because project 6316ffe69cae49b196e34ba90bbe5e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:49.724361 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.725010 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.726493 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1416/2838] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:49 2022] DELETE /identity/v3/projects/6316ffe69cae49b196e34ba90bbe5e7e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:49.730430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f0f78-6a5a-4e7d-9242-bd7edff4224b service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:49.740547 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f0f78-6a5a-4e7d-9242-bd7edff4224b service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:49.799150 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:49.799908 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:49.800219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:49.800699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] PATH_INFO: `/v3/users/8be02760818d40b0b0febce4c806f757` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:49.801839 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be02760818d40b0b0febce4c806f757)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:49.803767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:49.856034 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be02760818d40b0b0febce4c806f757'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.864604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be02760818d40b0b0febce4c806f757'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.877382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be02760818d40b0b0febce4c806f757'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.878059 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be02760818d40b0b0febce4c806f757'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.878657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be02760818d40b0b0febce4c806f757'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:49.890769 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1423/2839] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:49 2022] DELETE /identity/v3/users/8be02760818d40b0b0febce4c806f757 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:50.173641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:50.175275 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:50.189997 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae2402-ca90-4a23-9b78-5209aa8a1720 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:50.249495 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:50.250110 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:50.250386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:50.250657 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] PATH_INFO: `/v3/projects/81903eeeb1044e42beb867fd7f9a1fc3` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:50.251784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81903eeeb1044e42beb867fd7f9a1fc3)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:50.253722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:50.303365 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81903eeeb1044e42beb867fd7f9a1fc3', 'request_id': 'req-bab20ec8-8791-4af0-b10b-cce1abef5046'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.310825 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81903eeeb1044e42beb867fd7f9a1fc3', 'request_id': 'req-bab20ec8-8791-4af0-b10b-cce1abef5046'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.316820 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81903eeeb1044e42beb867fd7f9a1fc3', 'request_id': 'req-bab20ec8-8791-4af0-b10b-cce1abef5046'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.327807 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] The token cache is being invalidate because project 81903eeeb1044e42beb867fd7f9a1fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:50.328639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.329494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.330958 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1417/2840] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:50 2022] DELETE /identity/v3/projects/81903eeeb1044e42beb867fd7f9a1fc3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:18:50.334938 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:50.336352 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:50.345028 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:50.351766 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d6174-e203-4166-9005-b0689367bca5 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:50.410336 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:50.410996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:50.411294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:50.411548 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] PATH_INFO: `/v3/users/0f3389743ad540c598b777a4b51ae00c` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:50.412749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3389743ad540c598b777a4b51ae00c)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:50.414742 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:50.462177 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3389743ad540c598b777a4b51ae00c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.471148 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3389743ad540c598b777a4b51ae00c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.483400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3389743ad540c598b777a4b51ae00c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.484056 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3389743ad540c598b777a4b51ae00c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.484912 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3389743ad540c598b777a4b51ae00c'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.497050 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1424/2841] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:18:50 2022] DELETE /identity/v3/users/0f3389743ad540c598b777a4b51ae00c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:18:50.778055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:18:50.780389 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:18:50.801991 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab20ec8-8791-4af0-b10b-cce1abef5046 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:18:50.838624 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:18:50.867100 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:18:50.867743 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:18:50.868023 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:18:50.868297 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] PATH_INFO: `/v3/projects/4017d58d30474b8ba6e36d8f2a8693eb` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:18:50.869506 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4017d58d30474b8ba6e36d8f2a8693eb)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:18:50.871427 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:18:50.916507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4017d58d30474b8ba6e36d8f2a8693eb', 'request_id': 'req-5d06a8cc-8be5-4e38-8bad-3ad437134c18'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.924770 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4017d58d30474b8ba6e36d8f2a8693eb', 'request_id': 'req-5d06a8cc-8be5-4e38-8bad-3ad437134c18'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.930544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4017d58d30474b8ba6e36d8f2a8693eb', 'request_id': 'req-5d06a8cc-8be5-4e38-8bad-3ad437134c18'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.941696 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] The token cache is being invalidate because project 4017d58d30474b8ba6e36d8f2a8693eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:18:50.941988 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.942655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:18:50.944113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1418/2842] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:18:50 2022] DELETE /identity/v3/projects/4017d58d30474b8ba6e36d8f2a8693eb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:00.493554 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:00.938633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:26.570819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:26.572304 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:26.695579 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a7315-64c1-4b96-9d1a-41cbfe730575 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:26.766953 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52994e73-dd5f-47c0-9dcd-2ff134d09a35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b918da0f83754f3887de1cfa2e4df028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:26.768055 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52994e73-dd5f-47c0-9dcd-2ff134d09a35 service placement] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:26.768407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52994e73-dd5f-47c0-9dcd-2ff134d09a35 service placement] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:26.768782 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52994e73-dd5f-47c0-9dcd-2ff134d09a35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:26.770679 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-52994e73-dd5f-47c0-9dcd-2ff134d09a35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:26.784066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52994e73-dd5f-47c0-9dcd-2ff134d09a35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:26.785822 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52994e73-dd5f-47c0-9dcd-2ff134d09a35 service placement] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:26.797163 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1425/2843] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:19:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:19:36.221618 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:36.223145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:36.296881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06a8cc-8be5-4e38-8bad-3ad437134c18 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:36.301679 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d1094-62da-4d93-8ec9-4328e65e5116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:36.302319 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d1094-62da-4d93-8ec9-4328e65e5116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:36.302784 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d1094-62da-4d93-8ec9-4328e65e5116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:36.303066 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d1094-62da-4d93-8ec9-4328e65e5116 admin admin] PATH_INFO: `/v3/users/f798985ff3b94ee7ac098697355aecfa` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:36.304207 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d1094-62da-4d93-8ec9-4328e65e5116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f798985ff3b94ee7ac098697355aecfa)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:36.306219 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d1094-62da-4d93-8ec9-4328e65e5116 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:36.356423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-376d1094-62da-4d93-8ec9-4328e65e5116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f798985ff3b94ee7ac098697355aecfa'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:36.366206 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-376d1094-62da-4d93-8ec9-4328e65e5116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f798985ff3b94ee7ac098697355aecfa'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:36.366907 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-376d1094-62da-4d93-8ec9-4328e65e5116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f798985ff3b94ee7ac098697355aecfa'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:36.367594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-376d1094-62da-4d93-8ec9-4328e65e5116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f798985ff3b94ee7ac098697355aecfa'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:36.381114 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-376d1094-62da-4d93-8ec9-4328e65e5116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f798985ff3b94ee7ac098697355aecfa'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:36.393921 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1419/2844] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:19:36 2022] DELETE /identity/v3/users/f798985ff3b94ee7ac098697355aecfa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:36.581693 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52994e73-dd5f-47c0-9dcd-2ff134d09a35 service placement] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:36.593689 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52994e73-dd5f-47c0-9dcd-2ff134d09a35 service placement] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:36.669215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:36.669865 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:36.670174 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:36.670429 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5 admin admin] PATH_INFO: `/v3/projects/93d9335c85de4f66807cf738c7f25df8` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:36.671565 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d9335c85de4f66807cf738c7f25df8)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:36.674373 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:36.690924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=100 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:36.723699 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d9335c85de4f66807cf738c7f25df8', 'request_id': 'req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:36.729113 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d9335c85de4f66807cf738c7f25df8', 'request_id': 'req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:36.737902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d9335c85de4f66807cf738c7f25df8', 'request_id': 'req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:36.749369 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5 admin admin] The token cache is being invalidate because project 93d9335c85de4f66807cf738c7f25df8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:19:36.749658 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:36.750313 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-9d6e3a35-06b1-468e-abf7-8498a64fdaf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:36.752562 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1426/2845] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:19:36 2022] DELETE /identity/v3/projects/93d9335c85de4f66807cf738c7f25df8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:36.757812 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab3a05-0130-4d11-a32d-f4f288623570 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:36.758097 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab3a05-0130-4d11-a32d-f4f288623570 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:36.758373 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab3a05-0130-4d11-a32d-f4f288623570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:36.780992 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-0dab3a05-0130-4d11-a32d-f4f288623570 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:36.782842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-0dab3a05-0130-4d11-a32d-f4f288623570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:36.843346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1420/2846] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:36.853029 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272dfa-98b8-4252-b8b6-eb6a31d3e90a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:36.853316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272dfa-98b8-4252-b8b6-eb6a31d3e90a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:36.853596 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272dfa-98b8-4252-b8b6-eb6a31d3e90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:36.874753 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-fc272dfa-98b8-4252-b8b6-eb6a31d3e90a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:36.875991 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-fc272dfa-98b8-4252-b8b6-eb6a31d3e90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:36.883966 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1427/2847] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:36.888353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab3a05-0130-4d11-a32d-f4f288623570 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:36.899154 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab3a05-0130-4d11-a32d-f4f288623570 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:36.903865 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c34fa-39a5-4e72-a018-868a16ae7523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:36.904477 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c34fa-39a5-4e72-a018-868a16ae7523 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:36.904792 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c34fa-39a5-4e72-a018-868a16ae7523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:36.905070 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c34fa-39a5-4e72-a018-868a16ae7523 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:36.905978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c34fa-39a5-4e72-a018-868a16ae7523 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:19:36.906283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c34fa-39a5-4e72-a018-868a16ae7523 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:36.908531 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c34fa-39a5-4e72-a018-868a16ae7523 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:36.921089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1421/2848] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:19:36.925723 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272dfa-98b8-4252-b8b6-eb6a31d3e90a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:36.935249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272dfa-98b8-4252-b8b6-eb6a31d3e90a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:36.940042 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f79759-9f12-43ca-9cbd-ba387ea05d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:36.940659 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f79759-9f12-43ca-9cbd-ba387ea05d01 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:36.940971 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f79759-9f12-43ca-9cbd-ba387ea05d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:36.941246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f79759-9f12-43ca-9cbd-ba387ea05d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:36.941929 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f79759-9f12-43ca-9cbd-ba387ea05d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:36.943833 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f79759-9f12-43ca-9cbd-ba387ea05d01 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:36.973340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1428/2849] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:19:36 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:19:36.977465 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c34fa-39a5-4e72-a018-868a16ae7523 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:36.987707 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c34fa-39a5-4e72-a018-868a16ae7523 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:36.991535 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:37.058775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10372cfe-9e82-46a3-8b58-9f50d7d52f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:37.059380 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10372cfe-9e82-46a3-8b58-9f50d7d52f75 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:37.059661 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10372cfe-9e82-46a3-8b58-9f50d7d52f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:37.059934 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10372cfe-9e82-46a3-8b58-9f50d7d52f75 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:37.060584 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10372cfe-9e82-46a3-8b58-9f50d7d52f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:37.062547 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10372cfe-9e82-46a3-8b58-9f50d7d52f75 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:37.084430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1422/2850] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:19:36 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:19:37.088670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f79759-9f12-43ca-9cbd-ba387ea05d01 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:37.100864 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f79759-9f12-43ca-9cbd-ba387ea05d01 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:37.105713 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aee0c-c807-428a-8105-4bcdf1d5ef74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:37.106320 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aee0c-c807-428a-8105-4bcdf1d5ef74 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:37.106601 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aee0c-c807-428a-8105-4bcdf1d5ef74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:37.106874 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848aee0c-c807-428a-8105-4bcdf1d5ef74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:37.107525 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aee0c-c807-428a-8105-4bcdf1d5ef74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:37.109182 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848aee0c-c807-428a-8105-4bcdf1d5ef74 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:37.123910 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1429/2851] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:19:37.128894 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10372cfe-9e82-46a3-8b58-9f50d7d52f75 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:37.139286 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10372cfe-9e82-46a3-8b58-9f50d7d52f75 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:37.144975 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024152f4-2f5b-4d77-8b15-732147d2a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:37.145586 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024152f4-2f5b-4d77-8b15-732147d2a090 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:37.145867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024152f4-2f5b-4d77-8b15-732147d2a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:37.146140 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024152f4-2f5b-4d77-8b15-732147d2a090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:37.146867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024152f4-2f5b-4d77-8b15-732147d2a090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:37.157214 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024152f4-2f5b-4d77-8b15-732147d2a090 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:37.169972 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1423/2852] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:19:37.174524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aee0c-c807-428a-8105-4bcdf1d5ef74 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:37.185327 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848aee0c-c807-428a-8105-4bcdf1d5ef74 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:37.190576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218438e-c659-4641-a4cd-e4848f7e993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:37.191256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218438e-c659-4641-a4cd-e4848f7e993a admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:37.191537 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218438e-c659-4641-a4cd-e4848f7e993a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:37.191831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218438e-c659-4641-a4cd-e4848f7e993a admin admin] PATH_INFO: `/v3/projects/815a7655f24c474a9450343dadb9b457/users/9bc587202fbc40088d660f3c85534fd0/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:37.210126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218438e-c659-4641-a4cd-e4848f7e993a admin admin] RBAC: Authorizing `identity:create_grant(project_id=815a7655f24c474a9450343dadb9b457, user_id=9bc587202fbc40088d660f3c85534fd0, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:37.212843 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218438e-c659-4641-a4cd-e4848f7e993a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:37.227605 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1430/2853] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:19:37 2022] PUT /identity/v3/projects/815a7655f24c474a9450343dadb9b457/users/9bc587202fbc40088d660f3c85534fd0/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:19:37.238251 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1089-2495-45ec-a5df-276286dd5b80 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:37.238822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1089-2495-45ec-a5df-276286dd5b80 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:37.238822 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1089-2495-45ec-a5df-276286dd5b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:37.273924 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-dc2d1089-2495-45ec-a5df-276286dd5b80 None None] MFA Rules not processed for user `9bc587202fbc40088d660f3c85534fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:37.275337 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-dc2d1089-2495-45ec-a5df-276286dd5b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:37.343258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1424/2854] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:37.355559 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218438e-c659-4641-a4cd-e4848f7e993a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:37.358030 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-7218438e-c659-4641-a4cd-e4848f7e993a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:37.447482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218438e-c659-4641-a4cd-e4848f7e993a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:37.453013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b71f-f887-4847-be5f-90e9bc6444eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:37.453620 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b71f-f887-4847-be5f-90e9bc6444eb service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:37.454445 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b71f-f887-4847-be5f-90e9bc6444eb service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:37.454776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b71f-f887-4847-be5f-90e9bc6444eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:37.463299 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701b71f-f887-4847-be5f-90e9bc6444eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:37.464954 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701b71f-f887-4847-be5f-90e9bc6444eb service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:37.474773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1431/2855] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:19:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:19:42.790092 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d1089-2495-45ec-a5df-276286dd5b80 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:42.858318 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d1089-2495-45ec-a5df-276286dd5b80 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:42.863397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:42.864032 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:42.864334 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:42.864568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] PATH_INFO: `/v3/users/9bc587202fbc40088d660f3c85534fd0` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:42.865713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc587202fbc40088d660f3c85534fd0)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:42.867613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:42.885313 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:42.923223 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc587202fbc40088d660f3c85534fd0'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:42.931757 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc587202fbc40088d660f3c85534fd0'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:42.932450 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc587202fbc40088d660f3c85534fd0'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:42.933183 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc587202fbc40088d660f3c85534fd0'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:42.945889 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc587202fbc40088d660f3c85534fd0'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:42.958030 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1425/2856] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:19:42 2022] DELETE /identity/v3/users/9bc587202fbc40088d660f3c85534fd0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:42.962709 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf045b-23ff-482d-a4ca-bf13791f521a None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:42.963239 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf045b-23ff-482d-a4ca-bf13791f521a None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:42.963239 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf045b-23ff-482d-a4ca-bf13791f521a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:42.982664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-68cf045b-23ff-482d-a4ca-bf13791f521a None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:42.983878 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-68cf045b-23ff-482d-a4ca-bf13791f521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:43.006353 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:43.055002 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1432/2857] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:19:43.065513 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:43.066936 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:43.153112 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd9f64-6d07-4037-8864-df199b3ff171 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:43.157863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8750fe-8293-4487-bf19-9e52ba928cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:43.158538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8750fe-8293-4487-bf19-9e52ba928cfd service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:43.160581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8750fe-8293-4487-bf19-9e52ba928cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:43.161095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8750fe-8293-4487-bf19-9e52ba928cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:43.179370 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8750fe-8293-4487-bf19-9e52ba928cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:43.180728 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8750fe-8293-4487-bf19-9e52ba928cfd service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:43.191538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1426/2858] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:19:43.475294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf045b-23ff-482d-a4ca-bf13791f521a None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:43.477064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-68cf045b-23ff-482d-a4ca-bf13791f521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:43.503466 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf045b-23ff-482d-a4ca-bf13791f521a None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:43.519043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747f436-8992-4d25-aca5-dfbf10ef6a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:43.519706 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747f436-8992-4d25-aca5-dfbf10ef6a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:43.519990 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747f436-8992-4d25-aca5-dfbf10ef6a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:43.520267 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747f436-8992-4d25-aca5-dfbf10ef6a6a admin admin] PATH_INFO: `/v3/projects/815a7655f24c474a9450343dadb9b457` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:43.521439 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747f436-8992-4d25-aca5-dfbf10ef6a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=815a7655f24c474a9450343dadb9b457)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:43.523371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747f436-8992-4d25-aca5-dfbf10ef6a6a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:43.589180 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8747f436-8992-4d25-aca5-dfbf10ef6a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815a7655f24c474a9450343dadb9b457', 'request_id': 'req-8747f436-8992-4d25-aca5-dfbf10ef6a6a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:43.596443 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8747f436-8992-4d25-aca5-dfbf10ef6a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815a7655f24c474a9450343dadb9b457', 'request_id': 'req-8747f436-8992-4d25-aca5-dfbf10ef6a6a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:43.604308 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8747f436-8992-4d25-aca5-dfbf10ef6a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815a7655f24c474a9450343dadb9b457', 'request_id': 'req-8747f436-8992-4d25-aca5-dfbf10ef6a6a'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:43.617524 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8747f436-8992-4d25-aca5-dfbf10ef6a6a admin admin] The token cache is being invalidate because project 815a7655f24c474a9450343dadb9b457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:19:43.617821 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8747f436-8992-4d25-aca5-dfbf10ef6a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:43.618511 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-8747f436-8992-4d25-aca5-dfbf10ef6a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:43.620021 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1433/2859] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:19:43 2022] DELETE /identity/v3/projects/815a7655f24c474a9450343dadb9b457 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:43.625053 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060adde-39ca-48f1-8ce1-20ab57f07618 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:43.626025 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060adde-39ca-48f1-8ce1-20ab57f07618 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:43.626375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060adde-39ca-48f1-8ce1-20ab57f07618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:43.647573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-5060adde-39ca-48f1-8ce1-20ab57f07618 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:43.648836 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5060adde-39ca-48f1-8ce1-20ab57f07618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:43.710361 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1427/2860] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:43.718240 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994b9e9-ea6e-4e76-8d66-5c2ddc8ec44b None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:43.718479 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994b9e9-ea6e-4e76-8d66-5c2ddc8ec44b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:43.718700 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994b9e9-ea6e-4e76-8d66-5c2ddc8ec44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:43.740603 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-8994b9e9-ea6e-4e76-8d66-5c2ddc8ec44b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:43.741887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-8994b9e9-ea6e-4e76-8d66-5c2ddc8ec44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:43.750307 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1434/2861] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:43.755566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060adde-39ca-48f1-8ce1-20ab57f07618 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:43.765716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060adde-39ca-48f1-8ce1-20ab57f07618 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:43.770806 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585087ca-5fea-4baf-b463-4147431ecd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:43.771421 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585087ca-5fea-4baf-b463-4147431ecd21 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:43.771701 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585087ca-5fea-4baf-b463-4147431ecd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:43.771977 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585087ca-5fea-4baf-b463-4147431ecd21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:43.772629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585087ca-5fea-4baf-b463-4147431ecd21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:19:43.772967 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585087ca-5fea-4baf-b463-4147431ecd21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:43.774573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585087ca-5fea-4baf-b463-4147431ecd21 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:43.787529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1428/2862] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:19:43.792039 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994b9e9-ea6e-4e76-8d66-5c2ddc8ec44b None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:43.802887 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994b9e9-ea6e-4e76-8d66-5c2ddc8ec44b None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:43.807804 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a030fa-1623-4e81-99e6-b22540c16ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:43.808419 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a030fa-1623-4e81-99e6-b22540c16ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:43.809490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a030fa-1623-4e81-99e6-b22540c16ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:43.809490 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a030fa-1623-4e81-99e6-b22540c16ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:43.809734 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a030fa-1623-4e81-99e6-b22540c16ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:43.811536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a030fa-1623-4e81-99e6-b22540c16ae8 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:43.844283 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1435/2863] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:19:43 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:19:43.848601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585087ca-5fea-4baf-b463-4147431ecd21 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:43.855009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:43.864573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585087ca-5fea-4baf-b463-4147431ecd21 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:43.927009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4fcc0-8ae7-4f1c-acf2-52f70c5f734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:43.927622 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4fcc0-8ae7-4f1c-acf2-52f70c5f734b admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:43.927906 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4fcc0-8ae7-4f1c-acf2-52f70c5f734b admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:43.928182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4fcc0-8ae7-4f1c-acf2-52f70c5f734b admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:43.928867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4fcc0-8ae7-4f1c-acf2-52f70c5f734b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:43.930793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4fcc0-8ae7-4f1c-acf2-52f70c5f734b admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:43.953108 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1429/2864] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:19:43 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:19:43.958083 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a030fa-1623-4e81-99e6-b22540c16ae8 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:43.970509 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a030fa-1623-4e81-99e6-b22540c16ae8 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:43.975153 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555dada-139a-41d2-bb42-f6dfb359a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:43.975819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555dada-139a-41d2-bb42-f6dfb359a84a admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:43.976111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555dada-139a-41d2-bb42-f6dfb359a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:43.976382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555dada-139a-41d2-bb42-f6dfb359a84a admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:43.977087 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555dada-139a-41d2-bb42-f6dfb359a84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:43.978930 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555dada-139a-41d2-bb42-f6dfb359a84a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:43.993330 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1436/2865] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:19:43.995530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4fcc0-8ae7-4f1c-acf2-52f70c5f734b admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:44.010754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4fcc0-8ae7-4f1c-acf2-52f70c5f734b admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:44.015613 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233d69b-9f9a-4fcc-b1c6-71fd5d5d2c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:44.017076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233d69b-9f9a-4fcc-b1c6-71fd5d5d2c53 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:44.017076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233d69b-9f9a-4fcc-b1c6-71fd5d5d2c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:44.017713 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233d69b-9f9a-4fcc-b1c6-71fd5d5d2c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:44.018196 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233d69b-9f9a-4fcc-b1c6-71fd5d5d2c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:44.019923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233d69b-9f9a-4fcc-b1c6-71fd5d5d2c53 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:44.036124 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1430/2866] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:19:44.040551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555dada-139a-41d2-bb42-f6dfb359a84a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:44.050906 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555dada-139a-41d2-bb42-f6dfb359a84a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:44.055629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7b59b-bc59-40b2-8534-7bcf52e9e472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:44.056289 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7b59b-bc59-40b2-8534-7bcf52e9e472 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:44.056576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7b59b-bc59-40b2-8534-7bcf52e9e472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:44.056889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7b59b-bc59-40b2-8534-7bcf52e9e472 admin admin] PATH_INFO: `/v3/projects/a5f9957b91bd454580dd177abf846449/users/f02665e835b8460688332c715a63f05b/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:44.074378 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7b59b-bc59-40b2-8534-7bcf52e9e472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f9957b91bd454580dd177abf846449, user_id=f02665e835b8460688332c715a63f05b, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:44.077134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7b59b-bc59-40b2-8534-7bcf52e9e472 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:44.091778 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1437/2867] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:19:44 2022] PUT /identity/v3/projects/a5f9957b91bd454580dd177abf846449/users/f02665e835b8460688332c715a63f05b/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:44.103562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff7416-e358-411a-b81e-76e0a884abcd None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:44.103867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff7416-e358-411a-b81e-76e0a884abcd None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:44.104139 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff7416-e358-411a-b81e-76e0a884abcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:44.134514 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-6dff7416-e358-411a-b81e-76e0a884abcd None None] MFA Rules not processed for user `f02665e835b8460688332c715a63f05b`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:44.135764 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-6dff7416-e358-411a-b81e-76e0a884abcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:44.207908 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1431/2868] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:19:44.222603 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7b59b-bc59-40b2-8534-7bcf52e9e472 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:44.224003 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-58c7b59b-bc59-40b2-8534-7bcf52e9e472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:44.274278 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:44.305249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7b59b-bc59-40b2-8534-7bcf52e9e472 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:44.311388 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4969a2d-d8d3-4559-a1a3-81e1a3397aaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d71c0688ea84c05af925f3fb08f35ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:44.312008 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4969a2d-d8d3-4559-a1a3-81e1a3397aaf service nova] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:44.312306 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4969a2d-d8d3-4559-a1a3-81e1a3397aaf service nova] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:44.312568 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4969a2d-d8d3-4559-a1a3-81e1a3397aaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:44.322840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4969a2d-d8d3-4559-a1a3-81e1a3397aaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:44.324454 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4969a2d-d8d3-4559-a1a3-81e1a3397aaf service nova] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:44.334730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1438/2869] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:19:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:19:47.097341 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff7416-e358-411a-b81e-76e0a884abcd None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:47.161740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff7416-e358-411a-b81e-76e0a884abcd None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:47.166651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:47.167009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:47.167289 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:47.167562 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] PATH_INFO: `/v3/users/f02665e835b8460688332c715a63f05b` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:47.168755 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=f02665e835b8460688332c715a63f05b)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:47.170629 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:47.186715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:47.226433 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f02665e835b8460688332c715a63f05b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:47.237110 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f02665e835b8460688332c715a63f05b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:47.237731 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f02665e835b8460688332c715a63f05b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:47.238344 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f02665e835b8460688332c715a63f05b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:47.251853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f02665e835b8460688332c715a63f05b'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:47.265055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1432/2870] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:19:47 2022] DELETE /identity/v3/users/f02665e835b8460688332c715a63f05b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:47.270316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8bfe1-185b-46f0-a1c8-c209b50d425f None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:47.270970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8bfe1-185b-46f0-a1c8-c209b50d425f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:47.270970 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8bfe1-185b-46f0-a1c8-c209b50d425f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:47.291879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-83a8bfe1-185b-46f0-a1c8-c209b50d425f None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:47.293036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-83a8bfe1-185b-46f0-a1c8-c209b50d425f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:47.355611 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1439/2871] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:19:47.365779 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:47.367196 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:47.427441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdfcd4-8dc5-40df-99f1-c13fa29bd4df admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:47.431166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb02f14-4486-48cd-b204-a054263571e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:47.431775 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02f14-4486-48cd-b204-a054263571e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:47.432055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02f14-4486-48cd-b204-a054263571e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:47.432327 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02f14-4486-48cd-b204-a054263571e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:47.441869 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb02f14-4486-48cd-b204-a054263571e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:47.443307 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb02f14-4486-48cd-b204-a054263571e1 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:47.453963 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1433/2872] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:19:47.745191 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8bfe1-185b-46f0-a1c8-c209b50d425f None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:47.746685 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-83a8bfe1-185b-46f0-a1c8-c209b50d425f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:47.761672 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8bfe1-185b-46f0-a1c8-c209b50d425f None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:47.767771 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49f6ca-c2e9-4a44-881d-e125557ee636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:47.768451 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f6ca-c2e9-4a44-881d-e125557ee636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:47.768763 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f6ca-c2e9-4a44-881d-e125557ee636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:47.769045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f6ca-c2e9-4a44-881d-e125557ee636 admin admin] PATH_INFO: `/v3/projects/a5f9957b91bd454580dd177abf846449` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:47.770237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49f6ca-c2e9-4a44-881d-e125557ee636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f9957b91bd454580dd177abf846449)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:47.772294 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49f6ca-c2e9-4a44-881d-e125557ee636 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:47.830973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7d49f6ca-c2e9-4a44-881d-e125557ee636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f9957b91bd454580dd177abf846449', 'request_id': 'req-7d49f6ca-c2e9-4a44-881d-e125557ee636'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:47.837719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7d49f6ca-c2e9-4a44-881d-e125557ee636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f9957b91bd454580dd177abf846449', 'request_id': 'req-7d49f6ca-c2e9-4a44-881d-e125557ee636'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:47.848622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7d49f6ca-c2e9-4a44-881d-e125557ee636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f9957b91bd454580dd177abf846449', 'request_id': 'req-7d49f6ca-c2e9-4a44-881d-e125557ee636'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:47.861360 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7d49f6ca-c2e9-4a44-881d-e125557ee636 admin admin] The token cache is being invalidate because project a5f9957b91bd454580dd177abf846449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:19:47.861653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7d49f6ca-c2e9-4a44-881d-e125557ee636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:47.862316 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-7d49f6ca-c2e9-4a44-881d-e125557ee636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:47.863801 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1440/2873] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:19:47 2022] DELETE /identity/v3/projects/a5f9957b91bd454580dd177abf846449 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:47.870063 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16d050-011a-402c-8027-7e2ec9b3de2b None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:47.870353 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16d050-011a-402c-8027-7e2ec9b3de2b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:47.870632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16d050-011a-402c-8027-7e2ec9b3de2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:47.892085 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-ff16d050-011a-402c-8027-7e2ec9b3de2b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:47.893573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-ff16d050-011a-402c-8027-7e2ec9b3de2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:47.960777 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1434/2874] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:47.968789 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9309-8181-4677-9e31-8161c2d53515 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:47.969106 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9309-8181-4677-9e31-8161c2d53515 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:47.969366 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9309-8181-4677-9e31-8161c2d53515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:47.990536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-35bc9309-8181-4677-9e31-8161c2d53515 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:47.991761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-35bc9309-8181-4677-9e31-8161c2d53515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:47.999815 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1441/2875] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:48.005176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16d050-011a-402c-8027-7e2ec9b3de2b None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:48.015335 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16d050-011a-402c-8027-7e2ec9b3de2b None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:48.020233 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637b0ae-61f9-4aff-84a0-57c2c7c6a894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:48.020881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637b0ae-61f9-4aff-84a0-57c2c7c6a894 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.021166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637b0ae-61f9-4aff-84a0-57c2c7c6a894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.021444 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637b0ae-61f9-4aff-84a0-57c2c7c6a894 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.022131 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637b0ae-61f9-4aff-84a0-57c2c7c6a894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:19:48.022437 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637b0ae-61f9-4aff-84a0-57c2c7c6a894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:48.024055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637b0ae-61f9-4aff-84a0-57c2c7c6a894 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:48.037482 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1435/2876] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:19:48.041752 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9309-8181-4677-9e31-8161c2d53515 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:48.053759 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9309-8181-4677-9e31-8161c2d53515 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:48.060956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9f3f-5ceb-4079-ab9f-44bd42165464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:48.061959 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9f3f-5ceb-4079-ab9f-44bd42165464 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.062412 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9f3f-5ceb-4079-ab9f-44bd42165464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.063831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9f3f-5ceb-4079-ab9f-44bd42165464 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.065069 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda9f3f-5ceb-4079-ab9f-44bd42165464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:48.068498 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda9f3f-5ceb-4079-ab9f-44bd42165464 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:48.101670 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1442/2877] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:19:48 2022] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:19:48.105965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637b0ae-61f9-4aff-84a0-57c2c7c6a894 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:48.124468 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637b0ae-61f9-4aff-84a0-57c2c7c6a894 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:48.146113 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:48.190805 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f14022-f2fb-444a-9077-e1911940384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:48.191415 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f14022-f2fb-444a-9077-e1911940384d admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.191694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f14022-f2fb-444a-9077-e1911940384d admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.191970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f14022-f2fb-444a-9077-e1911940384d admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.193529 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f14022-f2fb-444a-9077-e1911940384d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:48.194581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f14022-f2fb-444a-9077-e1911940384d admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:48.218399 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1436/2878] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:19:48 2022] POST /identity/v3/users => generated 305 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:19:48.222902 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9f3f-5ceb-4079-ab9f-44bd42165464 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:48.235187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9f3f-5ceb-4079-ab9f-44bd42165464 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:48.240291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7b4c4-ee92-4ca9-814f-413acbca91dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:48.240974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7b4c4-ee92-4ca9-814f-413acbca91dd admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.241256 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7b4c4-ee92-4ca9-814f-413acbca91dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.241536 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7b4c4-ee92-4ca9-814f-413acbca91dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.242188 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7b4c4-ee92-4ca9-814f-413acbca91dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:48.243796 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7b4c4-ee92-4ca9-814f-413acbca91dd admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:48.255248 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1443/2879] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:19:48.259383 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f14022-f2fb-444a-9077-e1911940384d admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:48.269898 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f14022-f2fb-444a-9077-e1911940384d admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:48.274956 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf601bd-5759-4aa4-b84a-9675513cfa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:48.275601 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf601bd-5759-4aa4-b84a-9675513cfa97 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.275881 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf601bd-5759-4aa4-b84a-9675513cfa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.276200 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf601bd-5759-4aa4-b84a-9675513cfa97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.276916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf601bd-5759-4aa4-b84a-9675513cfa97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:48.278546 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf601bd-5759-4aa4-b84a-9675513cfa97 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:48.290395 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1437/2880] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:19:48.302849 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7b4c4-ee92-4ca9-814f-413acbca91dd admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:48.314273 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7b4c4-ee92-4ca9-814f-413acbca91dd admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:48.318882 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe457010-578e-4b94-8e48-a04e352f0d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:48.319540 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe457010-578e-4b94-8e48-a04e352f0d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.319819 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe457010-578e-4b94-8e48-a04e352f0d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.320093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe457010-578e-4b94-8e48-a04e352f0d5b admin admin] PATH_INFO: `/v3/projects/2074574cf1f340a5a034f04b8aca2463/users/70cdf72b8f8b495d844d7ebee34a7831/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.332249 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:48.336956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe457010-578e-4b94-8e48-a04e352f0d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2074574cf1f340a5a034f04b8aca2463, user_id=70cdf72b8f8b495d844d7ebee34a7831, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:48.340364 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe457010-578e-4b94-8e48-a04e352f0d5b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:48.354717 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1444/2881] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:19:48 2022] PUT /identity/v3/projects/2074574cf1f340a5a034f04b8aca2463/users/70cdf72b8f8b495d844d7ebee34a7831/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:48.365943 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40399484-b5ad-4a95-88e9-a73dc7655320 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.366243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40399484-b5ad-4a95-88e9-a73dc7655320 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.366479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40399484-b5ad-4a95-88e9-a73dc7655320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.396441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-40399484-b5ad-4a95-88e9-a73dc7655320 None None] MFA Rules not processed for user `70cdf72b8f8b495d844d7ebee34a7831`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:48.397699 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-40399484-b5ad-4a95-88e9-a73dc7655320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:48.467733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1438/2882] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:48 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:48.473501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe457010-578e-4b94-8e48-a04e352f0d5b admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:48.538574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe457010-578e-4b94-8e48-a04e352f0d5b admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:48.543219 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424f852-48f9-409d-a540-bc7bbe4ccf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:48.543829 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424f852-48f9-409d-a540-bc7bbe4ccf79 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.544108 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424f852-48f9-409d-a540-bc7bbe4ccf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.544382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424f852-48f9-409d-a540-bc7bbe4ccf79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.545082 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424f852-48f9-409d-a540-bc7bbe4ccf79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:48.547051 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424f852-48f9-409d-a540-bc7bbe4ccf79 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:48.575943 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1445/2883] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:19:48 2022] POST /identity/v3/projects => generated 409 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:19:48.581234 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40399484-b5ad-4a95-88e9-a73dc7655320 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:48.599589 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40399484-b5ad-4a95-88e9-a73dc7655320 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:48.665269 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53d6ce-e844-4fb8-8124-a052d2193c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:48.665953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53d6ce-e844-4fb8-8124-a052d2193c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.666306 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53d6ce-e844-4fb8-8124-a052d2193c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.666544 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53d6ce-e844-4fb8-8124-a052d2193c9f admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.667201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53d6ce-e844-4fb8-8124-a052d2193c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:48.669170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53d6ce-e844-4fb8-8124-a052d2193c9f admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:48.691790 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1439/2884] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:19:48 2022] POST /identity/v3/users => generated 311 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:19:48.695860 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424f852-48f9-409d-a540-bc7bbe4ccf79 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:48.707187 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424f852-48f9-409d-a540-bc7bbe4ccf79 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:48.711840 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980551a3-5242-4302-9511-66c186a74bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:48.712446 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980551a3-5242-4302-9511-66c186a74bba admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.712764 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980551a3-5242-4302-9511-66c186a74bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.713036 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980551a3-5242-4302-9511-66c186a74bba admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.713680 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980551a3-5242-4302-9511-66c186a74bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:48.715312 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980551a3-5242-4302-9511-66c186a74bba admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:48.727122 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1446/2885] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:19:48.732489 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53d6ce-e844-4fb8-8124-a052d2193c9f admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:48.744387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53d6ce-e844-4fb8-8124-a052d2193c9f admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:48.749362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e336ef-569b-4838-a888-3febf5b5fac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:48.750020 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e336ef-569b-4838-a888-3febf5b5fac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.750377 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e336ef-569b-4838-a888-3febf5b5fac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.751291 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e336ef-569b-4838-a888-3febf5b5fac2 admin admin] PATH_INFO: `/v3/projects/a45f0d2fae2a4291a16c904896104841/users/d2caf2922ecf4fd9a53f92892202655f/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.767975 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e336ef-569b-4838-a888-3febf5b5fac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45f0d2fae2a4291a16c904896104841, user_id=d2caf2922ecf4fd9a53f92892202655f, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:48.770677 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e336ef-569b-4838-a888-3febf5b5fac2 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:48.773763 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:48.795364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1440/2886] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:19:48 2022] PUT /identity/v3/projects/a45f0d2fae2a4291a16c904896104841/users/d2caf2922ecf4fd9a53f92892202655f/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:48.799806 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980551a3-5242-4302-9511-66c186a74bba admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:48.810983 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980551a3-5242-4302-9511-66c186a74bba admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:48.871470 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921ffb-018c-4dd6-8ea4-096cd5f18483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:48.872129 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921ffb-018c-4dd6-8ea4-096cd5f18483 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.872437 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921ffb-018c-4dd6-8ea4-096cd5f18483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.872739 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921ffb-018c-4dd6-8ea4-096cd5f18483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.873389 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3921ffb-018c-4dd6-8ea4-096cd5f18483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:48.875013 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3921ffb-018c-4dd6-8ea4-096cd5f18483 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:48.885674 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1447/2887] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:19:48.890507 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e336ef-569b-4838-a888-3febf5b5fac2 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:48.902632 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e336ef-569b-4838-a888-3febf5b5fac2 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:48.908154 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d3e52-7118-4fae-b540-6436c0b2b6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:48.908793 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d3e52-7118-4fae-b540-6436c0b2b6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.909076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d3e52-7118-4fae-b540-6436c0b2b6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.909350 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d3e52-7118-4fae-b540-6436c0b2b6d9 admin admin] PATH_INFO: `/v3/projects/a45f0d2fae2a4291a16c904896104841/users/d2caf2922ecf4fd9a53f92892202655f/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.911303 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d3e52-7118-4fae-b540-6436c0b2b6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45f0d2fae2a4291a16c904896104841, user_id=d2caf2922ecf4fd9a53f92892202655f, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:48.913927 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d3e52-7118-4fae-b540-6436c0b2b6d9 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:48.925171 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1441/2888] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:19:48 2022] PUT /identity/v3/projects/a45f0d2fae2a4291a16c904896104841/users/d2caf2922ecf4fd9a53f92892202655f/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:48.937407 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f947b5-4369-4579-8a57-fd6f68bd7ed8 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:48.937783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f947b5-4369-4579-8a57-fd6f68bd7ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:48.938710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f947b5-4369-4579-8a57-fd6f68bd7ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:48.969919 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-c1f947b5-4369-4579-8a57-fd6f68bd7ed8 None None] MFA Rules not processed for user `d2caf2922ecf4fd9a53f92892202655f`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:48.971150 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-c1f947b5-4369-4579-8a57-fd6f68bd7ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:49.030088 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:49.055250 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1448/2889] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:48 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:49.066022 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d3e52-7118-4fae-b540-6436c0b2b6d9 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:49.068375 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-cf6d3e52-7118-4fae-b540-6436c0b2b6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:49.161106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d3e52-7118-4fae-b540-6436c0b2b6d9 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:49.164902 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a627c-09aa-4fe4-a6f4-0f2891d6681c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:49.165604 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a627c-09aa-4fe4-a6f4-0f2891d6681c service cinder] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:49.165778 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a627c-09aa-4fe4-a6f4-0f2891d6681c service cinder] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:49.166177 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a627c-09aa-4fe4-a6f4-0f2891d6681c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:49.176190 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a627c-09aa-4fe4-a6f4-0f2891d6681c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:49.177590 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a627c-09aa-4fe4-a6f4-0f2891d6681c service cinder] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:49.187449 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1442/2890] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:19:49 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:19:49.349936 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f947b5-4369-4579-8a57-fd6f68bd7ed8 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:49.359803 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f947b5-4369-4579-8a57-fd6f68bd7ed8 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:49.363761 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4e1da-3221-4191-bdd2-b242dc05ae91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:49.364375 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4e1da-3221-4191-bdd2-b242dc05ae91 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:49.364657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4e1da-3221-4191-bdd2-b242dc05ae91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:49.364973 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4e1da-3221-4191-bdd2-b242dc05ae91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:49.430220 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4e1da-3221-4191-bdd2-b242dc05ae91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:49.431636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4e1da-3221-4191-bdd2-b242dc05ae91 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:49.441673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1449/2891] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:19:49 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:19:54.794806 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a627c-09aa-4fe4-a6f4-0f2891d6681c service cinder] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:54.855873 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a627c-09aa-4fe4-a6f4-0f2891d6681c service cinder] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:54.860953 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:54.861569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:54.861848 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:54.862132 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] PATH_INFO: `/v3/users/70cdf72b8f8b495d844d7ebee34a7831` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:54.863240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] RBAC: Authorizing `identity:delete_user(user_id=70cdf72b8f8b495d844d7ebee34a7831)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:54.865174 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:54.913089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cdf72b8f8b495d844d7ebee34a7831'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:54.920880 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cdf72b8f8b495d844d7ebee34a7831'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:54.921551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cdf72b8f8b495d844d7ebee34a7831'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:54.922926 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cdf72b8f8b495d844d7ebee34a7831'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:54.933565 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:54.936123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cdf72b8f8b495d844d7ebee34a7831'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:54.949980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1443/2892] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:19:54 2022] DELETE /identity/v3/users/70cdf72b8f8b495d844d7ebee34a7831 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:19:54.954606 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25510555-50af-404e-adc5-e24f9583ab87 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:54.955107 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25510555-50af-404e-adc5-e24f9583ab87 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:54.955216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25510555-50af-404e-adc5-e24f9583ab87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:54.974049 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-25510555-50af-404e-adc5-e24f9583ab87 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:54.975231 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-25510555-50af-404e-adc5-e24f9583ab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:55.040156 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1450/2893] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:55.050499 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:55.051896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:55.107481 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0aa6-f598-4b5d-93ac-a6d6828ce53a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:55.111800 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa6597-eb5e-4259-a9a1-0e77c6e34672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:55.112394 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa6597-eb5e-4259-a9a1-0e77c6e34672 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:55.112672 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa6597-eb5e-4259-a9a1-0e77c6e34672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:55.112970 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa6597-eb5e-4259-a9a1-0e77c6e34672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:55.121875 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa6597-eb5e-4259-a9a1-0e77c6e34672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:55.123278 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa6597-eb5e-4259-a9a1-0e77c6e34672 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:55.133397 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1444/2894] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:19:55.410834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25510555-50af-404e-adc5-e24f9583ab87 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:55.412436 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-25510555-50af-404e-adc5-e24f9583ab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:55.425889 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25510555-50af-404e-adc5-e24f9583ab87 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:55.431215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:55.431854 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:55.432134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:55.432410 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] PATH_INFO: `/v3/projects/2074574cf1f340a5a034f04b8aca2463` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:55.433566 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2074574cf1f340a5a034f04b8aca2463)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:55.435492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:55.486126 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2074574cf1f340a5a034f04b8aca2463', 'request_id': 'req-b50e3774-4360-40bd-8b6d-682a5fd3f678'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:55.491698 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2074574cf1f340a5a034f04b8aca2463', 'request_id': 'req-b50e3774-4360-40bd-8b6d-682a5fd3f678'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:55.499192 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2074574cf1f340a5a034f04b8aca2463', 'request_id': 'req-b50e3774-4360-40bd-8b6d-682a5fd3f678'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:55.510719 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] The token cache is being invalidate because project 2074574cf1f340a5a034f04b8aca2463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:19:55.511006 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:55.511633 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:55.513144 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1451/2895] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:19:55 2022] DELETE /identity/v3/projects/2074574cf1f340a5a034f04b8aca2463 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:55.517635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa6597-eb5e-4259-a9a1-0e77c6e34672 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:55.527167 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa6597-eb5e-4259-a9a1-0e77c6e34672 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:55.612965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea68ff-ac92-46c9-b799-19ee294bb541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:55.613598 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea68ff-ac92-46c9-b799-19ee294bb541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:55.613877 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea68ff-ac92-46c9-b799-19ee294bb541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:55.614155 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea68ff-ac92-46c9-b799-19ee294bb541 admin admin] PATH_INFO: `/v3/users/d2caf2922ecf4fd9a53f92892202655f` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:55.615283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea68ff-ac92-46c9-b799-19ee294bb541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2caf2922ecf4fd9a53f92892202655f)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:55.617216 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea68ff-ac92-46c9-b799-19ee294bb541 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:55.668295 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-21ea68ff-ac92-46c9-b799-19ee294bb541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2caf2922ecf4fd9a53f92892202655f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:55.676755 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-21ea68ff-ac92-46c9-b799-19ee294bb541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2caf2922ecf4fd9a53f92892202655f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:55.677317 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-21ea68ff-ac92-46c9-b799-19ee294bb541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2caf2922ecf4fd9a53f92892202655f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:55.677920 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-21ea68ff-ac92-46c9-b799-19ee294bb541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2caf2922ecf4fd9a53f92892202655f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:55.689915 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-21ea68ff-ac92-46c9-b799-19ee294bb541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2caf2922ecf4fd9a53f92892202655f'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:55.701965 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1445/2896] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:19:55 2022] DELETE /identity/v3/users/d2caf2922ecf4fd9a53f92892202655f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:55.981736 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:55.983232 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:55.997492 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e3774-4360-40bd-8b6d-682a5fd3f678 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:56.002110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:56.057995 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155f6ea-fb15-44de-83c3-b85a32804ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:56.058621 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155f6ea-fb15-44de-83c3-b85a32804ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.058900 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155f6ea-fb15-44de-83c3-b85a32804ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.059171 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155f6ea-fb15-44de-83c3-b85a32804ac5 admin admin] PATH_INFO: `/v3/projects/a45f0d2fae2a4291a16c904896104841` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:56.060276 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155f6ea-fb15-44de-83c3-b85a32804ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45f0d2fae2a4291a16c904896104841)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:56.062216 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155f6ea-fb15-44de-83c3-b85a32804ac5 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:56.110829 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2155f6ea-fb15-44de-83c3-b85a32804ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45f0d2fae2a4291a16c904896104841', 'request_id': 'req-2155f6ea-fb15-44de-83c3-b85a32804ac5'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:56.116636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2155f6ea-fb15-44de-83c3-b85a32804ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45f0d2fae2a4291a16c904896104841', 'request_id': 'req-2155f6ea-fb15-44de-83c3-b85a32804ac5'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:56.124043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2155f6ea-fb15-44de-83c3-b85a32804ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45f0d2fae2a4291a16c904896104841', 'request_id': 'req-2155f6ea-fb15-44de-83c3-b85a32804ac5'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:56.135974 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2155f6ea-fb15-44de-83c3-b85a32804ac5 admin admin] The token cache is being invalidate because project a45f0d2fae2a4291a16c904896104841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:19:56.136268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2155f6ea-fb15-44de-83c3-b85a32804ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:56.136935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-2155f6ea-fb15-44de-83c3-b85a32804ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:56.138444 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1452/2897] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:19:55 2022] DELETE /identity/v3/projects/a45f0d2fae2a4291a16c904896104841 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:56.144137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cca71-9558-4759-99c5-beb69f5efb8b None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.144618 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cca71-9558-4759-99c5-beb69f5efb8b None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.144774 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cca71-9558-4759-99c5-beb69f5efb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:56.159203 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:56.166609 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-c88cca71-9558-4759-99c5-beb69f5efb8b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:56.168432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-c88cca71-9558-4759-99c5-beb69f5efb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:56.228733 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1446/2898] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:56.237284 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4537b6d-9b7c-468b-89f3-ffad60b2ce0d None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.237573 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4537b6d-9b7c-468b-89f3-ffad60b2ce0d None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.237848 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4537b6d-9b7c-468b-89f3-ffad60b2ce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:56.257737 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-b4537b6d-9b7c-468b-89f3-ffad60b2ce0d None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:56.258936 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-b4537b6d-9b7c-468b-89f3-ffad60b2ce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:56.267418 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1453/2899] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:56.271870 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cca71-9558-4759-99c5-beb69f5efb8b None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:56.283641 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cca71-9558-4759-99c5-beb69f5efb8b None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:56.288224 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb9e9c-a8d5-4fe0-9586-18863403c59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:56.288853 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb9e9c-a8d5-4fe0-9586-18863403c59a admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.289137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb9e9c-a8d5-4fe0-9586-18863403c59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.289411 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb9e9c-a8d5-4fe0-9586-18863403c59a admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:56.290060 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb9e9c-a8d5-4fe0-9586-18863403c59a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:19:56.290362 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb9e9c-a8d5-4fe0-9586-18863403c59a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:56.291981 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb9e9c-a8d5-4fe0-9586-18863403c59a admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:56.304386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1447/2900] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:19:56.308914 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4537b6d-9b7c-468b-89f3-ffad60b2ce0d None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:56.318614 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4537b6d-9b7c-468b-89f3-ffad60b2ce0d None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:56.323315 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28294b67-22d2-4527-a515-c176791a8f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:56.323911 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28294b67-22d2-4527-a515-c176791a8f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.324193 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28294b67-22d2-4527-a515-c176791a8f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.324468 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28294b67-22d2-4527-a515-c176791a8f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:56.325154 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28294b67-22d2-4527-a515-c176791a8f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:56.327068 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28294b67-22d2-4527-a515-c176791a8f44 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:56.355746 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1454/2901] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:19:56 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:19:56.359980 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb9e9c-a8d5-4fe0-9586-18863403c59a admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:56.369888 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb9e9c-a8d5-4fe0-9586-18863403c59a admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:56.425494 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3670-aecf-4edf-b599-34ea6fadae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:56.426089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3670-aecf-4edf-b599-34ea6fadae63 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.426424 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3670-aecf-4edf-b599-34ea6fadae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.426639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3670-aecf-4edf-b599-34ea6fadae63 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:56.427271 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf3670-aecf-4edf-b599-34ea6fadae63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:56.429209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf3670-aecf-4edf-b599-34ea6fadae63 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:56.451039 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1448/2902] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:19:56 2022] POST /identity/v3/users => generated 280 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:19:56.455898 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28294b67-22d2-4527-a515-c176791a8f44 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:56.466302 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28294b67-22d2-4527-a515-c176791a8f44 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:56.471551 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad068c-425c-402c-a137-ce7fff059edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:56.472215 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad068c-425c-402c-a137-ce7fff059edc admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.472501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad068c-425c-402c-a137-ce7fff059edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.472831 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad068c-425c-402c-a137-ce7fff059edc admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:56.473482 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad068c-425c-402c-a137-ce7fff059edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:56.475179 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad068c-425c-402c-a137-ce7fff059edc admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:56.485621 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1455/2903] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:19:56.489558 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3670-aecf-4edf-b599-34ea6fadae63 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:56.499538 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3670-aecf-4edf-b599-34ea6fadae63 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:56.504387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51fd10-830c-40ba-98e4-d9b45e9e1740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:56.505008 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51fd10-830c-40ba-98e4-d9b45e9e1740 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.505413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51fd10-830c-40ba-98e4-d9b45e9e1740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.505690 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51fd10-830c-40ba-98e4-d9b45e9e1740 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:56.506326 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51fd10-830c-40ba-98e4-d9b45e9e1740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:56.507886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51fd10-830c-40ba-98e4-d9b45e9e1740 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:56.519798 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1449/2904] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:19:56.523895 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad068c-425c-402c-a137-ce7fff059edc admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:56.534708 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad068c-425c-402c-a137-ce7fff059edc admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:56.539291 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2a8e4-26fa-4a0a-a35d-63972fbb0375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:56.539933 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2a8e4-26fa-4a0a-a35d-63972fbb0375 admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.540211 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2a8e4-26fa-4a0a-a35d-63972fbb0375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.540486 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2a8e4-26fa-4a0a-a35d-63972fbb0375 admin admin] PATH_INFO: `/v3/projects/9f7030a70f3940ebadbb7ea8a5c8dba2/users/f8491b29e4434468b32c7262d98d2d13/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:56.555462 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2a8e4-26fa-4a0a-a35d-63972fbb0375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7030a70f3940ebadbb7ea8a5c8dba2, user_id=f8491b29e4434468b32c7262d98d2d13, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:56.558142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2a8e4-26fa-4a0a-a35d-63972fbb0375 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:56.571883 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1456/2905] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:19:56 2022] PUT /identity/v3/projects/9f7030a70f3940ebadbb7ea8a5c8dba2/users/f8491b29e4434468b32c7262d98d2d13/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:56.582854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d59b7f-8dd7-47cb-a452-07565f123948 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.583166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d59b7f-8dd7-47cb-a452-07565f123948 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.583438 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d59b7f-8dd7-47cb-a452-07565f123948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:56.611577 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-b3d59b7f-8dd7-47cb-a452-07565f123948 None None] MFA Rules not processed for user `f8491b29e4434468b32c7262d98d2d13`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:56.612823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-b3d59b7f-8dd7-47cb-a452-07565f123948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:56.675520 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1450/2906] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:19:56.712478 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2a8e4-26fa-4a0a-a35d-63972fbb0375 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:56.714255 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-73e2a8e4-26fa-4a0a-a35d-63972fbb0375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:56.748866 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:56.773246 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2a8e4-26fa-4a0a-a35d-63972fbb0375 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:56.776838 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7429e4b-8f3b-4a7c-a12f-c0fefd2c90c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c901e018aa1c429da33b5809873d0aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:56.777447 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7429e4b-8f3b-4a7c-a12f-c0fefd2c90c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.777735 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7429e4b-8f3b-4a7c-a12f-c0fefd2c90c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.778001 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7429e4b-8f3b-4a7c-a12f-c0fefd2c90c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:56.786664 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7429e4b-8f3b-4a7c-a12f-c0fefd2c90c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:56.788093 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7429e4b-8f3b-4a7c-a12f-c0fefd2c90c4 service cinder] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:56.796853 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1457/2907] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:19:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:19:56.813410 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d59b7f-8dd7-47cb-a452-07565f123948 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:56.817581 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:56.882896 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d59b7f-8dd7-47cb-a452-07565f123948 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:56.887461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:56.888096 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.888381 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.888655 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] PATH_INFO: `/v3/users/f8491b29e4434468b32c7262d98d2d13` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:56.889823 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8491b29e4434468b32c7262d98d2d13)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:56.892635 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:56.947832 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8491b29e4434468b32c7262d98d2d13'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:56.956107 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8491b29e4434468b32c7262d98d2d13'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:56.956746 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8491b29e4434468b32c7262d98d2d13'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:56.957354 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8491b29e4434468b32c7262d98d2d13'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:56.969607 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8491b29e4434468b32c7262d98d2d13'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:56.981952 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1451/2908] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:19:56 2022] DELETE /identity/v3/users/f8491b29e4434468b32c7262d98d2d13 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:56.987142 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba49eb-8854-4262-828e-ff2b5d6713e5 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:56.987656 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba49eb-8854-4262-828e-ff2b5d6713e5 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:56.987767 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba49eb-8854-4262-828e-ff2b5d6713e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:57.009422 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-adba49eb-8854-4262-828e-ff2b5d6713e5 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:57.010600 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-adba49eb-8854-4262-828e-ff2b5d6713e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:57.073009 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1458/2909] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:57.082682 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:57.084084 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:57.141814 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afcfc5-04fd-429a-bfeb-cbe96abacea8 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:57.145551 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d744c0-35f5-49ae-b0e4-bca54d6bc797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:57.146137 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d744c0-35f5-49ae-b0e4-bca54d6bc797 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:57.146432 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d744c0-35f5-49ae-b0e4-bca54d6bc797 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:57.146697 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d744c0-35f5-49ae-b0e4-bca54d6bc797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:57.155935 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d744c0-35f5-49ae-b0e4-bca54d6bc797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:57.157599 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d744c0-35f5-49ae-b0e4-bca54d6bc797 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:57.171272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1452/2910] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:19:57.452575 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba49eb-8854-4262-828e-ff2b5d6713e5 None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:57.454481 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-adba49eb-8854-4262-828e-ff2b5d6713e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:57.467577 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba49eb-8854-4262-828e-ff2b5d6713e5 None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:57.474776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c6823-50ef-4736-8ba2-b380bb356d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:57.474776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c6823-50ef-4736-8ba2-b380bb356d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:57.474776 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c6823-50ef-4736-8ba2-b380bb356d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:57.475604 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c6823-50ef-4736-8ba2-b380bb356d46 admin admin] PATH_INFO: `/v3/projects/9f7030a70f3940ebadbb7ea8a5c8dba2` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:57.476975 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c6823-50ef-4736-8ba2-b380bb356d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7030a70f3940ebadbb7ea8a5c8dba2)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:57.478998 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c6823-50ef-4736-8ba2-b380bb356d46 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:57.527053 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-060c6823-50ef-4736-8ba2-b380bb356d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7030a70f3940ebadbb7ea8a5c8dba2', 'request_id': 'req-060c6823-50ef-4736-8ba2-b380bb356d46'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:57.533815 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-060c6823-50ef-4736-8ba2-b380bb356d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7030a70f3940ebadbb7ea8a5c8dba2', 'request_id': 'req-060c6823-50ef-4736-8ba2-b380bb356d46'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:57.540879 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-060c6823-50ef-4736-8ba2-b380bb356d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7030a70f3940ebadbb7ea8a5c8dba2', 'request_id': 'req-060c6823-50ef-4736-8ba2-b380bb356d46'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:57.553134 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-060c6823-50ef-4736-8ba2-b380bb356d46 admin admin] The token cache is being invalidate because project 9f7030a70f3940ebadbb7ea8a5c8dba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81620) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:19:57.553424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-060c6823-50ef-4736-8ba2-b380bb356d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:57.554057 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-060c6823-50ef-4736-8ba2-b380bb356d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:19:57.555523 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1459/2911] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:19:57 2022] DELETE /identity/v3/projects/9f7030a70f3940ebadbb7ea8a5c8dba2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:57.560597 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855530b1-ab6e-49c4-ac33-90c2ae321f84 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:57.560923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855530b1-ab6e-49c4-ac33-90c2ae321f84 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:57.561235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855530b1-ab6e-49c4-ac33-90c2ae321f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:57.581252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-855530b1-ab6e-49c4-ac33-90c2ae321f84 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:57.582480 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-855530b1-ab6e-49c4-ac33-90c2ae321f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:57.602722 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:57.643283 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1453/2912] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:57.705684 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb5fe6-5713-4c9d-8495-94c34121331b None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:57.705969 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb5fe6-5713-4c9d-8495-94c34121331b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:57.706244 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb5fe6-5713-4c9d-8495-94c34121331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:57.726400 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-19cb5fe6-5713-4c9d-8495-94c34121331b None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:57.727599 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-19cb5fe6-5713-4c9d-8495-94c34121331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:57.736015 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1460/2913] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:57.740355 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855530b1-ab6e-49c4-ac33-90c2ae321f84 None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:57.750754 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855530b1-ab6e-49c4-ac33-90c2ae321f84 None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:57.755387 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b2a68-c985-4409-8270-fa24f1243315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:57.755986 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b2a68-c985-4409-8270-fa24f1243315 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:57.756266 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b2a68-c985-4409-8270-fa24f1243315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:57.756543 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b2a68-c985-4409-8270-fa24f1243315 admin admin] PATH_INFO: `/v3/domains` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:57.757225 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b2a68-c985-4409-8270-fa24f1243315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81621) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:19:57.757530 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b2a68-c985-4409-8270-fa24f1243315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:57.759122 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b2a68-c985-4409-8270-fa24f1243315 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:57.771740 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1454/2914] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Sep 7 16:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:19:57.776033 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb5fe6-5713-4c9d-8495-94c34121331b None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:57.786340 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb5fe6-5713-4c9d-8495-94c34121331b None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:57.790935 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c417ec-5bfd-4f1a-bf9c-c5308dfb2011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:57.791529 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c417ec-5bfd-4f1a-bf9c-c5308dfb2011 admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:57.791811 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c417ec-5bfd-4f1a-bf9c-c5308dfb2011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:57.792085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c417ec-5bfd-4f1a-bf9c-c5308dfb2011 admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:57.792749 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c417ec-5bfd-4f1a-bf9c-c5308dfb2011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:57.794710 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c417ec-5bfd-4f1a-bf9c-c5308dfb2011 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:57.821650 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1461/2915] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:19:57 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:19:57.825854 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b2a68-c985-4409-8270-fa24f1243315 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:57.836863 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b2a68-c985-4409-8270-fa24f1243315 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:57.895235 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fdeae-5fd3-45f6-8c89-1ddbe6227c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:57.895858 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fdeae-5fd3-45f6-8c89-1ddbe6227c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:57.896145 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fdeae-5fd3-45f6-8c89-1ddbe6227c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:57.896421 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fdeae-5fd3-45f6-8c89-1ddbe6227c7e admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:57.897458 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fdeae-5fd3-45f6-8c89-1ddbe6227c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:57.899398 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fdeae-5fd3-45f6-8c89-1ddbe6227c7e admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:57.920868 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1455/2916] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:19:57 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:19:57.925032 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c417ec-5bfd-4f1a-bf9c-c5308dfb2011 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:57.935236 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c417ec-5bfd-4f1a-bf9c-c5308dfb2011 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:57.939780 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d578c3a-7304-41d5-9aa3-28925d72106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:57.940371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578c3a-7304-41d5-9aa3-28925d72106a admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:57.940653 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578c3a-7304-41d5-9aa3-28925d72106a admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:57.940962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578c3a-7304-41d5-9aa3-28925d72106a admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:57.941602 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d578c3a-7304-41d5-9aa3-28925d72106a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:57.943234 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d578c3a-7304-41d5-9aa3-28925d72106a admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:57.954079 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1462/2917] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:19:57.957573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fdeae-5fd3-45f6-8c89-1ddbe6227c7e admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:57.967364 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fdeae-5fd3-45f6-8c89-1ddbe6227c7e admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:57.972536 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e6115-2a13-4bd6-9d37-fa24e18d4fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:57.973150 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6115-2a13-4bd6-9d37-fa24e18d4fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:57.973423 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6115-2a13-4bd6-9d37-fa24e18d4fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:57.973693 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6115-2a13-4bd6-9d37-fa24e18d4fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:57.974323 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e6115-2a13-4bd6-9d37-fa24e18d4fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:57.975882 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e6115-2a13-4bd6-9d37-fa24e18d4fd0 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:57.986321 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1456/2918] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:19:57.990507 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d578c3a-7304-41d5-9aa3-28925d72106a admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:58.001146 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d578c3a-7304-41d5-9aa3-28925d72106a admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:58.005810 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68713fe0-eae7-4702-a7a3-5142a6d0a99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:58.006463 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68713fe0-eae7-4702-a7a3-5142a6d0a99b admin admin] REQUEST_METHOD: `PUT` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:58.006740 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68713fe0-eae7-4702-a7a3-5142a6d0a99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:58.007014 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68713fe0-eae7-4702-a7a3-5142a6d0a99b admin admin] PATH_INFO: `/v3/projects/bd528973ce684113bb65ebe1f7c596e7/users/89603b3fc7b34070ae58a162113d1f9d/roles/068a24594f0b4d01aab3485c009314d4` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:58.021972 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68713fe0-eae7-4702-a7a3-5142a6d0a99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd528973ce684113bb65ebe1f7c596e7, user_id=89603b3fc7b34070ae58a162113d1f9d, role_id=068a24594f0b4d01aab3485c009314d4)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:58.024642 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68713fe0-eae7-4702-a7a3-5142a6d0a99b admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:58.027755 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:19:58.040355 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1463/2919] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:19:57 2022] PUT /identity/v3/projects/bd528973ce684113bb65ebe1f7c596e7/users/89603b3fc7b34070ae58a162113d1f9d/roles/068a24594f0b4d01aab3485c009314d4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:19:58.045339 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf1a54-48c3-4839-b945-2155b30d9282 None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:58.045628 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf1a54-48c3-4839-b945-2155b30d9282 None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:58.045910 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf1a54-48c3-4839-b945-2155b30d9282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:58.065061 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-64bf1a54-48c3-4839-b945-2155b30d9282 None None] MFA Rules not processed for user `ce735e61d3c64f3e9c5c513c8681f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:19:58.066281 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-64bf1a54-48c3-4839-b945-2155b30d9282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:58.126240 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1457/2920] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:19:58.135977 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68713fe0-eae7-4702-a7a3-5142a6d0a99b admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:19:58.137765 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-68713fe0-eae7-4702-a7a3-5142a6d0a99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:19:58.194924 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68713fe0-eae7-4702-a7a3-5142a6d0a99b admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:19:58.198586 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9778e-02be-4c4b-b7e6-96fbd87816d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:19:58.199185 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9778e-02be-4c4b-b7e6-96fbd87816d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:19:58.199465 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9778e-02be-4c4b-b7e6-96fbd87816d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:19:58.199739 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9778e-02be-4c4b-b7e6-96fbd87816d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:19:58.209402 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9778e-02be-4c4b-b7e6-96fbd87816d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:19:58.210845 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9778e-02be-4c4b-b7e6-96fbd87816d2 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:19:58.220359 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1464/2921] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:20:02.312021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c046d11-4743-4f92-a0f7-ee327a26b82e None None] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:02.312532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c046d11-4743-4f92-a0f7-ee327a26b82e None None] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:02.313360 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c046d11-4743-4f92-a0f7-ee327a26b82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:02.348258 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.auth.core [None req-1c046d11-4743-4f92-a0f7-ee327a26b82e None None] MFA Rules not processed for user `89603b3fc7b34070ae58a162113d1f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81621) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:20:02.349567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-1c046d11-4743-4f92-a0f7-ee327a26b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:20:02.378949 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:20:02.430159 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1458/2922] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:20:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:20:02.434844 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9778e-02be-4c4b-b7e6-96fbd87816d2 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:20:02.444678 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9778e-02be-4c4b-b7e6-96fbd87816d2 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:20:02.449229 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0eb74-4d14-4715-af0e-bd55efdf5f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:20:02.449835 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0eb74-4d14-4715-af0e-bd55efdf5f2c admin admin] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:02.450111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0eb74-4d14-4715-af0e-bd55efdf5f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:02.450382 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0eb74-4d14-4715-af0e-bd55efdf5f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:02.451024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0eb74-4d14-4715-af0e-bd55efdf5f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:20:02.453501 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0eb74-4d14-4715-af0e-bd55efdf5f2c admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:20:02.487045 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1465/2923] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Sep 7 16:20:02 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:20:02.488846 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c046d11-4743-4f92-a0f7-ee327a26b82e None None] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:20:02.500861 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c046d11-4743-4f92-a0f7-ee327a26b82e None None] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:20:02.558596 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146e7e-5090-4e44-a85f-f70e42bf4473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:20:02.559201 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146e7e-5090-4e44-a85f-f70e42bf4473 admin admin] REQUEST_METHOD: `POST` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:02.559479 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146e7e-5090-4e44-a85f-f70e42bf4473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:02.559750 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146e7e-5090-4e44-a85f-f70e42bf4473 admin admin] PATH_INFO: `/v3/users` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:02.560386 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b146e7e-5090-4e44-a85f-f70e42bf4473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:20:02.563346 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b146e7e-5090-4e44-a85f-f70e42bf4473 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:20:02.585756 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1459/2924] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Sep 7 16:20:02 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:20:02.589798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0eb74-4d14-4715-af0e-bd55efdf5f2c admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:20:02.602066 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0eb74-4d14-4715-af0e-bd55efdf5f2c admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:20:02.606697 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d15857-148a-453c-9ac3-1a3f2463fb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:20:02.607296 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d15857-148a-453c-9ac3-1a3f2463fb9d admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:02.607576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d15857-148a-453c-9ac3-1a3f2463fb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:02.607847 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d15857-148a-453c-9ac3-1a3f2463fb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:02.608516 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d15857-148a-453c-9ac3-1a3f2463fb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:20:02.610702 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d15857-148a-453c-9ac3-1a3f2463fb9d admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:20:02.621768 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1466/2925] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:20:02.626569 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146e7e-5090-4e44-a85f-f70e42bf4473 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:20:02.636413 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146e7e-5090-4e44-a85f-f70e42bf4473 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:20:02.641123 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b120ae-ffb8-4387-ba61-0d695cf9f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:20:02.641759 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b120ae-ffb8-4387-ba61-0d695cf9f559 admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:02.642037 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b120ae-ffb8-4387-ba61-0d695cf9f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:02.642312 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b120ae-ffb8-4387-ba61-0d695cf9f559 admin admin] PATH_INFO: `/v3/projects/75c497d245d346289104917ea13d6973/users/69b5335663504af0bcdbeeaae2fb6bf6/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:02.657872 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b120ae-ffb8-4387-ba61-0d695cf9f559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c497d245d346289104917ea13d6973, user_id=69b5335663504af0bcdbeeaae2fb6bf6, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:20:02.660505 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b120ae-ffb8-4387-ba61-0d695cf9f559 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:20:02.673909 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1460/2926] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:20:02 2022] PUT /identity/v3/projects/75c497d245d346289104917ea13d6973/users/69b5335663504af0bcdbeeaae2fb6bf6/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:20:02.677829 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d15857-148a-453c-9ac3-1a3f2463fb9d admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:20:02.688557 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d15857-148a-453c-9ac3-1a3f2463fb9d admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:20:02.746781 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b9630-f406-47a0-a329-398ff2dbadd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:20:02.747392 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b9630-f406-47a0-a329-398ff2dbadd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:02.747673 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b9630-f406-47a0-a329-398ff2dbadd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:02.747947 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b9630-f406-47a0-a329-398ff2dbadd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:02.748646 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b9630-f406-47a0-a329-398ff2dbadd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:20:02.750790 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b9630-f406-47a0-a329-398ff2dbadd6 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:20:02.760430 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1467/2927] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Sep 7 16:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:20:02.764886 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b120ae-ffb8-4387-ba61-0d695cf9f559 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:20:02.776263 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b120ae-ffb8-4387-ba61-0d695cf9f559 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:20:02.781588 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235d2fc-1ce9-4f5f-a18b-cfd8c2b5e0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:20:02.782244 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235d2fc-1ce9-4f5f-a18b-cfd8c2b5e0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:02.782526 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235d2fc-1ce9-4f5f-a18b-cfd8c2b5e0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:02.782803 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235d2fc-1ce9-4f5f-a18b-cfd8c2b5e0fc admin admin] PATH_INFO: `/v3/projects/75c497d245d346289104917ea13d6973/users/69b5335663504af0bcdbeeaae2fb6bf6/roles/82a92af3d1d24106b94706aa71c779d5` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:02.784757 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235d2fc-1ce9-4f5f-a18b-cfd8c2b5e0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c497d245d346289104917ea13d6973, user_id=69b5335663504af0bcdbeeaae2fb6bf6, role_id=82a92af3d1d24106b94706aa71c779d5)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:20:02.787363 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235d2fc-1ce9-4f5f-a18b-cfd8c2b5e0fc admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:20:02.798064 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1461/2928] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Sep 7 16:20:02 2022] PUT /identity/v3/projects/75c497d245d346289104917ea13d6973/users/69b5335663504af0bcdbeeaae2fb6bf6/roles/82a92af3d1d24106b94706aa71c779d5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:20:07.670987 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c320f1-2448-42c6-8a32-bac93184547b None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:07.672064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c320f1-2448-42c6-8a32-bac93184547b None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:07.672064 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c320f1-2448-42c6-8a32-bac93184547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:07.705799 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-04c320f1-2448-42c6-8a32-bac93184547b None None] MFA Rules not processed for user `69b5335663504af0bcdbeeaae2fb6bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:20:07.707060 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-04c320f1-2448-42c6-8a32-bac93184547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:20:07.785925 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:20:07.810934 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1468/2929] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:20:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:20:07.825207 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235d2fc-1ce9-4f5f-a18b-cfd8c2b5e0fc admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:20:07.827036 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-a235d2fc-1ce9-4f5f-a18b-cfd8c2b5e0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:20:07.907826 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235d2fc-1ce9-4f5f-a18b-cfd8c2b5e0fc admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:20:07.913809 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4e8e-3e44-48bc-a06e-6d428c65f196 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc71e3a41ac644ff8a908b766495b5f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:20:07.914571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4e8e-3e44-48bc-a06e-6d428c65f196 service glance] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:07.914838 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4e8e-3e44-48bc-a06e-6d428c65f196 service glance] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:07.915118 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4e8e-3e44-48bc-a06e-6d428c65f196 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:07.950703 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:20:07.999492 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff4e8e-3e44-48bc-a06e-6d428c65f196 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:20:08.001567 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff4e8e-3e44-48bc-a06e-6d428c65f196 service glance] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:20:08.017416 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1462/2930] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:20:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:20:08.163197 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0bbd4-05d1-4e4a-af63-744fbafb728e None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:08.163579 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0bbd4-05d1-4e4a-af63-744fbafb728e None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:08.163863 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0bbd4-05d1-4e4a-af63-744fbafb728e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:08.200214 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-e9a0bbd4-05d1-4e4a-af63-744fbafb728e None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:20:08.201692 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-e9a0bbd4-05d1-4e4a-af63-744fbafb728e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:20:08.262958 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1469/2931] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:20:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:20:08.309916 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4e8e-3e44-48bc-a06e-6d428c65f196 service glance] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:20:08.311306 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-efff4e8e-3e44-48bc-a06e-6d428c65f196 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:20:08.383067 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4e8e-3e44-48bc-a06e-6d428c65f196 service glance] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:20:08.388068 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5529195-a249-4ea0-8087-054cd5d24120 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:20:08.388673 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5529195-a249-4ea0-8087-054cd5d24120 service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:08.388978 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5529195-a249-4ea0-8087-054cd5d24120 service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:08.389252 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5529195-a249-4ea0-8087-054cd5d24120 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:08.398170 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5529195-a249-4ea0-8087-054cd5d24120 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:20:08.399769 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5529195-a249-4ea0-8087-054cd5d24120 service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:20:08.409156 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1463/2932] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:20:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:20:17.325085 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bba66-64b2-445c-a38f-cf4a099e9738 None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:17.325615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bba66-64b2-445c-a38f-cf4a099e9738 None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:17.325615 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bba66-64b2-445c-a38f-cf4a099e9738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:17.346351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-f44bba66-64b2-445c-a38f-cf4a099e9738 None None] MFA Rules not processed for user `89603b3fc7b34070ae58a162113d1f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:20:17.347574 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-f44bba66-64b2-445c-a38f-cf4a099e9738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:20:17.358846 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1470/2933] 10.222.0.43 () {58 vars in 958 bytes} [Wed Sep 7 16:20:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:20:17.630659 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5529195-a249-4ea0-8087-054cd5d24120 service swift] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:20:17.689009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5529195-a249-4ea0-8087-054cd5d24120 service swift] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:20:17.692532 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df251987-d3bd-4b84-852f-6feba23e6a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:20:17.693166 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df251987-d3bd-4b84-852f-6feba23e6a44 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:17.693443 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df251987-d3bd-4b84-852f-6feba23e6a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:17.693715 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df251987-d3bd-4b84-852f-6feba23e6a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:17.695428 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-df251987-d3bd-4b84-852f-6feba23e6a44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:20:17.705828 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df251987-d3bd-4b84-852f-6feba23e6a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:20:17.707243 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df251987-d3bd-4b84-852f-6feba23e6a44 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:20:17.715461 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1464/2934] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:20:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:20:19.313783 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a42ee-1664-43c5-b454-23710f1d4fbf None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:19.314371 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a42ee-1664-43c5-b454-23710f1d4fbf None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:19.314688 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a42ee-1664-43c5-b454-23710f1d4fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:19.336798 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-da9a42ee-1664-43c5-b454-23710f1d4fbf None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:20:19.338455 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-da9a42ee-1664-43c5-b454-23710f1d4fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:20:19.346098 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1471/2935] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Sep 7 16:20:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:20:19.361441 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df251987-d3bd-4b84-852f-6feba23e6a44 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:20:19.382316 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df251987-d3bd-4b84-852f-6feba23e6a44 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:20:19.388470 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51f3e6-feef-402c-92e8-cbfe1a2c919b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:20:19.389135 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f3e6-feef-402c-92e8-cbfe1a2c919b service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:19.389419 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f3e6-feef-402c-92e8-cbfe1a2c919b service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:19.389694 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f3e6-feef-402c-92e8-cbfe1a2c919b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:19.399388 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51f3e6-feef-402c-92e8-cbfe1a2c919b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:20:19.401009 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51f3e6-feef-402c-92e8-cbfe1a2c919b service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:20:19.410209 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1465/2936] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:20:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:20:29.331625 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=41 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:20:29.407994 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=79 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:20:40.197157 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a42ee-1664-43c5-b454-23710f1d4fbf None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:20:40.198652 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-da9a42ee-1664-43c5-b454-23710f1d4fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:20:40.210225 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a42ee-1664-43c5-b454-23710f1d4fbf None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:20:40.213773 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a896-1a69-4178-b6b8-909c4b12bd95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:20:40.214370 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a896-1a69-4178-b6b8-909c4b12bd95 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:40.214654 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a896-1a69-4178-b6b8-909c4b12bd95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:40.214931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a896-1a69-4178-b6b8-909c4b12bd95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:40.224541 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a896-1a69-4178-b6b8-909c4b12bd95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:20:40.226022 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a896-1a69-4178-b6b8-909c4b12bd95 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:20:40.236114 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1472/2937] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:20:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:20:43.352069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51f3e6-feef-402c-92e8-cbfe1a2c919b service swift] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:20:43.362055 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51f3e6-feef-402c-92e8-cbfe1a2c919b service swift] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:20:43.365685 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179771c-bf75-4445-9d46-ad49f01636ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:20:43.366282 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179771c-bf75-4445-9d46-ad49f01636ce service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:20:43.366566 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179771c-bf75-4445-9d46-ad49f01636ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:20:43.366842 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179771c-bf75-4445-9d46-ad49f01636ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:20:43.368582 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-4179771c-bf75-4445-9d46-ad49f01636ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:20:43.443573 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179771c-bf75-4445-9d46-ad49f01636ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:20:43.445221 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179771c-bf75-4445-9d46-ad49f01636ce service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:20:43.458003 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1466/2938] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:20:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:20:50.231424 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=6 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:20:53.451545 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=34 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:21:09.975800 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a896-1a69-4178-b6b8-909c4b12bd95 service neutron] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:21:09.986024 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a896-1a69-4178-b6b8-909c4b12bd95 service neutron] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:21:09.990200 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9d387-dc05-4863-a403-424ffdea8289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:21:09.990931 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9d387-dc05-4863-a403-424ffdea8289 service neutron] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:21:09.991281 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9d387-dc05-4863-a403-424ffdea8289 service neutron] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:21:09.991636 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9d387-dc05-4863-a403-424ffdea8289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:21:09.993622 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ebe9d387-dc05-4863-a403-424ffdea8289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:21:10.005275 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9d387-dc05-4863-a403-424ffdea8289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:21:10.006792 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9d387-dc05-4863-a403-424ffdea8289 service neutron] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:21:10.016506 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1473/2939] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:21:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:21:11.181430 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179771c-bf75-4445-9d46-ad49f01636ce service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:21:11.192021 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179771c-bf75-4445-9d46-ad49f01636ce service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:21:11.195683 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3792d-307d-478d-ba6b-08338f1c4b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f048f8885448383f4a361b07dac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:21:11.196290 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3792d-307d-478d-ba6b-08338f1c4b08 service neutron] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:21:11.196574 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3792d-307d-478d-ba6b-08338f1c4b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:21:11.196913 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3792d-307d-478d-ba6b-08338f1c4b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:21:11.198664 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-5ee3792d-307d-478d-ba6b-08338f1c4b08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:21:11.219712 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3792d-307d-478d-ba6b-08338f1c4b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:21:11.222070 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3792d-307d-478d-ba6b-08338f1c4b08 service neutron] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:21:11.234492 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1467/2940] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:21:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:21:20.011753 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=6 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:21:21.228457 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=6 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:22:02.595590 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecf552-734f-4b4b-b495-743a7481b30f None None] REQUEST_METHOD: `POST` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:22:02.596125 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecf552-734f-4b4b-b495-743a7481b30f None None] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:22:02.596237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecf552-734f-4b4b-b495-743a7481b30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:22:02.664629 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.auth.core [None req-53ecf552-734f-4b4b-b495-743a7481b30f None None] MFA Rules not processed for user `c0fa7d339c134c20b471170e13bbb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81620) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:22:02.665869 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-53ecf552-734f-4b4b-b495-743a7481b30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:22:02.684616 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1474/2941] 10.222.0.43 () {58 vars in 967 bytes} [Wed Sep 7 16:22:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:22:02.729867 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3792d-307d-478d-ba6b-08338f1c4b08 service neutron] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:22:02.750742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3792d-307d-478d-ba6b-08338f1c4b08 service neutron] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:22:02.756272 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba1a46-fca6-4712-9768-f6f5c567fdc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd853bab10d9d4060809476bfc44d3822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:22:02.756911 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba1a46-fca6-4712-9768-f6f5c567fdc6 service swift] REQUEST_METHOD: `GET` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:22:02.757194 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba1a46-fca6-4712-9768-f6f5c567fdc6 service swift] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:22:02.757472 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba1a46-fca6-4712-9768-f6f5c567fdc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:22:02.765812 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba1a46-fca6-4712-9768-f6f5c567fdc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:22:02.767418 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba1a46-fca6-4712-9768-f6f5c567fdc6 service swift] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:22:02.776568 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1468/2942] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Sep 7 16:22:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:22:09.559268 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecf552-734f-4b4b-b495-743a7481b30f None None] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:22:09.637901 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecf552-734f-4b4b-b495-743a7481b30f None None] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:22:09.644957 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:22:09.645997 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:22:09.646310 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:22:09.646592 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] PATH_INFO: `/v3/users/89603b3fc7b34070ae58a162113d1f9d` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:22:09.648086 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89603b3fc7b34070ae58a162113d1f9d)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:22:09.649940 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:22:09.717904 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89603b3fc7b34070ae58a162113d1f9d'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:09.727917 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89603b3fc7b34070ae58a162113d1f9d'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:09.755431 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89603b3fc7b34070ae58a162113d1f9d'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:09.756363 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89603b3fc7b34070ae58a162113d1f9d'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:09.757111 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89603b3fc7b34070ae58a162113d1f9d'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:09.776155 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1475/2943] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:22:09 2022] DELETE /identity/v3/users/89603b3fc7b34070ae58a162113d1f9d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:22:09.974069 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba1a46-fca6-4712-9768-f6f5c567fdc6 service swift] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:22:09.985315 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba1a46-fca6-4712-9768-f6f5c567fdc6 service swift] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:22:10.068639 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:22:10.069372 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:22:10.069651 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:22:10.069923 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] PATH_INFO: `/v3/projects/bd528973ce684113bb65ebe1f7c596e7` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:22:10.071143 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd528973ce684113bb65ebe1f7c596e7)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:22:10.073090 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:22:10.137184 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd528973ce684113bb65ebe1f7c596e7', 'request_id': 'req-3ce2ce76-6cac-4972-a374-f728d71ffd70'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.146808 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd528973ce684113bb65ebe1f7c596e7', 'request_id': 'req-3ce2ce76-6cac-4972-a374-f728d71ffd70'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.152716 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd528973ce684113bb65ebe1f7c596e7', 'request_id': 'req-3ce2ce76-6cac-4972-a374-f728d71ffd70'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.163890 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] The token cache is being invalidate because project bd528973ce684113bb65ebe1f7c596e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:22:10.164176 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.165108 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.166571 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1469/2944] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:22:09 2022] DELETE /identity/v3/projects/bd528973ce684113bb65ebe1f7c596e7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:22:10.170607 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:22:10.172052 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:22:10.185730 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82898bad-71df-45f2-a984-8e708c115b08 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:22:10.225576 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:22:10.246043 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:22:10.246676 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:22:10.246956 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:22:10.247233 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] PATH_INFO: `/v3/users/69b5335663504af0bcdbeeaae2fb6bf6` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:22:10.248367 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b5335663504af0bcdbeeaae2fb6bf6)` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:22:10.250351 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:22:10.297333 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b5335663504af0bcdbeeaae2fb6bf6'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.305834 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b5335663504af0bcdbeeaae2fb6bf6'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.318690 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b5335663504af0bcdbeeaae2fb6bf6'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.319346 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b5335663504af0bcdbeeaae2fb6bf6'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.319941 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.notifications [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b5335663504af0bcdbeeaae2fb6bf6'} {{(pid=81620) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.332488 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1476/2945] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Sep 7 16:22:10 2022] DELETE /identity/v3/users/69b5335663504af0bcdbeeaae2fb6bf6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:22:10.519076 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] Authenticating user token {{(pid=81621) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:22:10.521106 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.fernet_utils [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81621) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:22:10.536403 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2ce76-6cac-4972-a374-f728d71ffd70 admin admin] Validating token access rules against request {{(pid=81621) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:22:10.597400 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246810a-a7e2-411f-808c-3e6ddf52a415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce735e61d3c64f3e9c5c513c8681f881', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fca4039aaacb4eb6975387ddf331698c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81621) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:22:10.598089 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246810a-a7e2-411f-808c-3e6ddf52a415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:22:10.598366 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246810a-a7e2-411f-808c-3e6ddf52a415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:22:10.598633 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246810a-a7e2-411f-808c-3e6ddf52a415 admin admin] PATH_INFO: `/v3/projects/75c497d245d346289104917ea13d6973` {{(pid=81621) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:22:10.599796 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246810a-a7e2-411f-808c-3e6ddf52a415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c497d245d346289104917ea13d6973)` {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:22:10.601742 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246810a-a7e2-411f-808c-3e6ddf52a415 admin admin] RBAC: Authorization granted {{(pid=81621) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:22:10.615717 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:22:10.656528 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9246810a-a7e2-411f-808c-3e6ddf52a415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c497d245d346289104917ea13d6973', 'request_id': 'req-9246810a-a7e2-411f-808c-3e6ddf52a415'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.666182 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9246810a-a7e2-411f-808c-3e6ddf52a415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c497d245d346289104917ea13d6973', 'request_id': 'req-9246810a-a7e2-411f-808c-3e6ddf52a415'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.672095 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9246810a-a7e2-411f-808c-3e6ddf52a415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c497d245d346289104917ea13d6973', 'request_id': 'req-9246810a-a7e2-411f-808c-3e6ddf52a415'} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.684604 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9246810a-a7e2-411f-808c-3e6ddf52a415 admin admin] The token cache is being invalidate because project 75c497d245d346289104917ea13d6973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81621) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:22:10.684930 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9246810a-a7e2-411f-808c-3e6ddf52a415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.685594 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG keystone.notifications [None req-9246810a-a7e2-411f-808c-3e6ddf52a415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81621) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:22:10.687099 dv-cinder-856174-1-smb devstack@keystone.service[81621]: [pid: 81621|app: 0|req: 1470/2946] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Sep 7 16:22:10 2022] DELETE /identity/v3/projects/75c497d245d346289104917ea13d6973 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:22:20.328509 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:22:20.681455 dv-cinder-856174-1-smb devstack@keystone.service[81621]: DEBUG dbcounter [-] [81621] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:24:46.072563 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] Authenticating user token {{(pid=81620) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:24:46.073996 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:24:46.143859 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00ee40-f522-48d7-947c-f5bb0a619894 admin admin] Validating token access rules against request {{(pid=81620) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:24:46.204046 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae157d7e-585c-4706-a8f6-d625c564d12f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b918da0f83754f3887de1cfa2e4df028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '983beac5fc784756b6bdf11b07e219ac', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81620) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:24:46.204657 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae157d7e-585c-4706-a8f6-d625c564d12f service placement] REQUEST_METHOD: `GET` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:24:46.204962 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae157d7e-585c-4706-a8f6-d625c564d12f service placement] SCRIPT_NAME: `/identity` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:24:46.205237 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae157d7e-585c-4706-a8f6-d625c564d12f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81620) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:24:46.206954 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.fernet_utils [None req-ae157d7e-585c-4706-a8f6-d625c564d12f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81620) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:24:46.218526 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae157d7e-585c-4706-a8f6-d625c564d12f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:24:46.220110 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae157d7e-585c-4706-a8f6-d625c564d12f service placement] RBAC: Authorization granted {{(pid=81620) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:24:46.230212 dv-cinder-856174-1-smb devstack@keystone.service[81620]: [pid: 81620|app: 0|req: 1477/2947] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Sep 7 16:24:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:24:56.225784 dv-cinder-856174-1-smb devstack@keystone.service[81620]: DEBUG dbcounter [-] [81620] Writing DB stats keystone:SELECT=58 {{(pid=81620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}